[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:15:12.526188  7076 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.233.62:40373
I20260709 13:15:12.527647  7076 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:15:12.528676  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:12.543166  7083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:12.543174  7082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:12.546020  7076 server_base.cc:1061] running on GCE node
W20260709 13:15:12.545456  7085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:13.751216  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:13.751488  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:13.751659  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602913751639 us; error 0 us; skew 500 ppm
I20260709 13:15:13.752614  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:13.758975  7076 webserver.cc:533] Webserver started at http://127.6.233.62:44137/ using document root <none> and password file <none>
I20260709 13:15:13.759924  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:13.760210  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:13.760684  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:13.766997  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/master-0-root/instance:
uuid: "0291129818ea4c18ae5ddf705e69dd7b"
format_stamp: "Formatted at 2026-07-09 13:15:13 on dist-test-slave-sjgx"
I20260709 13:15:13.775194  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.010s	sys 0.000s
I20260709 13:15:13.780500  7091 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:13.781775  7076 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:13.782100  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/master-0-root
uuid: "0291129818ea4c18ae5ddf705e69dd7b"
format_stamp: "Formatted at 2026-07-09 13:15:13 on dist-test-slave-sjgx"
I20260709 13:15:13.782395  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:13.846560  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:13.848137  7076 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:15:13.848572  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:13.920390  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.62:40373
I20260709 13:15:13.920471  7142 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.62:40373 every 8 connection(s)
I20260709 13:15:13.928617  7143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:13.950312  7143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b: Bootstrap starting.
I20260709 13:15:13.956218  7143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.958053  7143 log.cc:826] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b: Log is configured to *not* fsync() on all Append() calls
I20260709 13:15:13.962558  7143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b: No bootstrap required, opened a new log
I20260709 13:15:13.983134  7143 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0291129818ea4c18ae5ddf705e69dd7b" member_type: VOTER }
I20260709 13:15:13.983691  7143 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.984000  7143 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291129818ea4c18ae5ddf705e69dd7b, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.985008  7143 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0291129818ea4c18ae5ddf705e69dd7b" member_type: VOTER }
I20260709 13:15:13.985500  7143 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:13.985821  7143 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:13.986160  7143 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.990289  7143 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0291129818ea4c18ae5ddf705e69dd7b" member_type: VOTER }
I20260709 13:15:13.991051  7143 leader_election.cc:304] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0291129818ea4c18ae5ddf705e69dd7b; no voters: 
I20260709 13:15:13.992780  7143 leader_election.cc:290] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:13.993177  7146 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.995846  7146 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 1 LEADER]: Becoming Leader. State: Replica: 0291129818ea4c18ae5ddf705e69dd7b, State: Running, Role: LEADER
I20260709 13:15:13.996804  7146 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0291129818ea4c18ae5ddf705e69dd7b" member_type: VOTER }
I20260709 13:15:13.997776  7143 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:14.006971  7147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0291129818ea4c18ae5ddf705e69dd7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0291129818ea4c18ae5ddf705e69dd7b" member_type: VOTER } }
I20260709 13:15:14.007543  7147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:14.007961  7148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0291129818ea4c18ae5ddf705e69dd7b. Latest consensus state: current_term: 1 leader_uuid: "0291129818ea4c18ae5ddf705e69dd7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0291129818ea4c18ae5ddf705e69dd7b" member_type: VOTER } }
I20260709 13:15:14.008793  7148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:14.010733  7155 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:14.024691  7155 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:14.027036  7076 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:14.040381  7155 catalog_manager.cc:1383] Generated new cluster ID: fc50b9611c8a400ca321e90af88490d1
I20260709 13:15:14.040715  7155 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:14.071205  7155 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:14.073354  7155 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:14.095273  7155 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b: Generated new TSK 0
I20260709 13:15:14.096495  7155 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:14.157991  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:14.166915  7165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:14.168273  7166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:14.172025  7168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:14.172804  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:14.173686  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:14.173950  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:14.174149  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602914174130 us; error 0 us; skew 500 ppm
I20260709 13:15:14.174943  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:14.178898  7076 webserver.cc:533] Webserver started at http://127.6.233.1:38799/ using document root <none> and password file <none>
I20260709 13:15:14.179576  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:14.179823  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:14.180187  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:14.181686  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-0-root/instance:
uuid: "ae34dfe761db4265b3d72da4731ca426"
format_stamp: "Formatted at 2026-07-09 13:15:14 on dist-test-slave-sjgx"
I20260709 13:15:14.188532  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:15:14.193524  7173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:14.194423  7076 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:15:14.194753  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "ae34dfe761db4265b3d72da4731ca426"
format_stamp: "Formatted at 2026-07-09 13:15:14 on dist-test-slave-sjgx"
I20260709 13:15:14.195111  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:14.216338  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:14.218094  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:14.220849  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:14.226145  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:14.226440  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:14.226755  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:14.226984  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:14.325691  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:39733
I20260709 13:15:14.325831  7235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:39733 every 8 connection(s)
I20260709 13:15:14.333178  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:14.343456  7240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:14.344867  7241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:14.350489  7243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:14.351188  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:14.352172  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:14.352394  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:14.352577  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602914352559 us; error 0 us; skew 500 ppm
I20260709 13:15:14.353339  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:14.358062  7076 webserver.cc:533] Webserver started at http://127.6.233.2:36795/ using document root <none> and password file <none>
I20260709 13:15:14.358752  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:14.359001  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:14.359315  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:14.359495  7236 heartbeater.cc:344] Connected to a master server at 127.6.233.62:40373
I20260709 13:15:14.359871  7236 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:14.360837  7236 heartbeater.cc:507] Master 127.6.233.62:40373 requested a full tablet report, sending...
I20260709 13:15:14.360759  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-1-root/instance:
uuid: "5da8bd59d9db4743b7723b1c7203d719"
format_stamp: "Formatted at 2026-07-09 13:15:14 on dist-test-slave-sjgx"
I20260709 13:15:14.364135  7108 ts_manager.cc:194] Registered new tserver with Master: ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733)
I20260709 13:15:14.367225  7108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40060
I20260709 13:15:14.376758  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.014s	user 0.000s	sys 0.011s
I20260709 13:15:14.383533  7248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:14.384758  7076 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.001s
I20260709 13:15:14.385085  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-1-root
uuid: "5da8bd59d9db4743b7723b1c7203d719"
format_stamp: "Formatted at 2026-07-09 13:15:14 on dist-test-slave-sjgx"
I20260709 13:15:14.385433  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:14.400723  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:14.402328  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:14.404771  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:14.408387  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:14.408648  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:14.408926  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:14.409133  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:14.496030  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.2:36697
I20260709 13:15:14.496316  7311 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.2:36697 every 8 connection(s)
I20260709 13:15:14.503640  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:14.511023  7315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:14.512976  7316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:14.518337  7312 heartbeater.cc:344] Connected to a master server at 127.6.233.62:40373
I20260709 13:15:14.518843  7312 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:14.520037  7312 heartbeater.cc:507] Master 127.6.233.62:40373 requested a full tablet report, sending...
I20260709 13:15:14.522634  7108 ts_manager.cc:194] Registered new tserver with Master: 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:14.524336  7108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40062
I20260709 13:15:14.525681  7076 server_base.cc:1061] running on GCE node
W20260709 13:15:14.526926  7318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:14.528419  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:14.528676  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:14.528867  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602914528852 us; error 0 us; skew 500 ppm
I20260709 13:15:14.529611  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:14.532439  7076 webserver.cc:533] Webserver started at http://127.6.233.3:33699/ using document root <none> and password file <none>
I20260709 13:15:14.533043  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:14.533283  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:14.533587  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:14.534915  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-2-root/instance:
uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
format_stamp: "Formatted at 2026-07-09 13:15:14 on dist-test-slave-sjgx"
I20260709 13:15:14.540620  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:14.544641  7323 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:14.545495  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:15:14.545809  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-2-root
uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
format_stamp: "Formatted at 2026-07-09 13:15:14 on dist-test-slave-sjgx"
I20260709 13:15:14.546165  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602912355568-7076-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:14.563990  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:14.565614  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:14.568225  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:14.571837  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:14.572122  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:15:14.572400  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:14.572600  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:14.657047  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.3:40925
I20260709 13:15:14.657119  7385 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.3:40925 every 8 connection(s)
I20260709 13:15:14.674461  7386 heartbeater.cc:344] Connected to a master server at 127.6.233.62:40373
I20260709 13:15:14.674903  7386 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:14.675726  7386 heartbeater.cc:507] Master 127.6.233.62:40373 requested a full tablet report, sending...
I20260709 13:15:14.677819  7108 ts_manager.cc:194] Registered new tserver with Master: 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:14.678876  7076 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015734516s
I20260709 13:15:14.679314  7108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40074
I20260709 13:15:14.728006  7108 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40080:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:14.731540  7108 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:14.846402  7200 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2ba9aa737426a88c949c7d3f2ac75 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:14.846203  7201 tablet_service.cc:1511] Processing CreateTablet for tablet 14184f6dc18f45198cc304c2a48350ef (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:14.850755  7197 tablet_service.cc:1511] Processing CreateTablet for tablet 877dbd6f29bb46f8909834b8a1fb5fbb (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:14.849413  7198 tablet_service.cc:1511] Processing CreateTablet for tablet d02861fa80824be993b57c94e95831d8 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:14.847826  7199 tablet_service.cc:1511] Processing CreateTablet for tablet b5f3163a0429429181c74a8c3b160baa (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:14.858595  7201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14184f6dc18f45198cc304c2a48350ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.859081  7195 tablet_service.cc:1511] Processing CreateTablet for tablet c204ba6ca9bc40c8b35f454c60d288bb (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:14.861176  7194 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba9c14eb37c4f819fed83f8887fb324 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:14.862742  7193 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8b974338c34da5b3947af117c93463 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:14.867981  7198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02861fa80824be993b57c94e95831d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.857653  7196 tablet_service.cc:1511] Processing CreateTablet for tablet 32b2a43acc764d729484d38fb36193f0 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:14.869552  7194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba9c14eb37c4f819fed83f8887fb324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.871580  7195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204ba6ca9bc40c8b35f454c60d288bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.872457  7196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b2a43acc764d729484d38fb36193f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.878417  7197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877dbd6f29bb46f8909834b8a1fb5fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.878374  7351 tablet_service.cc:1511] Processing CreateTablet for tablet 14184f6dc18f45198cc304c2a48350ef (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:14.885123  7347 tablet_service.cc:1511] Processing CreateTablet for tablet 877dbd6f29bb46f8909834b8a1fb5fbb (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:14.886226  7347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877dbd6f29bb46f8909834b8a1fb5fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.882599  7348 tablet_service.cc:1511] Processing CreateTablet for tablet d02861fa80824be993b57c94e95831d8 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:14.890641  7351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14184f6dc18f45198cc304c2a48350ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.890350  7193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8b974338c34da5b3947af117c93463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.891445  7346 tablet_service.cc:1511] Processing CreateTablet for tablet 32b2a43acc764d729484d38fb36193f0 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:14.887900  7345 tablet_service.cc:1511] Processing CreateTablet for tablet c204ba6ca9bc40c8b35f454c60d288bb (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:14.891804  7350 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2ba9aa737426a88c949c7d3f2ac75 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:14.894994  7348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02861fa80824be993b57c94e95831d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.897316  7349 tablet_service.cc:1511] Processing CreateTablet for tablet b5f3163a0429429181c74a8c3b160baa (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:14.895056  7344 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba9c14eb37c4f819fed83f8887fb324 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:14.901376  7350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2ba9aa737426a88c949c7d3f2ac75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.900068  7343 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8b974338c34da5b3947af117c93463 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:14.908555  7346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b2a43acc764d729484d38fb36193f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.919047  7345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204ba6ca9bc40c8b35f454c60d288bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.923233  7349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f3163a0429429181c74a8c3b160baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.922209  7200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2ba9aa737426a88c949c7d3f2ac75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.931381  7344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba9c14eb37c4f819fed83f8887fb324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.931488  7277 tablet_service.cc:1511] Processing CreateTablet for tablet 14184f6dc18f45198cc304c2a48350ef (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:14.934326  7277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14184f6dc18f45198cc304c2a48350ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.939070  7199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f3163a0429429181c74a8c3b160baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.939733  7343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8b974338c34da5b3947af117c93463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.939810  7276 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2ba9aa737426a88c949c7d3f2ac75 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:14.950702  7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2ba9aa737426a88c949c7d3f2ac75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:14.942965  7275 tablet_service.cc:1511] Processing CreateTablet for tablet b5f3163a0429429181c74a8c3b160baa (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:14.967587  7273 tablet_service.cc:1511] Processing CreateTablet for tablet 877dbd6f29bb46f8909834b8a1fb5fbb (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:14.972724  7274 tablet_service.cc:1511] Processing CreateTablet for tablet d02861fa80824be993b57c94e95831d8 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:14.984529  7275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f3163a0429429181c74a8c3b160baa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:15.010458  7272 tablet_service.cc:1511] Processing CreateTablet for tablet 32b2a43acc764d729484d38fb36193f0 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:15.013384  7273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877dbd6f29bb46f8909834b8a1fb5fbb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:15.018137  7156 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:15.019320  7272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32b2a43acc764d729484d38fb36193f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:15.041913  7270 tablet_service.cc:1511] Processing CreateTablet for tablet c204ba6ca9bc40c8b35f454c60d288bb (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:15.040751  7274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02861fa80824be993b57c94e95831d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:15.061029  7270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204ba6ca9bc40c8b35f454c60d288bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:15.060916  7269 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba9c14eb37c4f819fed83f8887fb324 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:15.070770  7269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba9c14eb37c4f819fed83f8887fb324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:15.069834  7268 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8b974338c34da5b3947af117c93463 (DEFAULT_TABLE table=test-workload [id=d381a55b866742a5892d7eeb394310be]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:15.073083  7404 tablet_bootstrap.cc:492] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.074332  7268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8b974338c34da5b3947af117c93463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:15.218274  7404 tablet_bootstrap.cc:654] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.226082  7406 tablet_bootstrap.cc:492] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.239952  7405 tablet_bootstrap.cc:492] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.243498  7406 tablet_bootstrap.cc:654] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.244230  7404 tablet_bootstrap.cc:492] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.244711  7404 ts_tablet_manager.cc:1403] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.174s	user 0.013s	sys 0.005s
I20260709 13:15:15.248217  7404 raft_consensus.cc:359] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.248987  7404 raft_consensus.cc:385] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.249084  7405 tablet_bootstrap.cc:654] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.249330  7404 raft_consensus.cc:740] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.250098  7404 consensus_queue.cc:260] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.255532  7406 tablet_bootstrap.cc:492] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.256127  7406 ts_tablet_manager.cc:1403] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.007s
I20260709 13:15:15.259899  7406 raft_consensus.cc:359] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.260980  7406 raft_consensus.cc:385] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.261368  7406 raft_consensus.cc:740] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.262336  7406 consensus_queue.cc:260] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.265832  7236 heartbeater.cc:499] Master 127.6.233.62:40373 was elected leader, sending a full tablet report...
I20260709 13:15:15.266116  7404 ts_tablet_manager.cc:1434] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.013s
I20260709 13:15:15.267180  7404 tablet_bootstrap.cc:492] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.273802  7404 tablet_bootstrap.cc:654] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.289343  7386 heartbeater.cc:499] Master 127.6.233.62:40373 was elected leader, sending a full tablet report...
I20260709 13:15:15.290174  7405 tablet_bootstrap.cc:492] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.290632  7405 ts_tablet_manager.cc:1403] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.061s	user 0.028s	sys 0.015s
I20260709 13:15:15.292183  7404 tablet_bootstrap.cc:492] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.292682  7404 ts_tablet_manager.cc:1403] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.019s
I20260709 13:15:15.294488  7406 ts_tablet_manager.cc:1434] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:15:15.294173  7405 raft_consensus.cc:359] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.294904  7405 raft_consensus.cc:385] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.295235  7405 raft_consensus.cc:740] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.295482  7406 tablet_bootstrap.cc:492] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.296175  7404 raft_consensus.cc:359] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.296991  7404 raft_consensus.cc:385] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.297364  7404 raft_consensus.cc:740] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.295967  7405 consensus_queue.cc:260] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.298095  7404 consensus_queue.cc:260] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.300685  7404 ts_tablet_manager.cc:1434] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:15:15.301664  7404 tablet_bootstrap.cc:492] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.303746  7406 tablet_bootstrap.cc:654] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.308212  7404 tablet_bootstrap.cc:654] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.309350  7312 heartbeater.cc:499] Master 127.6.233.62:40373 was elected leader, sending a full tablet report...
I20260709 13:15:15.311980  7405 ts_tablet_manager.cc:1434] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:15:15.313278  7405 tablet_bootstrap.cc:492] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.323181  7406 tablet_bootstrap.cc:492] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.323680  7406 ts_tablet_manager.cc:1403] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.011s
I20260709 13:15:15.324568  7405 tablet_bootstrap.cc:654] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.326515  7406 raft_consensus.cc:359] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.327299  7406 raft_consensus.cc:385] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.327630  7406 raft_consensus.cc:740] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.332280  7404 tablet_bootstrap.cc:492] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.332763  7404 ts_tablet_manager.cc:1403] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.008s
W20260709 13:15:15.332873  7237 tablet.cc:2406] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:15.335708  7404 raft_consensus.cc:359] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.336485  7404 raft_consensus.cc:385] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.336808  7404 raft_consensus.cc:740] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.337456  7404 consensus_queue.cc:260] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.338243  7405 tablet_bootstrap.cc:492] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.338680  7405 ts_tablet_manager.cc:1403] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 13:15:15.339212  7404 ts_tablet_manager.cc:1434] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:15:15.339944  7404 tablet_bootstrap.cc:492] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.340588  7406 consensus_queue.cc:260] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.341650  7405 raft_consensus.cc:359] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.342375  7405 raft_consensus.cc:385] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.342705  7405 raft_consensus.cc:740] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.344187  7406 ts_tablet_manager.cc:1434] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:15:15.348515  7406 tablet_bootstrap.cc:492] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.343649  7405 consensus_queue.cc:260] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.353552  7413 raft_consensus.cc:493] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.353868  7405 ts_tablet_manager.cc:1434] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:15:15.354091  7413 raft_consensus.cc:515] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.354841  7405 tablet_bootstrap.cc:492] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.357623  7413 leader_election.cc:290] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:15.346871  7404 tablet_bootstrap.cc:654] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.367664  7406 tablet_bootstrap.cc:654] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.392134  7404 tablet_bootstrap.cc:492] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.395962  7405 tablet_bootstrap.cc:654] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.396430  7404 ts_tablet_manager.cc:1403] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.000s
I20260709 13:15:15.400832  7406 tablet_bootstrap.cc:492] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.400765  7404 raft_consensus.cc:359] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.401414  7406 ts_tablet_manager.cc:1403] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.007s
I20260709 13:15:15.401578  7404 raft_consensus.cc:385] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.401925  7404 raft_consensus.cc:740] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.402669  7404 consensus_queue.cc:260] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.404814  7404 ts_tablet_manager.cc:1434] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:15:15.405750  7404 tablet_bootstrap.cc:492] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.408977  7406 raft_consensus.cc:359] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.409878  7406 raft_consensus.cc:385] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.410511  7406 raft_consensus.cc:740] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.411716  7406 consensus_queue.cc:260] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.413190  7404 tablet_bootstrap.cc:654] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.415642  7406 ts_tablet_manager.cc:1434] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:15:15.419426  7406 tablet_bootstrap.cc:492] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.420426  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:15.421216  7211 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 0.
I20260709 13:15:15.422703  7252 leader_election.cc:304] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:15.423228  7411 raft_consensus.cc:493] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.423565  7413 raft_consensus.cc:2804] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.424024  7413 raft_consensus.cc:493] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.424427  7413 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.423686  7411 raft_consensus.cc:515] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.430630  7405 tablet_bootstrap.cc:492] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.431166  7405 ts_tablet_manager.cc:1403] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.002s
I20260709 13:15:15.431291  7411 leader_election.cc:290] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.435017  7405 raft_consensus.cc:359] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.436177  7405 raft_consensus.cc:385] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.436506  7405 raft_consensus.cc:740] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.437006  7413 raft_consensus.cc:515] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.437379  7405 consensus_queue.cc:260] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.440119  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:15.440732  7211 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.445765  7413 leader_election.cc:290] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:15.448789  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:15.450353  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" is_pre_election: true
I20260709 13:15:15.451179  7404 tablet_bootstrap.cc:492] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.450130  7360 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.455699  7404 ts_tablet_manager.cc:1403] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.003s
I20260709 13:15:15.461514  7406 tablet_bootstrap.cc:654] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.465294  7404 raft_consensus.cc:359] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.469264  7404 raft_consensus.cc:385] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.469686  7404 raft_consensus.cc:740] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.472468  7211 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 1.
I20260709 13:15:15.475214  7404 consensus_queue.cc:260] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.477676  7405 ts_tablet_manager.cc:1434] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.046s	user 0.019s	sys 0.025s
I20260709 13:15:15.478621  7405 tablet_bootstrap.cc:492] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.481690  7404 ts_tablet_manager.cc:1434] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:15:15.485045  7411 raft_consensus.cc:493] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.485548  7404 tablet_bootstrap.cc:492] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.485495  7411 raft_consensus.cc:515] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.488579  7411 leader_election.cc:290] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.489111  7252 leader_election.cc:304] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:15.489532  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:15.490851  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:15.493950  7210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:15.494596  7210 raft_consensus.cc:2468] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 0.
I20260709 13:15:15.495393  7211 raft_consensus.cc:2393] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20bfb4a0ce744b23ac25b32f6740acb6 in current term 1: Already voted for candidate 5da8bd59d9db4743b7723b1c7203d719 in this term.
I20260709 13:15:15.497038  7327 leader_election.cc:304] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:15.497706  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:15.500566  7411 raft_consensus.cc:2804] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.501083  7411 raft_consensus.cc:493] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.501791  7411 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:15.501886  7324 leader_election.cc:343] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.498301  7360 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 1.
I20260709 13:15:15.505820  7428 raft_consensus.cc:2804] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.506705  7428 raft_consensus.cc:697] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 1 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:15.513041  7405 tablet_bootstrap.cc:654] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.513648  7406 tablet_bootstrap.cc:492] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.513947  7411 raft_consensus.cc:515] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.514302  7428 consensus_queue.cc:237] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:15.516403  7404 tablet_bootstrap.cc:654] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.515661  7406 ts_tablet_manager.cc:1403] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.016s
I20260709 13:15:15.520656  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:15.521234  7211 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.521847  7406 raft_consensus.cc:359] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.522774  7406 raft_consensus.cc:385] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.523144  7406 raft_consensus.cc:740] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.527324  7411 leader_election.cc:290] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.534862  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
W20260709 13:15:15.536449  7324 leader_election.cc:343] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.543200  7211 raft_consensus.cc:2468] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 1.
I20260709 13:15:15.524528  7406 consensus_queue.cc:260] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.549682  7327 leader_election.cc:304] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:15.550554  7406 ts_tablet_manager.cc:1434] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:15:15.554534  7411 raft_consensus.cc:2804] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.555498  7411 raft_consensus.cc:697] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:15.556970  7406 tablet_bootstrap.cc:492] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.560799  7324 leader_election.cc:304] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6; no voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:15.560608  7411 consensus_queue.cc:237] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.560449  7105 catalog_manager.cc:5697] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.574858  7409 raft_consensus.cc:493] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.575357  7409 raft_consensus.cc:515] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.580333  7433 raft_consensus.cc:493] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.581717  7433 raft_consensus.cc:515] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.587209  7404 tablet_bootstrap.cc:492] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.590260  7404 ts_tablet_manager.cc:1403] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.013s
I20260709 13:15:15.589004  7409 leader_election.cc:290] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
W20260709 13:15:15.608227  7324 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:36697, user_credentials={real_user=slave}} blocked reactor thread for 47494us
I20260709 13:15:15.594486  7435 raft_consensus.cc:2749] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.613162  7406 tablet_bootstrap.cc:654] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.617101  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:15.618853  7433 leader_election.cc:290] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.617936  7404 raft_consensus.cc:359] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.619800  7404 raft_consensus.cc:385] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.620211  7404 raft_consensus.cc:740] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.620580  7405 tablet_bootstrap.cc:492] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.617946  7211 raft_consensus.cc:2468] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 0.
I20260709 13:15:15.621186  7404 consensus_queue.cc:260] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.623031  7327 leader_election.cc:304] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:15.623898  7433 raft_consensus.cc:2804] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.621201  7405 ts_tablet_manager.cc:1403] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.143s	user 0.021s	sys 0.015s
I20260709 13:15:15.624279  7433 raft_consensus.cc:493] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.627065  7433 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.626772  7404 ts_tablet_manager.cc:1434] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 13:15:15.634775  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:15.635115  7107 catalog_manager.cc:5697] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:15.641423  7324 leader_election.cc:343] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.639631  7404 tablet_bootstrap.cc:492] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.638206  7405 raft_consensus.cc:359] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.649248  7433 raft_consensus.cc:515] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.647173  7405 raft_consensus.cc:385] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.652192  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:15.654990  7404 tablet_bootstrap.cc:654] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.654863  7405 raft_consensus.cc:740] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.656389  7433 leader_election.cc:290] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.658206  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:15.657948  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:15.662077  7211 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:15.662624  7324 leader_election.cc:343] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.660789  7406 tablet_bootstrap.cc:492] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.657585  7405 consensus_queue.cc:260] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.664928  7406 ts_tablet_manager.cc:1403] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.108s	user 0.023s	sys 0.005s
I20260709 13:15:15.666617  7287 raft_consensus.cc:2468] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 0.
I20260709 13:15:15.668350  7405 ts_tablet_manager.cc:1434] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.006s
I20260709 13:15:15.668483  7406 raft_consensus.cc:359] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.676316  7406 raft_consensus.cc:385] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.676759  7406 raft_consensus.cc:740] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.677083  7405 tablet_bootstrap.cc:492] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.677742  7406 consensus_queue.cc:260] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.668918  7174 leader_election.cc:304] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:15.679517  7409 raft_consensus.cc:2804] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.679914  7409 raft_consensus.cc:493] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.680353  7409 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.681566  7406 ts_tablet_manager.cc:1434] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 13:15:15.682858  7406 tablet_bootstrap.cc:492] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.674342  7211 raft_consensus.cc:2468] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 1.
I20260709 13:15:15.685321  7405 tablet_bootstrap.cc:654] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.685194  7327 leader_election.cc:304] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:15.687652  7409 raft_consensus.cc:515] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.688354  7433 raft_consensus.cc:2804] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.688831  7433 raft_consensus.cc:697] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:15.689651  7433 consensus_queue.cc:237] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.689651  7409 leader_election.cc:290] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 election: Requested vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:15.693013  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:15.693790  7287 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.714042  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" is_pre_election: true
I20260709 13:15:15.714377  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:15.713318  7409 raft_consensus.cc:493] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:15.715620  7174 leader_election.cc:343] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.715868  7409 raft_consensus.cc:515] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
W20260709 13:15:15.716599  7174 leader_election.cc:343] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.704010  7287 raft_consensus.cc:2468] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 1.
I20260709 13:15:15.717636  7404 tablet_bootstrap.cc:492] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.717806  7409 leader_election.cc:290] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:15.718099  7404 ts_tablet_manager.cc:1403] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.083s	user 0.029s	sys 0.028s
I20260709 13:15:15.720227  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" is_pre_election: true
I20260709 13:15:15.720983  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:15.706893  7405 tablet_bootstrap.cc:492] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.724090  7405 ts_tablet_manager.cc:1403] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.003s
I20260709 13:15:15.726019  7406 tablet_bootstrap.cc:654] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.721940  7404 raft_consensus.cc:359] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
W20260709 13:15:15.722733  7174 leader_election.cc:343] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.728243  7404 raft_consensus.cc:385] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:15.728580  7174 leader_election.cc:343] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.729074  7174 leader_election.cc:304] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae34dfe761db4265b3d72da4731ca426; no voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:15.728578  7404 raft_consensus.cc:740] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.730291  7409 raft_consensus.cc:2749] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.730804  7174 leader_election.cc:304] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 20bfb4a0ce744b23ac25b32f6740acb6
I20260709 13:15:15.730878  7105 catalog_manager.cc:5697] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.731860  7409 raft_consensus.cc:2804] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.727442  7405 raft_consensus.cc:359] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.732535  7405 raft_consensus.cc:385] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.733003  7405 raft_consensus.cc:740] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.734158  7405 consensus_queue.cc:260] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.741150  7405 ts_tablet_manager.cc:1434] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:15.731292  7404 consensus_queue.cc:260] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.742228  7405 tablet_bootstrap.cc:492] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.748749  7409 raft_consensus.cc:697] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Becoming Leader. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:15.749653  7409 consensus_queue.cc:237] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.752238  7406 tablet_bootstrap.cc:492] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.752740  7406 ts_tablet_manager.cc:1403] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.008s
I20260709 13:15:15.753029  7405 tablet_bootstrap.cc:654] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.754140  7404 ts_tablet_manager.cc:1434] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 13:15:15.755112  7404 tablet_bootstrap.cc:492] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.755873  7406 raft_consensus.cc:359] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.756781  7406 raft_consensus.cc:385] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.757128  7406 raft_consensus.cc:740] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.758309  7406 consensus_queue.cc:260] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.759379  7405 tablet_bootstrap.cc:492] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.759907  7405 ts_tablet_manager.cc:1403] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.006s
I20260709 13:15:15.765416  7406 ts_tablet_manager.cc:1434] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:15.767681  7404 tablet_bootstrap.cc:654] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.769680  7406 tablet_bootstrap.cc:492] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.772989  7433 raft_consensus.cc:493] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.773458  7433 raft_consensus.cc:515] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.775676  7433 leader_election.cc:290] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.777056  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:15.778052  7406 tablet_bootstrap.cc:654] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.777987  7287 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 0.
I20260709 13:15:15.779387  7324 leader_election.cc:304] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: 
I20260709 13:15:15.780315  7433 raft_consensus.cc:2804] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.780812  7433 raft_consensus.cc:493] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.777114  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:15.781178  7433 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.781380  7211 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 0.
I20260709 13:15:15.780349  7405 raft_consensus.cc:359] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.783030  7405 raft_consensus.cc:385] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.783342  7405 raft_consensus.cc:740] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.784189  7405 consensus_queue.cc:260] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.786604  7405 ts_tablet_manager.cc:1434] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:15:15.787655  7405 tablet_bootstrap.cc:492] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.790355  7404 tablet_bootstrap.cc:492] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.790853  7404 ts_tablet_manager.cc:1403] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.009s
I20260709 13:15:15.773304  7107 catalog_manager.cc:5697] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae34dfe761db4265b3d72da4731ca426 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "ae34dfe761db4265b3d72da4731ca426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.793727  7404 raft_consensus.cc:359] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.796484  7404 raft_consensus.cc:385] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.794410  7406 tablet_bootstrap.cc:492] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.796840  7405 tablet_bootstrap.cc:654] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.796523  7433 raft_consensus.cc:515] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.797438  7406 ts_tablet_manager.cc:1403] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.009s
I20260709 13:15:15.800099  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:15.800365  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:15.800697  7287 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.801023  7211 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.805089  7287 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 1.
I20260709 13:15:15.805485  7433 leader_election.cc:290] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.800350  7406 raft_consensus.cc:359] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.806100  7406 raft_consensus.cc:385] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.806088  7324 leader_election.cc:304] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: 
I20260709 13:15:15.806681  7406 raft_consensus.cc:740] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.806949  7211 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 1.
I20260709 13:15:15.807125  7433 raft_consensus.cc:2804] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.807796  7433 raft_consensus.cc:697] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:15.813841  7433 consensus_queue.cc:237] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.796942  7404 raft_consensus.cc:740] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.807758  7406 consensus_queue.cc:260] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.816735  7404 consensus_queue.cc:260] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.818625  7404 ts_tablet_manager.cc:1434] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 13:15:15.818760  7406 ts_tablet_manager.cc:1434] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 13:15:15.819474  7404 tablet_bootstrap.cc:492] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426: Bootstrap starting.
I20260709 13:15:15.819574  7406 tablet_bootstrap.cc:492] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.825215  7404 tablet_bootstrap.cc:654] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.825778  7406 tablet_bootstrap.cc:654] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.825881  7405 tablet_bootstrap.cc:492] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.826361  7405 ts_tablet_manager.cc:1403] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.003s
I20260709 13:15:15.830341  7405 raft_consensus.cc:359] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.831274  7405 raft_consensus.cc:385] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.831594  7405 raft_consensus.cc:740] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.832288  7405 consensus_queue.cc:260] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.834864  7405 ts_tablet_manager.cc:1434] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:15:15.835896  7106 catalog_manager.cc:5697] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.840427  7405 tablet_bootstrap.cc:492] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.842064  7404 tablet_bootstrap.cc:492] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426: No bootstrap required, opened a new log
I20260709 13:15:15.846024  7404 ts_tablet_manager.cc:1403] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 13:15:15.849795  7404 raft_consensus.cc:359] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.850425  7404 raft_consensus.cc:385] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.850678  7404 raft_consensus.cc:740] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.851284  7404 consensus_queue.cc:260] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.853096  7405 tablet_bootstrap.cc:654] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.853477  7404 ts_tablet_manager.cc:1434] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:15.860452  7405 tablet_bootstrap.cc:492] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.860905  7405 ts_tablet_manager.cc:1403] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.001s
I20260709 13:15:15.863960  7405 raft_consensus.cc:359] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.864677  7405 raft_consensus.cc:385] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.864936  7405 raft_consensus.cc:740] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.865531  7405 consensus_queue.cc:260] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.867681  7405 ts_tablet_manager.cc:1434] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:15.868724  7405 tablet_bootstrap.cc:492] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719: Bootstrap starting.
I20260709 13:15:15.874106  7405 tablet_bootstrap.cc:654] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.890637  7405 tablet_bootstrap.cc:492] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719: No bootstrap required, opened a new log
I20260709 13:15:15.891151  7405 ts_tablet_manager.cc:1403] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:15:15.893139  7428 raft_consensus.cc:493] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.893692  7428 raft_consensus.cc:515] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.894652  7405 raft_consensus.cc:359] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.895285  7406 tablet_bootstrap.cc:492] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.895853  7406 ts_tablet_manager.cc:1403] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.037s
I20260709 13:15:15.895385  7405 raft_consensus.cc:385] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.896570  7428 leader_election.cc:290] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:15.896826  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204ba6ca9bc40c8b35f454c60d288bb" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:15.897274  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204ba6ca9bc40c8b35f454c60d288bb" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" is_pre_election: true
I20260709 13:15:15.897449  7211 raft_consensus.cc:2468] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 0.
I20260709 13:15:15.897898  7361 raft_consensus.cc:2468] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 0.
I20260709 13:15:15.898452  7406 raft_consensus.cc:359] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.898783  7252 leader_election.cc:304] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:15.899155  7406 raft_consensus.cc:385] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.896301  7405 raft_consensus.cc:740] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.899415  7406 raft_consensus.cc:740] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.899912  7428 raft_consensus.cc:2804] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.900331  7428 raft_consensus.cc:493] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.900324  7406 consensus_queue.cc:260] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.900925  7428 raft_consensus.cc:3060] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.900377  7405 consensus_queue.cc:260] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.902472  7406 ts_tablet_manager.cc:1434] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:15.902997  7405 ts_tablet_manager.cc:1434] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:15:15.903318  7406 tablet_bootstrap.cc:492] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6: Bootstrap starting.
I20260709 13:15:15.908520  7433 raft_consensus.cc:493] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.909013  7433 raft_consensus.cc:515] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.909909  7406 tablet_bootstrap.cc:654] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.911062  7433 leader_election.cc:290] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.912657  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8b974338c34da5b3947af117c93463" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:15.913296  7287 raft_consensus.cc:2468] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 0.
I20260709 13:15:15.913444  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8b974338c34da5b3947af117c93463" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:15.914124  7211 raft_consensus.cc:2468] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 0.
I20260709 13:15:15.914525  7324 leader_election.cc:304] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: 
I20260709 13:15:15.915410  7433 raft_consensus.cc:2804] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.915786  7433 raft_consensus.cc:493] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.908540  7428 raft_consensus.cc:515] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.916247  7433 raft_consensus.cc:3060] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.918644  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204ba6ca9bc40c8b35f454c60d288bb" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:15.919157  7211 raft_consensus.cc:3060] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.922887  7433 raft_consensus.cc:515] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.925833  7210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8b974338c34da5b3947af117c93463" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:15.926389  7210 raft_consensus.cc:3060] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.927076  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b8b974338c34da5b3947af117c93463" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:15.927659  7287 raft_consensus.cc:3060] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.928169  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204ba6ca9bc40c8b35f454c60d288bb" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:15.928737  7361 raft_consensus.cc:3060] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.930114  7433 leader_election.cc:290] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:15.931301  7428 leader_election.cc:290] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:15.925446  7211 raft_consensus.cc:2468] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 1.
I20260709 13:15:15.937340  7252 leader_election.cc:304] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:15.937362  7287 raft_consensus.cc:2468] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 1.
I20260709 13:15:15.939455  7210 raft_consensus.cc:2468] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 1.
I20260709 13:15:15.939496  7324 leader_election.cc:304] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: 
I20260709 13:15:15.940724  7428 raft_consensus.cc:2804] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.941748  7428 raft_consensus.cc:697] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 1 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:15.941777  7433 raft_consensus.cc:2804] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.944530  7433 raft_consensus.cc:697] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:15.945443  7433 consensus_queue.cc:237] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.946213  7406 tablet_bootstrap.cc:492] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6: No bootstrap required, opened a new log
I20260709 13:15:15.947134  7406 ts_tablet_manager.cc:1403] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.011s
I20260709 13:15:15.943781  7361 raft_consensus.cc:2468] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 1.
I20260709 13:15:15.950486  7406 raft_consensus.cc:359] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.951148  7406 raft_consensus.cc:385] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.951390  7406 raft_consensus.cc:740] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.952028  7406 consensus_queue.cc:260] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.953043  7428 consensus_queue.cc:237] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.953761  7406 ts_tablet_manager.cc:1434] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:15.955513  7106 catalog_manager.cc:5697] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.963503  7107 catalog_manager.cc:5697] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.994330  7409 raft_consensus.cc:493] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.994835  7409 raft_consensus.cc:515] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:15.996516  7409 leader_election.cc:290] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:15.997409  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:15.997854  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" is_pre_election: true
I20260709 13:15:15.998052  7287 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 0.
I20260709 13:15:15.998432  7361 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 0.
I20260709 13:15:15.999128  7174 leader_election.cc:304] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:15.999882  7409 raft_consensus.cc:2804] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.000264  7409 raft_consensus.cc:493] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.000574  7409 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.004621  7409 raft_consensus.cc:515] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.006883  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:16.007201  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:16.007516  7287 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.007795  7361 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.006197  7409 leader_election.cc:290] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 election: Requested vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:16.013478  7361 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 1.
I20260709 13:15:16.014678  7174 leader_election.cc:304] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:16.015439  7409 raft_consensus.cc:2804] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.015477  7287 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 1.
I20260709 13:15:16.016014  7409 raft_consensus.cc:697] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Becoming Leader. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:16.017060  7409 consensus_queue.cc:237] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.023178  7428 consensus_queue.cc:1048] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:16.024879  7433 raft_consensus.cc:493] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:16.025640  7156 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:16.025527  7433 raft_consensus.cc:515] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.027799  7433 leader_election.cc:290] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:16.028935  7210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:16.029253  7287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:16.029672  7210 raft_consensus.cc:2468] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 0.
I20260709 13:15:16.029906  7287 raft_consensus.cc:2468] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 0.
I20260709 13:15:16.030825  7327 leader_election.cc:304] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:16.031482  7433 raft_consensus.cc:2804] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.031810  7433 raft_consensus.cc:493] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.032133  7433 raft_consensus.cc:3060] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.035152  7106 catalog_manager.cc:5697] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae34dfe761db4265b3d72da4731ca426 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "ae34dfe761db4265b3d72da4731ca426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.039973  7287 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.042039  7413 consensus_queue.cc:1048] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.048236  7434 consensus_queue.cc:1048] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:16.038615  7433 raft_consensus.cc:515] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.062913  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:16.063078  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:16.063731  7211 raft_consensus.cc:3060] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.063897  7285 raft_consensus.cc:3060] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.073566  7433 leader_election.cc:290] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:16.075634  7211 raft_consensus.cc:2468] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 1.
I20260709 13:15:16.075634  7285 raft_consensus.cc:2468] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 1.
I20260709 13:15:16.076924  7327 leader_election.cc:304] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:16.077850  7433 raft_consensus.cc:2804] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.081002  7433 raft_consensus.cc:697] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:16.082494  7433 consensus_queue.cc:237] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.095685  7411 consensus_queue.cc:1048] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:16.102082  7106 catalog_manager.cc:5697] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:16.128954  7433 raft_consensus.cc:493] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.129380  7433 raft_consensus.cc:515] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.131276  7433 leader_election.cc:290] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:16.131953  7210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:16.132726  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5da8bd59d9db4743b7723b1c7203d719" is_pre_election: true
I20260709 13:15:16.133446  7286 raft_consensus.cc:2393] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20bfb4a0ce744b23ac25b32f6740acb6 in current term 1: Already voted for candidate ae34dfe761db4265b3d72da4731ca426 in this term.
I20260709 13:15:16.134316  7324 leader_election.cc:304] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6; no voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:16.134946  7433 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.139508  7433 raft_consensus.cc:2749] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.157838  7409 consensus_queue.cc:1048] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.166706  7448 consensus_queue.cc:1048] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.170632  7428 raft_consensus.cc:493] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.171171  7428 raft_consensus.cc:515] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.173697  7428 leader_election.cc:290] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:16.175509  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" is_pre_election: true
I20260709 13:15:16.181000  7210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae34dfe761db4265b3d72da4731ca426" is_pre_election: true
I20260709 13:15:16.181769  7210 raft_consensus.cc:2393] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5da8bd59d9db4743b7723b1c7203d719 in current term 1: Already voted for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in this term.
I20260709 13:15:16.182737  7252 leader_election.cc:304] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719; no voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:16.183492  7428 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.189574  7428 raft_consensus.cc:2749] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.276124  7433 consensus_queue.cc:1048] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.288269  7411 consensus_queue.cc:1048] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:16.295697  7411 consensus_queue.cc:1048] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.296480  7434 consensus_queue.cc:1048] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.349568  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
mode: GRACEFUL
new_leader_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:58318
I20260709 13:15:16.350281  7286 raft_consensus.cc:606] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 1 LEADER]: Received request to transfer leadership to TS ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:16.363559  7361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
mode: GRACEFUL
new_leader_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:15:16.364118  7361 raft_consensus.cc:606] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Received request to transfer leadership to TS ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:16.369180  7361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
mode: GRACEFUL
new_leader_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:15:16.369689  7361 raft_consensus.cc:606] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Received request to transfer leadership to TS ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:16.384883  7434 consensus_queue.cc:1048] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.391547  7210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
mode: GRACEFUL
new_leader_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:15:16.392139  7210 raft_consensus.cc:606] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Received request to transfer leadership to TS 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:16.398248  7411 consensus_queue.cc:1048] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.402513  7361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
mode: GRACEFUL
new_leader_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:15:16.403102  7361 raft_consensus.cc:606] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Received request to transfer leadership to TS 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:16.413740  7361 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
mode: GRACEFUL
new_leader_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:15:16.414367  7361 raft_consensus.cc:606] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Received request to transfer leadership to TS 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:16.443153  7428 consensus_queue.cc:1048] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.455304  7413 consensus_queue.cc:1048] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.479278  7411 consensus_queue.cc:1048] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.486914  7411 raft_consensus.cc:993] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6: : Instructing follower 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:16.487386  7411 raft_consensus.cc:1081] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Signalling peer 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:16.491707  7286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:15:16.492313  7286 raft_consensus.cc:493] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.492723  7286 raft_consensus.cc:3060] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.492519  7411 consensus_queue.cc:1048] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:16.503568  7286 raft_consensus.cc:515] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.506157  7210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:16.506413  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba9c14eb37c4f819fed83f8887fb324" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:16.506934  7361 raft_consensus.cc:3055] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.507268  7361 raft_consensus.cc:740] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:16.508113  7361 consensus_queue.cc:260] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.509016  7361 raft_consensus.cc:3060] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.515308  7361 raft_consensus.cc:2468] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 2.
I20260709 13:15:16.516165  7286 leader_election.cc:290] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 2 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:16.516615  7249 leader_election.cc:304] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:16.517416  7413 raft_consensus.cc:2804] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.517902  7413 raft_consensus.cc:697] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:16.518618  7413 consensus_queue.cc:237] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.526000  7106 catalog_manager.cc:5697] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 1 to 2, leader changed from 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3) to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.554993  7448 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.562861  7447 raft_consensus.cc:993] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426: : Instructing follower 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:16.563323  7447 raft_consensus.cc:1081] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Signalling peer 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:16.565873  7286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:58308
I20260709 13:15:16.566412  7286 raft_consensus.cc:493] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.566802  7286 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.570314  7447 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.574659  7286 raft_consensus.cc:515] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.575866  7285 raft_consensus.cc:1240] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Rejecting Update request from peer ae34dfe761db4265b3d72da4731ca426 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:16.579449  7447 consensus_queue.cc:1059] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.580148  7286 leader_election.cc:290] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 2 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:16.581472  7447 raft_consensus.cc:3055] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.581840  7447 raft_consensus.cc:740] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:16.581902  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:16.583498  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:16.584205  7361 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.584513  7447 consensus_queue.cc:260] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.585788  7447 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.591395  7361 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 2.
I20260709 13:15:16.592700  7249 leader_election.cc:304] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: 
I20260709 13:15:16.593389  7413 raft_consensus.cc:2804] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.593825  7413 raft_consensus.cc:697] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:16.594516  7413 consensus_queue.cc:237] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.598579  7211 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 2.
I20260709 13:15:16.601269  7106 catalog_manager.cc:5697] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 1 to 2, leader changed from ae34dfe761db4265b3d72da4731ca426 (127.6.233.1) to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.629577  7466 raft_consensus.cc:993] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719: : Instructing follower ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:16.630033  7413 raft_consensus.cc:1081] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 1 LEADER]: Signalling peer ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:16.631597  7211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:38842
I20260709 13:15:16.632184  7211 raft_consensus.cc:493] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.632552  7211 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.639117  7211 raft_consensus.cc:515] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:16.641269  7211 leader_election.cc:290] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 2 election: Requested vote from peers 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:16.642114  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:16.642413  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:16.642724  7361 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.643013  7285 raft_consensus.cc:3055] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.643360  7285 raft_consensus.cc:740] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:16.644176  7285 consensus_queue.cc:260] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:16.645412  7285 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.647590  7361 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 2.
I20260709 13:15:16.649559  7174 leader_election.cc:304] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:16.650365  7447 raft_consensus.cc:2804] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.650822  7447 raft_consensus.cc:697] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Becoming Leader. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:16.651520  7447 consensus_queue.cc:237] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:16.652359  7285 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 2.
I20260709 13:15:16.658576  7106 catalog_manager.cc:5697] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 reported cstate change: term changed from 1 to 2, leader changed from 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2) to ae34dfe761db4265b3d72da4731ca426 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "ae34dfe761db4265b3d72da4731ca426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.664954  7433 raft_consensus.cc:993] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6: : Instructing follower ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:16.665661  7433 raft_consensus.cc:1081] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Signalling peer ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:16.667358  7211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:38850
I20260709 13:15:16.667990  7211 raft_consensus.cc:493] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.668380  7211 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.673008  7211 raft_consensus.cc:515] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.674846  7211 leader_election.cc:290] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 2 election: Requested vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:16.676270  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:16.676858  7361 raft_consensus.cc:3055] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.677183  7361 raft_consensus.cc:740] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:16.677125  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:16.678323  7286 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.678102  7361 consensus_queue.cc:260] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.679673  7361 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.682900  7286 raft_consensus.cc:2468] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 2.
I20260709 13:15:16.683998  7174 leader_election.cc:304] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:16.684746  7447 raft_consensus.cc:2804] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.685228  7447 raft_consensus.cc:697] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Becoming Leader. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:16.685922  7447 consensus_queue.cc:237] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.686905  7361 raft_consensus.cc:2468] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 2.
I20260709 13:15:16.693266  7105 catalog_manager.cc:5697] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 reported cstate change: term changed from 1 to 2, leader changed from 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3) to ae34dfe761db4265b3d72da4731ca426 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "ae34dfe761db4265b3d72da4731ca426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.695410  7411 raft_consensus.cc:993] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6: : Instructing follower ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:16.695868  7434 raft_consensus.cc:1081] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Signalling peer ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:16.697512  7211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:38850
I20260709 13:15:16.698057  7211 raft_consensus.cc:493] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.698405  7211 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.705097  7211 raft_consensus.cc:515] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.708164  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:16.708781  7285 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.716144  7285 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 2.
I20260709 13:15:16.717406  7174 leader_election.cc:304] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:16.718288  7447 raft_consensus.cc:2804] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.718858  7447 raft_consensus.cc:697] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Becoming Leader. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:16.719609  7447 consensus_queue.cc:237] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.723011  7211 leader_election.cc:290] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 2 election: Requested vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:16.723220  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:16.723919  7361 raft_consensus.cc:3055] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.724327  7361 raft_consensus.cc:740] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:16.725131  7361 consensus_queue.cc:260] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.726277  7361 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.727003  7105 catalog_manager.cc:5697] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 reported cstate change: term changed from 1 to 2, leader changed from 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3) to ae34dfe761db4265b3d72da4731ca426 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "ae34dfe761db4265b3d72da4731ca426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.731653  7361 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 2.
I20260709 13:15:16.754887  7434 raft_consensus.cc:993] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6: : Instructing follower 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:16.755375  7411 raft_consensus.cc:1081] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Signalling peer 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:16.756951  7285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:15:16.757483  7285 raft_consensus.cc:493] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:16.757870  7285 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.762192  7285 raft_consensus.cc:515] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.764575  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:16.764744  7361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:16.765072  7211 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.765326  7361 raft_consensus.cc:3055] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:16.765653  7361 raft_consensus.cc:740] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:16.766404  7361 consensus_queue.cc:260] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.767445  7361 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:16.768000  7285 leader_election.cc:290] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 2 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:16.770970  7211 raft_consensus.cc:2468] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 2.
I20260709 13:15:16.771947  7252 leader_election.cc:304] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:16.772694  7413 raft_consensus.cc:2804] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:16.773118  7413 raft_consensus.cc:697] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:16.773829  7361 raft_consensus.cc:2468] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 2.
I20260709 13:15:16.773921  7413 consensus_queue.cc:237] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:16.779886  7105 catalog_manager.cc:5697] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 1 to 2, leader changed from 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3) to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.998270  7211 raft_consensus.cc:1275] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:16.999786  7413 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.009615  7361 raft_consensus.cc:1275] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.011015  7466 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.020226  7361 raft_consensus.cc:1275] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.021867  7466 consensus_queue.cc:1048] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.037604  7210 raft_consensus.cc:3060] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.038681  7361 raft_consensus.cc:1275] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.040071  7447 consensus_queue.cc:1048] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.045744  7210 raft_consensus.cc:1275] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.047326  7466 consensus_queue.cc:1048] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.060513  7285 raft_consensus.cc:1275] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.064798  7447 consensus_queue.cc:1048] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.105975  7285 raft_consensus.cc:1275] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.107779  7447 consensus_queue.cc:1048] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.119640  7361 raft_consensus.cc:1275] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.121660  7447 consensus_queue.cc:1048] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.156057  7285 raft_consensus.cc:1275] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.157262  7447 consensus_queue.cc:1048] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.165871  7361 raft_consensus.cc:1275] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.168783  7409 consensus_queue.cc:1048] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.276028  7211 raft_consensus.cc:1275] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.277343  7466 consensus_queue.cc:1048] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.285429  7361 raft_consensus.cc:1275] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.288089  7413 consensus_queue.cc:1048] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.445353  7076 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:15:19.446175  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:19.468591  7285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
mode: GRACEFUL
new_leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
 from {username='slave'} at 127.0.0.1:58324
I20260709 13:15:19.469110  7285 raft_consensus.cc:606] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Received request to transfer leadership to TS 20bfb4a0ce744b23ac25b32f6740acb6
I20260709 13:15:19.479562  7211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
mode: GRACEFUL
new_leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
 from {username='slave'} at 127.0.0.1:38862
I20260709 13:15:19.480106  7211 raft_consensus.cc:606] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Received request to transfer leadership to TS 20bfb4a0ce744b23ac25b32f6740acb6
I20260709 13:15:19.481271  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:19.481802  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:19.483095  7497 raft_consensus.cc:993] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719: : Instructing follower 20bfb4a0ce744b23ac25b32f6740acb6 to start an election
I20260709 13:15:19.483515  7428 raft_consensus.cc:1081] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Signalling peer 20bfb4a0ce744b23ac25b32f6740acb6 to start an election
I20260709 13:15:19.484922  7360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
 from {username='slave'} at 127.0.0.1:38708
I20260709 13:15:19.485365  7360 raft_consensus.cc:493] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:19.485661  7360 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.490109  7360 raft_consensus.cc:515] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:19.491595  7360 leader_election.cc:290] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 3 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:19.492462  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:19.492676  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:19.493054  7211 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.493162  7285 raft_consensus.cc:3055] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:19.493487  7285 raft_consensus.cc:740] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:19.494272  7285 consensus_queue.cc:260] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:19.495404  7285 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.498974  7211 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 3.
I20260709 13:15:19.500185  7327 leader_election.cc:304] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:19.500844  7434 raft_consensus.cc:2804] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:19.501327  7285 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 3.
I20260709 13:15:19.502081  7434 raft_consensus.cc:697] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:19.502964  7434 consensus_queue.cc:237] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:19.509176  7107 catalog_manager.cc:5697] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 2 to 3, leader changed from 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2) to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 3 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.774647  7504 raft_consensus.cc:993] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426: : Instructing follower 20bfb4a0ce744b23ac25b32f6740acb6 to start an election
I20260709 13:15:19.775121  7504 raft_consensus.cc:1081] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Signalling peer 20bfb4a0ce744b23ac25b32f6740acb6 to start an election
I20260709 13:15:19.776592  7360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
 from {username='slave'} at 127.0.0.1:38722
I20260709 13:15:19.777093  7360 raft_consensus.cc:493] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:19.777410  7360 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.781786  7360 raft_consensus.cc:515] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:19.783437  7360 leader_election.cc:290] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 3 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:19.784175  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:19.784736  7211 raft_consensus.cc:3055] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:19.784623  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:19.785069  7211 raft_consensus.cc:740] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:19.785265  7285 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.785759  7211 consensus_queue.cc:260] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:19.786576  7211 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:19.789932  7285 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 3.
I20260709 13:15:19.790449  7211 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 3.
I20260709 13:15:19.790899  7324 leader_election.cc:304] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: 
I20260709 13:15:19.791610  7434 raft_consensus.cc:2804] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:19.792003  7434 raft_consensus.cc:697] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:19.792796  7434 consensus_queue.cc:237] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:19.801680  7107 catalog_manager.cc:5697] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 2 to 3, leader changed from ae34dfe761db4265b3d72da4731ca426 (127.6.233.1) to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 3 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:19.903571  7211 raft_consensus.cc:1275] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Refusing update from remote peer 20bfb4a0ce744b23ac25b32f6740acb6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:19.904727  7434 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:19.914346  7285 raft_consensus.cc:1275] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Refusing update from remote peer 20bfb4a0ce744b23ac25b32f6740acb6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:19.915822  7434 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.353684  7286 raft_consensus.cc:1275] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Refusing update from remote peer 20bfb4a0ce744b23ac25b32f6740acb6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:20.354821  7511 consensus_queue.cc:1048] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.362864  7211 raft_consensus.cc:1275] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Refusing update from remote peer 20bfb4a0ce744b23ac25b32f6740acb6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:20.364353  7511 consensus_queue.cc:1048] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:20.482651  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:20.492077  7211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
mode: GRACEFUL
new_leader_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:15:20.492556  7211 raft_consensus.cc:606] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Received request to transfer leadership to TS 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:20.497422  7211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
mode: GRACEFUL
new_leader_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:15:20.497910  7211 raft_consensus.cc:606] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Received request to transfer leadership to TS 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:20.502154  7360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
mode: GRACEFUL
new_leader_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:15:20.502661  7360 raft_consensus.cc:606] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Received request to transfer leadership to TS 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:20.506870  7211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d02861fa80824be993b57c94e95831d8"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
mode: GRACEFUL
new_leader_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:38860
I20260709 13:15:20.507306  7211 raft_consensus.cc:606] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Received request to transfer leadership to TS 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:20.511354  7360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
mode: GRACEFUL
new_leader_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:15:20.511845  7360 raft_consensus.cc:606] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Received request to transfer leadership to TS 5da8bd59d9db4743b7723b1c7203d719
I20260709 13:15:20.520714  7504 raft_consensus.cc:993] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426: : Instructing follower 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.521123  7514 raft_consensus.cc:1081] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Signalling peer 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.522503  7286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:58308
I20260709 13:15:20.522939  7286 raft_consensus.cc:493] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.523250  7286 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.527467  7286 raft_consensus.cc:515] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.529071  7286 leader_election.cc:290] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 3 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:20.529788  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:20.529994  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:20.530306  7211 raft_consensus.cc:3055] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:20.530490  7360 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.530625  7211 raft_consensus.cc:740] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:20.531344  7211 consensus_queue.cc:260] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.532433  7211 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.536690  7360 raft_consensus.cc:2468] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 3.
I20260709 13:15:20.538049  7211 raft_consensus.cc:2468] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 3.
I20260709 13:15:20.537961  7249 leader_election.cc:304] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: 
I20260709 13:15:20.538906  7428 raft_consensus.cc:2804] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:20.539821  7428 raft_consensus.cc:697] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:20.540817  7428 consensus_queue.cc:237] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.546936  7106 catalog_manager.cc:5697] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 2 to 3, leader changed from ae34dfe761db4265b3d72da4731ca426 (127.6.233.1) to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 3 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.640687  7504 raft_consensus.cc:993] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426: : Instructing follower 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.641088  7514 raft_consensus.cc:1081] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Signalling peer 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.642431  7286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:58308
I20260709 13:15:20.642925  7286 raft_consensus.cc:493] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.643211  7286 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.647416  7286 raft_consensus.cc:515] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:20.649266  7286 leader_election.cc:290] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 3 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:20.649968  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:20.650295  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:20.650437  7211 raft_consensus.cc:3055] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:20.650782  7211 raft_consensus.cc:740] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:20.650794  7360 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.651383  7211 consensus_queue.cc:260] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:20.652228  7211 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.655165  7360 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 3.
I20260709 13:15:20.655805  7211 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 3.
I20260709 13:15:20.656190  7249 leader_election.cc:304] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719; no voters: 
I20260709 13:15:20.656944  7428 raft_consensus.cc:2804] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:20.657401  7428 raft_consensus.cc:697] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:20.658001  7428 consensus_queue.cc:237] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:20.663861  7106 catalog_manager.cc:5697] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 2 to 3, leader changed from ae34dfe761db4265b3d72da4731ca426 (127.6.233.1) to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 3 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.729990  7498 raft_consensus.cc:993] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6: : Instructing follower 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.730410  7511 raft_consensus.cc:1081] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Signalling peer 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.731784  7286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:15:20.732270  7286 raft_consensus.cc:493] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.732565  7286 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.737567  7286 raft_consensus.cc:515] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.739513  7286 leader_election.cc:290] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 4 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:20.740129  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:20.740631  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:20.740828  7211 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.741276  7360 raft_consensus.cc:3055] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:20.741596  7360 raft_consensus.cc:740] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:20.742305  7360 consensus_queue.cc:260] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.743394  7360 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.745556  7211 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 4.
I20260709 13:15:20.746388  7252 leader_election.cc:304] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:20.747008  7428 raft_consensus.cc:2804] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:20.747466  7428 raft_consensus.cc:697] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 4 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:20.748549  7360 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 4.
I20260709 13:15:20.748330  7428 consensus_queue.cc:237] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.754249  7106 catalog_manager.cc:5697] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 3 to 4, leader changed from 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3) to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 4 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.763708  7504 raft_consensus.cc:993] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426: : Instructing follower 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.764132  7514 raft_consensus.cc:1081] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Signalling peer 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.765292  7286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d02861fa80824be993b57c94e95831d8"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:58308
I20260709 13:15:20.765749  7286 raft_consensus.cc:493] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.766041  7286 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.770954  7286 raft_consensus.cc:515] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.772883  7286 leader_election.cc:290] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 2 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:20.773984  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:20.774314  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:20.774690  7211 raft_consensus.cc:3055] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:20.774919  7360 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.775034  7211 raft_consensus.cc:740] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:20.775743  7211 consensus_queue.cc:260] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.776551  7211 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.779953  7360 raft_consensus.cc:2468] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 2.
I20260709 13:15:20.780161  7211 raft_consensus.cc:2468] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 2.
I20260709 13:15:20.781188  7249 leader_election.cc:304] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:20.781867  7428 raft_consensus.cc:2804] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.782286  7428 raft_consensus.cc:697] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:20.782913  7428 consensus_queue.cc:237] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.789703  7106 catalog_manager.cc:5697] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 1 to 2, leader changed from ae34dfe761db4265b3d72da4731ca426 (127.6.233.1) to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.878484  7498 raft_consensus.cc:993] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6: : Instructing follower 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.878958  7511 raft_consensus.cc:1081] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Signalling peer 5da8bd59d9db4743b7723b1c7203d719 to start an election
I20260709 13:15:20.880497  7286 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
 from {username='slave'} at 127.0.0.1:58294
I20260709 13:15:20.880960  7286 raft_consensus.cc:493] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.881230  7286 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.887590  7286 raft_consensus.cc:515] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.889648  7286 leader_election.cc:290] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 4 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:20.890574  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:20.890779  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f3163a0429429181c74a8c3b160baa" candidate_uuid: "5da8bd59d9db4743b7723b1c7203d719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:20.891321  7211 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.891479  7360 raft_consensus.cc:3055] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:20.892158  7360 raft_consensus.cc:740] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:20.893095  7360 consensus_queue.cc:260] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.894433  7360 raft_consensus.cc:3060] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:20.898123  7211 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 4.
I20260709 13:15:20.899277  7252 leader_election.cc:304] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:20.900068  7428 raft_consensus.cc:2804] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:20.900485  7428 raft_consensus.cc:697] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 4 LEADER]: Becoming Leader. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:20.900869  7360 raft_consensus.cc:2468] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5da8bd59d9db4743b7723b1c7203d719 in term 4.
I20260709 13:15:20.901247  7428 consensus_queue.cc:237] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:20.906845  7106 catalog_manager.cc:5697] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 reported cstate change: term changed from 3 to 4, leader changed from 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3) to 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2). New cstate: current_term: 4 leader_uuid: "5da8bd59d9db4743b7723b1c7203d719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.961912  7360 raft_consensus.cc:1275] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:20.963091  7428 consensus_queue.cc:1048] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.972725  7211 raft_consensus.cc:1275] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:20.974279  7515 consensus_queue.cc:1048] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.115864  7211 raft_consensus.cc:1275] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:21.117153  7525 consensus_queue.cc:1048] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.126065  7360 raft_consensus.cc:1275] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:21.127465  7428 consensus_queue.cc:1048] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.186384  7360 raft_consensus.cc:1275] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:21.187882  7428 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.195195  7211 raft_consensus.cc:1275] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.196997  7515 consensus_queue.cc:1048] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.199080  7211 raft_consensus.cc:1275] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:21.201825  7428 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.209414  7360 raft_consensus.cc:1275] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:21.213553  7515 consensus_queue.cc:1048] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:21.306536  7360 raft_consensus.cc:1275] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:21.307859  7515 consensus_queue.cc:1048] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.314973  7211 raft_consensus.cc:1275] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Refusing update from remote peer 5da8bd59d9db4743b7723b1c7203d719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:21.316447  7515 consensus_queue.cc:1048] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:23.524890  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:23.532575  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
mode: GRACEFUL
new_leader_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:58324
I20260709 13:15:23.533298  7286 raft_consensus.cc:606] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Received request to transfer leadership to TS ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:23.535869  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
mode: GRACEFUL
new_leader_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:58324
I20260709 13:15:23.536418  7286 raft_consensus.cc:606] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Received request to transfer leadership to TS ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:23.538560  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
mode: GRACEFUL
new_leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
 from {username='slave'} at 127.0.0.1:58324
I20260709 13:15:23.539026  7286 raft_consensus.cc:606] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Received request to transfer leadership to TS 20bfb4a0ce744b23ac25b32f6740acb6
I20260709 13:15:23.541216  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
mode: GRACEFUL
new_leader_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:58324
I20260709 13:15:23.541646  7286 raft_consensus.cc:606] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 4 LEADER]: Received request to transfer leadership to TS ae34dfe761db4265b3d72da4731ca426
I20260709 13:15:23.543649  7286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d02861fa80824be993b57c94e95831d8"
dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
mode: GRACEFUL
new_leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
 from {username='slave'} at 127.0.0.1:58324
I20260709 13:15:23.544092  7286 raft_consensus.cc:606] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Received request to transfer leadership to TS 20bfb4a0ce744b23ac25b32f6740acb6
I20260709 13:15:23.545135  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:23.545554  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:23.595151  7536 raft_consensus.cc:993] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719: : Instructing follower 20bfb4a0ce744b23ac25b32f6740acb6 to start an election
I20260709 13:15:23.595654  7536 raft_consensus.cc:1081] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Signalling peer 20bfb4a0ce744b23ac25b32f6740acb6 to start an election
I20260709 13:15:23.597232  7360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
 from {username='slave'} at 127.0.0.1:38708
I20260709 13:15:23.597754  7360 raft_consensus.cc:493] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.598070  7360 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.602964  7360 raft_consensus.cc:515] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.604516  7360 leader_election.cc:290] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 4 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:23.605757  7211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:23.605686  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2ba9aa737426a88c949c7d3f2ac75" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:23.606487  7211 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.606516  7286 raft_consensus.cc:3055] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:23.606921  7286 raft_consensus.cc:740] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:23.607692  7286 consensus_queue.cc:260] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.608649  7286 raft_consensus.cc:3060] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.611352  7211 raft_consensus.cc:2468] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 4.
I20260709 13:15:23.612614  7327 leader_election.cc:304] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:23.613008  7286 raft_consensus.cc:2468] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 4.
I20260709 13:15:23.613462  7511 raft_consensus.cc:2804] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:23.614575  7511 raft_consensus.cc:697] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:23.615475  7511 consensus_queue.cc:237] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.622041  7107 catalog_manager.cc:5697] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 3 to 4, leader changed from 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2) to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 4 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.639431  7428 raft_consensus.cc:993] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719: : Instructing follower ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:23.639822  7536 raft_consensus.cc:1081] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Signalling peer ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:23.641289  7211 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:38842
I20260709 13:15:23.641660  7211 raft_consensus.cc:493] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.641939  7211 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.645089  7428 raft_consensus.cc:993] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719: : Instructing follower ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:23.645514  7536 raft_consensus.cc:1081] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 4 LEADER]: Signalling peer ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:23.647004  7210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:38842
I20260709 13:15:23.647541  7210 raft_consensus.cc:493] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.647995  7210 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:23.647603  7211 raft_consensus.cc:515] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:23.649438  7211 leader_election.cc:290] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 4 election: Requested vote from peers 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:23.650341  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:23.650600  7286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14184f6dc18f45198cc304c2a48350ef" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:23.650887  7360 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.651139  7286 raft_consensus.cc:3055] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:23.651453  7286 raft_consensus.cc:740] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:23.652244  7286 consensus_queue.cc:260] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:23.653342  7286 raft_consensus.cc:3060] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:23.654636  7210 raft_consensus.cc:515] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.655480  7360 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 4.
I20260709 13:15:23.656698  7210 leader_election.cc:290] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 5 election: Requested vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:23.657090  7174 leader_election.cc:304] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:23.658674  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:23.658954  7543 raft_consensus.cc:2804] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:23.659242  7285 raft_consensus.cc:3055] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:23.659375  7286 raft_consensus.cc:2468] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 4.
I20260709 13:15:23.659610  7285 raft_consensus.cc:740] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:23.660488  7285 consensus_queue.cc:260] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.661559  7285 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:23.664618  7543 raft_consensus.cc:697] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 4 LEADER]: Becoming Leader. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:23.665723  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877dbd6f29bb46f8909834b8a1fb5fbb" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:23.665649  7543 consensus_queue.cc:237] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } }
I20260709 13:15:23.666266  7360 raft_consensus.cc:3060] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:23.667289  7285 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 5.
I20260709 13:15:23.668562  7174 leader_election.cc:304] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5da8bd59d9db4743b7723b1c7203d719, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:23.671557  7360 raft_consensus.cc:2468] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 5.
I20260709 13:15:23.669431  7544 raft_consensus.cc:2804] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:23.672194  7544 raft_consensus.cc:697] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 5 LEADER]: Becoming Leader. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:23.672974  7544 consensus_queue.cc:237] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.673938  7107 catalog_manager.cc:5697] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 reported cstate change: term changed from 3 to 4, leader changed from 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2) to ae34dfe761db4265b3d72da4731ca426 (127.6.233.1). New cstate: current_term: 4 leader_uuid: "ae34dfe761db4265b3d72da4731ca426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.685196  7107 catalog_manager.cc:5697] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 reported cstate change: term changed from 4 to 5, leader changed from 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2) to ae34dfe761db4265b3d72da4731ca426 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "ae34dfe761db4265b3d72da4731ca426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.694525  7428 raft_consensus.cc:993] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719: : Instructing follower ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:23.694943  7536 raft_consensus.cc:1081] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Signalling peer ae34dfe761db4265b3d72da4731ca426 to start an election
I20260709 13:15:23.696341  7210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0"
dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
 from {username='slave'} at 127.0.0.1:38842
I20260709 13:15:23.696799  7210 raft_consensus.cc:493] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.697094  7210 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.701618  7210 raft_consensus.cc:515] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.703105  7210 leader_election.cc:290] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 3 election: Requested vote from peers 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697), 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3:40925)
I20260709 13:15:23.703959  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:23.704156  7360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32b2a43acc764d729484d38fb36193f0" candidate_uuid: "ae34dfe761db4265b3d72da4731ca426" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
I20260709 13:15:23.704566  7360 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.704568  7285 raft_consensus.cc:3055] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:23.705034  7285 raft_consensus.cc:740] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:23.705808  7285 consensus_queue.cc:260] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.707000  7285 raft_consensus.cc:3060] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:23.710973  7360 raft_consensus.cc:2468] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 3.
I20260709 13:15:23.712062  7174 leader_election.cc:304] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:23.712869  7544 raft_consensus.cc:2804] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:23.713347  7544 raft_consensus.cc:697] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 3 LEADER]: Becoming Leader. State: Replica: ae34dfe761db4265b3d72da4731ca426, State: Running, Role: LEADER
I20260709 13:15:23.713418  7285 raft_consensus.cc:2468] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae34dfe761db4265b3d72da4731ca426 in term 3.
I20260709 13:15:23.714274  7544 consensus_queue.cc:237] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:23.720963  7107 catalog_manager.cc:5697] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 reported cstate change: term changed from 2 to 3, leader changed from 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2) to ae34dfe761db4265b3d72da4731ca426 (127.6.233.1). New cstate: current_term: 3 leader_uuid: "ae34dfe761db4265b3d72da4731ca426" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:24.046105  7360 raft_consensus.cc:1275] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:24.047397  7544 consensus_queue.cc:1048] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.059584  7285 raft_consensus.cc:1275] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:24.061643  7550 consensus_queue.cc:1048] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:24.070061  7210 raft_consensus.cc:1275] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Refusing update from remote peer 20bfb4a0ce744b23ac25b32f6740acb6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:24.071384  7511 consensus_queue.cc:1048] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.080986  7285 raft_consensus.cc:1275] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Refusing update from remote peer 20bfb4a0ce744b23ac25b32f6740acb6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:24.088057  7511 consensus_queue.cc:1048] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.115275  7285 raft_consensus.cc:1275] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 5 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:24.116453  7550 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:24.124843  7536 raft_consensus.cc:993] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719: : Instructing follower 20bfb4a0ce744b23ac25b32f6740acb6 to start an election
I20260709 13:15:24.125293  7536 raft_consensus.cc:1081] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Signalling peer 20bfb4a0ce744b23ac25b32f6740acb6 to start an election
I20260709 13:15:24.127089  7360 raft_consensus.cc:1275] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 5 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:24.127919  7361 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d02861fa80824be993b57c94e95831d8"
dest_uuid: "20bfb4a0ce744b23ac25b32f6740acb6"
 from {username='slave'} at 127.0.0.1:38708
I20260709 13:15:24.128501  7361 raft_consensus.cc:493] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:24.128911  7361 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.128669  7543 consensus_queue.cc:1048] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:24.139499  7361 raft_consensus.cc:515] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:24.140952  7361 leader_election.cc:290] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 3 election: Requested vote from peers ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733), 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2:36697)
I20260709 13:15:24.141789  7210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae34dfe761db4265b3d72da4731ca426"
I20260709 13:15:24.141955  7285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02861fa80824be993b57c94e95831d8" candidate_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5da8bd59d9db4743b7723b1c7203d719"
I20260709 13:15:24.142391  7210 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.142596  7285 raft_consensus.cc:3055] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:24.142976  7285 raft_consensus.cc:740] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5da8bd59d9db4743b7723b1c7203d719, State: Running, Role: LEADER
I20260709 13:15:24.143724  7285 consensus_queue.cc:260] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:24.144877  7285 raft_consensus.cc:3060] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:24.148774  7210 raft_consensus.cc:2468] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 3.
I20260709 13:15:24.149631  7285 raft_consensus.cc:2468] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20bfb4a0ce744b23ac25b32f6740acb6 in term 3.
I20260709 13:15:24.149796  7327 leader_election.cc:304] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20bfb4a0ce744b23ac25b32f6740acb6, ae34dfe761db4265b3d72da4731ca426; no voters: 
I20260709 13:15:24.150635  7511 raft_consensus.cc:2804] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:24.151027  7511 raft_consensus.cc:697] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Becoming Leader. State: Replica: 20bfb4a0ce744b23ac25b32f6740acb6, State: Running, Role: LEADER
I20260709 13:15:24.151801  7511 consensus_queue.cc:237] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } }
I20260709 13:15:24.157718  7106 catalog_manager.cc:5697] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 reported cstate change: term changed from 2 to 3, leader changed from 5da8bd59d9db4743b7723b1c7203d719 (127.6.233.2) to 20bfb4a0ce744b23ac25b32f6740acb6 (127.6.233.3). New cstate: current_term: 3 leader_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae34dfe761db4265b3d72da4731ca426" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 39733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.205459  7361 raft_consensus.cc:1275] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.206722  7544 consensus_queue.cc:1048] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20bfb4a0ce744b23ac25b32f6740acb6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 40925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.215068  7285 raft_consensus.cc:1275] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Refusing update from remote peer ae34dfe761db4265b3d72da4731ca426: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.216691  7543 consensus_queue.cc:1048] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.546377  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:24.552086  7076 tablet_server.cc:179] TabletServer@127.6.233.1:0 shutting down...
I20260709 13:15:24.577831  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:24.578550  7076 tablet_replica.cc:333] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.579191  7076 raft_consensus.cc:2243] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.579608  7076 raft_consensus.cc:2272] T 1b8b974338c34da5b3947af117c93463 P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.581777  7076 tablet_replica.cc:333] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.582238  7076 raft_consensus.cc:2243] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.582902  7076 raft_consensus.cc:2272] T 877dbd6f29bb46f8909834b8a1fb5fbb P ae34dfe761db4265b3d72da4731ca426 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.584911  7076 tablet_replica.cc:333] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.585518  7076 raft_consensus.cc:2243] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.585935  7076 raft_consensus.cc:2272] T b5f3163a0429429181c74a8c3b160baa P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.588088  7076 tablet_replica.cc:333] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.588538  7076 raft_consensus.cc:2243] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.588877  7076 raft_consensus.cc:2272] T 3be2ba9aa737426a88c949c7d3f2ac75 P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.590785  7076 tablet_replica.cc:333] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.591207  7076 raft_consensus.cc:2243] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.591813  7076 raft_consensus.cc:2272] T 14184f6dc18f45198cc304c2a48350ef P ae34dfe761db4265b3d72da4731ca426 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.593713  7076 tablet_replica.cc:333] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.594177  7076 raft_consensus.cc:2243] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.594580  7076 raft_consensus.cc:2272] T d02861fa80824be993b57c94e95831d8 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.596134  7076 tablet_replica.cc:333] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.596776  7076 raft_consensus.cc:2243] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.597251  7076 raft_consensus.cc:2272] T c204ba6ca9bc40c8b35f454c60d288bb P ae34dfe761db4265b3d72da4731ca426 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.598820  7076 tablet_replica.cc:333] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.599231  7076 raft_consensus.cc:2243] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.599979  7076 raft_consensus.cc:2272] T 32b2a43acc764d729484d38fb36193f0 P ae34dfe761db4265b3d72da4731ca426 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.601814  7076 tablet_replica.cc:333] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426: stopping tablet replica
I20260709 13:15:24.602178  7076 raft_consensus.cc:2243] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.602567  7076 raft_consensus.cc:2272] T 0ba9c14eb37c4f819fed83f8887fb324 P ae34dfe761db4265b3d72da4731ca426 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.604311  7285 raft_consensus.cc:1275] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Refusing update from remote peer 20bfb4a0ce744b23ac25b32f6740acb6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:24.605418  7511 consensus_queue.cc:1048] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5da8bd59d9db4743b7723b1c7203d719" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 36697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:15:24.617079  7327 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:24.718134  7327 consensus_peers.cc:597] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 -> Peer ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733): Couldn't send request to peer ae34dfe761db4265b3d72da4731ca426. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:39733: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.719453  7076 tablet_server.cc:196] TabletServer@127.6.233.1:0 shutdown complete.
W20260709 13:15:24.720515  7327 consensus_peers.cc:597] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 -> Peer ae34dfe761db4265b3d72da4731ca426 (127.6.233.1:39733): Couldn't send request to peer ae34dfe761db4265b3d72da4731ca426. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:39733: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.738083  7076 tablet_server.cc:179] TabletServer@127.6.233.2:0 shutting down...
I20260709 13:15:24.762905  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:24.763590  7076 tablet_replica.cc:333] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.764460  7076 raft_consensus.cc:2243] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.765448  7076 raft_consensus.cc:2272] T 0ba9c14eb37c4f819fed83f8887fb324 P 5da8bd59d9db4743b7723b1c7203d719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.767094  7076 tablet_replica.cc:333] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.767596  7076 raft_consensus.cc:2243] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.767936  7076 raft_consensus.cc:2272] T 3be2ba9aa737426a88c949c7d3f2ac75 P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.769896  7076 tablet_replica.cc:333] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.770332  7076 raft_consensus.cc:2243] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.770651  7076 raft_consensus.cc:2272] T 32b2a43acc764d729484d38fb36193f0 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.772477  7076 tablet_replica.cc:333] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.772898  7076 raft_consensus.cc:2243] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.773526  7076 raft_consensus.cc:2272] T c204ba6ca9bc40c8b35f454c60d288bb P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.775004  7076 tablet_replica.cc:333] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.775419  7076 raft_consensus.cc:2243] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.775743  7076 raft_consensus.cc:2272] T 877dbd6f29bb46f8909834b8a1fb5fbb P 5da8bd59d9db4743b7723b1c7203d719 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.777441  7076 tablet_replica.cc:333] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.777961  7076 raft_consensus.cc:2243] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.778364  7076 raft_consensus.cc:2272] T d02861fa80824be993b57c94e95831d8 P 5da8bd59d9db4743b7723b1c7203d719 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.780328  7076 tablet_replica.cc:333] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.780783  7076 raft_consensus.cc:2243] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.781136  7076 raft_consensus.cc:2272] T 1b8b974338c34da5b3947af117c93463 P 5da8bd59d9db4743b7723b1c7203d719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.782541  7076 tablet_replica.cc:333] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.782917  7076 raft_consensus.cc:2243] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.783761  7076 raft_consensus.cc:2272] T b5f3163a0429429181c74a8c3b160baa P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.785759  7076 tablet_replica.cc:333] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719: stopping tablet replica
I20260709 13:15:24.786170  7076 raft_consensus.cc:2243] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.786523  7076 raft_consensus.cc:2272] T 14184f6dc18f45198cc304c2a48350ef P 5da8bd59d9db4743b7723b1c7203d719 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.814567  7076 tablet_server.cc:196] TabletServer@127.6.233.2:0 shutdown complete.
I20260709 13:15:24.830253  7076 tablet_server.cc:179] TabletServer@127.6.233.3:0 shutting down...
I20260709 13:15:24.853142  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:24.853797  7076 tablet_replica.cc:333] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.854327  7076 raft_consensus.cc:2243] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.854756  7076 raft_consensus.cc:2272] T 0ba9c14eb37c4f819fed83f8887fb324 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.856380  7076 tablet_replica.cc:333] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.856923  7076 raft_consensus.cc:2243] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.857336  7076 raft_consensus.cc:2272] T 877dbd6f29bb46f8909834b8a1fb5fbb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.859186  7076 tablet_replica.cc:333] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.859683  7076 raft_consensus.cc:2243] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.860455  7076 raft_consensus.cc:2272] T d02861fa80824be993b57c94e95831d8 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.862262  7076 tablet_replica.cc:333] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.862741  7076 raft_consensus.cc:2243] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.863099  7076 raft_consensus.cc:2272] T c204ba6ca9bc40c8b35f454c60d288bb P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.864667  7076 tablet_replica.cc:333] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.865144  7076 raft_consensus.cc:2243] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.865540  7076 raft_consensus.cc:2272] T 32b2a43acc764d729484d38fb36193f0 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.867630  7076 tablet_replica.cc:333] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.868197  7076 raft_consensus.cc:2243] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.868599  7076 raft_consensus.cc:2272] T b5f3163a0429429181c74a8c3b160baa P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.870088  7076 tablet_replica.cc:333] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.870532  7076 raft_consensus.cc:2243] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.871217  7076 raft_consensus.cc:2272] T 1b8b974338c34da5b3947af117c93463 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.872814  7076 tablet_replica.cc:333] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.873275  7076 raft_consensus.cc:2243] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.873660  7076 raft_consensus.cc:2272] T 14184f6dc18f45198cc304c2a48350ef P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.875499  7076 tablet_replica.cc:333] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6: stopping tablet replica
I20260709 13:15:24.875944  7076 raft_consensus.cc:2243] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.876701  7076 raft_consensus.cc:2272] T 3be2ba9aa737426a88c949c7d3f2ac75 P 20bfb4a0ce744b23ac25b32f6740acb6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.902149  7076 tablet_server.cc:196] TabletServer@127.6.233.3:0 shutdown complete.
I20260709 13:15:24.917645  7076 master.cc:562] Master@127.6.233.62:40373 shutting down...
I20260709 13:15:25.113957  7076 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:25.114533  7076 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:25.114871  7076 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0291129818ea4c18ae5ddf705e69dd7b: stopping tablet replica
I20260709 13:15:25.134649  7076 master.cc:584] Master@127.6.233.62:40373 shutdown complete.
20bfb4a0ce744b23ac25b32f6740acb6  1
5da8bd59d9db4743b7723b1c7203d719  4
ae34dfe761db4265b3d72da4731ca426  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12652 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:15:25.174355  7076 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.233.62:33101
I20260709 13:15:25.175474  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:25.180879  7566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.181046  7567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.181937  7569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:25.182592  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:25.183308  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:25.183482  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:25.183593  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602925183581 us; error 0 us; skew 500 ppm
I20260709 13:15:25.184032  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:25.186369  7076 webserver.cc:533] Webserver started at http://127.6.233.62:43531/ using document root <none> and password file <none>
I20260709 13:15:25.186789  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:25.186940  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:25.187160  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:25.188282  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/master-0-root/instance:
uuid: "216c44cd7e3c45c9aef6913a66a6b2ac"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-sjgx"
I20260709 13:15:25.192304  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:15:25.195261  7574 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.195964  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:25.196305  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/master-0-root
uuid: "216c44cd7e3c45c9aef6913a66a6b2ac"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-sjgx"
I20260709 13:15:25.196586  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:25.206642  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:25.207783  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:25.244200  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.62:33101
I20260709 13:15:25.244349  7625 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.62:33101 every 8 connection(s)
I20260709 13:15:25.247916  7626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.257246  7626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac: Bootstrap starting.
I20260709 13:15:25.261627  7626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:25.265662  7626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac: No bootstrap required, opened a new log
I20260709 13:15:25.267679  7626 raft_consensus.cc:359] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216c44cd7e3c45c9aef6913a66a6b2ac" member_type: VOTER }
I20260709 13:15:25.268033  7626 raft_consensus.cc:385] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:25.268309  7626 raft_consensus.cc:740] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216c44cd7e3c45c9aef6913a66a6b2ac, State: Initialized, Role: FOLLOWER
I20260709 13:15:25.268953  7626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216c44cd7e3c45c9aef6913a66a6b2ac" member_type: VOTER }
I20260709 13:15:25.269402  7626 raft_consensus.cc:399] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:25.269618  7626 raft_consensus.cc:493] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:25.269883  7626 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:25.273793  7626 raft_consensus.cc:515] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216c44cd7e3c45c9aef6913a66a6b2ac" member_type: VOTER }
I20260709 13:15:25.274286  7626 leader_election.cc:304] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 216c44cd7e3c45c9aef6913a66a6b2ac; no voters: 
I20260709 13:15:25.275334  7626 leader_election.cc:290] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:25.275756  7629 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:25.277138  7629 raft_consensus.cc:697] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 1 LEADER]: Becoming Leader. State: Replica: 216c44cd7e3c45c9aef6913a66a6b2ac, State: Running, Role: LEADER
I20260709 13:15:25.277725  7629 consensus_queue.cc:237] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216c44cd7e3c45c9aef6913a66a6b2ac" member_type: VOTER }
I20260709 13:15:25.278393  7626 sys_catalog.cc:565] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:25.282413  7630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "216c44cd7e3c45c9aef6913a66a6b2ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216c44cd7e3c45c9aef6913a66a6b2ac" member_type: VOTER } }
I20260709 13:15:25.282595  7631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 216c44cd7e3c45c9aef6913a66a6b2ac. Latest consensus state: current_term: 1 leader_uuid: "216c44cd7e3c45c9aef6913a66a6b2ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216c44cd7e3c45c9aef6913a66a6b2ac" member_type: VOTER } }
I20260709 13:15:25.283222  7630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:25.283398  7631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:25.286192  7635 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:25.290915  7635 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:25.295456  7076 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:25.299369  7635 catalog_manager.cc:1383] Generated new cluster ID: 9d25bb0ca2ab476987f49f5bd635417d
I20260709 13:15:25.299630  7635 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:25.325495  7635 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:25.326750  7635 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:25.338964  7635 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac: Generated new TSK 0
I20260709 13:15:25.339567  7635 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:25.362573  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:25.368757  7647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.369671  7648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.370940  7650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:25.371762  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:25.372546  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:25.372730  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:25.372939  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602925372904 us; error 0 us; skew 500 ppm
I20260709 13:15:25.373468  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:25.375615  7076 webserver.cc:533] Webserver started at http://127.6.233.1:42219/ using document root <none> and password file <none>
I20260709 13:15:25.376147  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:25.376341  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:25.376633  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:25.377677  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-0-root/instance:
uuid: "40e01ad073c845148067fa56954db95b"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-sjgx"
I20260709 13:15:25.382171  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:25.385350  7655 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.386092  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:25.386384  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "40e01ad073c845148067fa56954db95b"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-sjgx"
I20260709 13:15:25.386691  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:25.411640  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:25.412974  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:25.414439  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:25.416600  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:25.416772  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.417047  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:25.417241  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.471004  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:38645
I20260709 13:15:25.471076  7717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:38645 every 8 connection(s)
I20260709 13:15:25.477543  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:25.485419  7722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.485872  7723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.492189  7725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:25.492663  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:25.493912  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:25.494225  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:25.494452  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602925494431 us; error 0 us; skew 500 ppm
I20260709 13:15:25.495262  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:25.498425  7076 webserver.cc:533] Webserver started at http://127.6.233.2:38191/ using document root <none> and password file <none>
I20260709 13:15:25.499025  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:25.499059  7718 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33101
I20260709 13:15:25.499365  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:25.499498  7718 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:25.499696  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:25.500439  7718 heartbeater.cc:507] Master 127.6.233.62:33101 requested a full tablet report, sending...
I20260709 13:15:25.501204  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-1-root/instance:
uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-sjgx"
I20260709 13:15:25.502895  7591 ts_manager.cc:194] Registered new tserver with Master: 40e01ad073c845148067fa56954db95b (127.6.233.1:38645)
I20260709 13:15:25.505549  7591 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33146
I20260709 13:15:25.506150  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:25.509945  7730 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.510725  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:15:25.511010  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-1-root
uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-sjgx"
I20260709 13:15:25.511289  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:25.522724  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:25.523847  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:25.525400  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:25.527611  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:25.527824  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.528095  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:25.528276  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.571534  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.2:44895
I20260709 13:15:25.571702  7792 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.2:44895 every 8 connection(s)
I20260709 13:15:25.577747  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:25.586278  7796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.589442  7797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:25.590093  7799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:25.590777  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:25.591358  7793 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33101
I20260709 13:15:25.591646  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:25.591722  7793 heartbeater.cc:461] Registering TS with master...
W20260709 13:15:25.591933  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:25.592168  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602925592148 us; error 0 us; skew 500 ppm
I20260709 13:15:25.592633  7793 heartbeater.cc:507] Master 127.6.233.62:33101 requested a full tablet report, sending...
I20260709 13:15:25.592730  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:25.594707  7591 ts_manager.cc:194] Registered new tserver with Master: 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:25.595248  7076 webserver.cc:533] Webserver started at http://127.6.233.3:42489/ using document root <none> and password file <none>
I20260709 13:15:25.595721  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:25.595909  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:25.596210  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:25.596334  7591 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33160
I20260709 13:15:25.597491  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-2-root/instance:
uuid: "59b3b18534984d9990fa505361d6260b"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-sjgx"
I20260709 13:15:25.601890  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:15:25.604859  7804 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.605582  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:25.605865  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-2-root
uuid: "59b3b18534984d9990fa505361d6260b"
format_stamp: "Formatted at 2026-07-09 13:15:25 on dist-test-slave-sjgx"
I20260709 13:15:25.606112  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602912355568-7076-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:25.624243  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:25.625566  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:25.627151  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:25.629616  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:25.629809  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.630126  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:25.630306  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:25.672762  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.3:35837
I20260709 13:15:25.672876  7866 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.3:35837 every 8 connection(s)
I20260709 13:15:25.686456  7867 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33101
I20260709 13:15:25.686842  7867 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:25.687613  7867 heartbeater.cc:507] Master 127.6.233.62:33101 requested a full tablet report, sending...
I20260709 13:15:25.689648  7591 ts_manager.cc:194] Registered new tserver with Master: 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:25.690595  7076 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014553215s
I20260709 13:15:25.691197  7591 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33168
I20260709 13:15:25.715127  7591 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33174:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:25.717916  7591 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:25.791283  7832 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd306e2d63141a99951fe3ab8bee1e8 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:25.792706  7832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd306e2d63141a99951fe3ab8bee1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.802901  7831 tablet_service.cc:1511] Processing CreateTablet for tablet 041a43c869d448afa07aa253b37c4c67 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:25.803813  7830 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3ee1ba73c4438c81c04e494930f738 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:25.804356  7831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041a43c869d448afa07aa253b37c4c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.805123  7830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3ee1ba73c4438c81c04e494930f738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.806067  7755 tablet_service.cc:1511] Processing CreateTablet for tablet 9cad1fa8779948188c5dc1205e7db50a (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:25.806306  7756 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3ee1ba73c4438c81c04e494930f738 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:25.807380  7755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cad1fa8779948188c5dc1205e7db50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.809170  7758 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd306e2d63141a99951fe3ab8bee1e8 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:25.810107  7757 tablet_service.cc:1511] Processing CreateTablet for tablet 041a43c869d448afa07aa253b37c4c67 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:25.814674  7754 tablet_service.cc:1511] Processing CreateTablet for tablet c2e7bff8785e4c7db11248adb1b8eac5 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:25.815085  7829 tablet_service.cc:1511] Processing CreateTablet for tablet 9cad1fa8779948188c5dc1205e7db50a (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:25.816418  7829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cad1fa8779948188c5dc1205e7db50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.816609  7753 tablet_service.cc:1511] Processing CreateTablet for tablet fdf258cfe3d04587a2fd2f09e6f65eae (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:25.818063  7758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd306e2d63141a99951fe3ab8bee1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.824863  7757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041a43c869d448afa07aa253b37c4c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.827316  7828 tablet_service.cc:1511] Processing CreateTablet for tablet c2e7bff8785e4c7db11248adb1b8eac5 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:25.828819  7754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e7bff8785e4c7db11248adb1b8eac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.828722  7828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e7bff8785e4c7db11248adb1b8eac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.832783  7753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf258cfe3d04587a2fd2f09e6f65eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.836860  7756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3ee1ba73c4438c81c04e494930f738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.844895  7824 tablet_service.cc:1511] Processing CreateTablet for tablet 598af4ca126148c48e7945f05680f23f (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:25.845585  7683 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd306e2d63141a99951fe3ab8bee1e8 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:25.846249  7824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598af4ca126148c48e7945f05680f23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.846858  7683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd306e2d63141a99951fe3ab8bee1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.846997  7679 tablet_service.cc:1511] Processing CreateTablet for tablet c2e7bff8785e4c7db11248adb1b8eac5 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:25.848290  7679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2e7bff8785e4c7db11248adb1b8eac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.849125  7823 tablet_service.cc:1511] Processing CreateTablet for tablet 775270eee7e44f0b8be7eeb24ac165cf (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:25.849207  7682 tablet_service.cc:1511] Processing CreateTablet for tablet 041a43c869d448afa07aa253b37c4c67 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:25.850394  7823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775270eee7e44f0b8be7eeb24ac165cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.850538  7682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041a43c869d448afa07aa253b37c4c67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.852972  7825 tablet_service.cc:1511] Processing CreateTablet for tablet 719f58f34ba047c59b79ea0985e9089d (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:25.853081  7681 tablet_service.cc:1511] Processing CreateTablet for tablet 3c3ee1ba73c4438c81c04e494930f738 (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:25.854271  7825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719f58f34ba047c59b79ea0985e9089d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.854339  7681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c3ee1ba73c4438c81c04e494930f738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.842628  7826 tablet_service.cc:1511] Processing CreateTablet for tablet 37f9140408e040218ea2dbfbc63f111b (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:25.857241  7680 tablet_service.cc:1511] Processing CreateTablet for tablet 9cad1fa8779948188c5dc1205e7db50a (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:25.856182  7827 tablet_service.cc:1511] Processing CreateTablet for tablet fdf258cfe3d04587a2fd2f09e6f65eae (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:25.857991  7826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f9140408e040218ea2dbfbc63f111b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.857972  7752 tablet_service.cc:1511] Processing CreateTablet for tablet 37f9140408e040218ea2dbfbc63f111b (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:25.858551  7680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cad1fa8779948188c5dc1205e7db50a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.859308  7752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f9140408e040218ea2dbfbc63f111b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.862833  7750 tablet_service.cc:1511] Processing CreateTablet for tablet 598af4ca126148c48e7945f05680f23f (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:25.864419  7751 tablet_service.cc:1511] Processing CreateTablet for tablet 719f58f34ba047c59b79ea0985e9089d (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:25.865110  7827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf258cfe3d04587a2fd2f09e6f65eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.865906  7750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598af4ca126148c48e7945f05680f23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.868386  7751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719f58f34ba047c59b79ea0985e9089d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.884054  7749 tablet_service.cc:1511] Processing CreateTablet for tablet 775270eee7e44f0b8be7eeb24ac165cf (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:25.885442  7749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775270eee7e44f0b8be7eeb24ac165cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.891137  7678 tablet_service.cc:1511] Processing CreateTablet for tablet fdf258cfe3d04587a2fd2f09e6f65eae (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:25.892607  7678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf258cfe3d04587a2fd2f09e6f65eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.918226  7677 tablet_service.cc:1511] Processing CreateTablet for tablet 37f9140408e040218ea2dbfbc63f111b (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:25.919736  7677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f9140408e040218ea2dbfbc63f111b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.921799  7676 tablet_service.cc:1511] Processing CreateTablet for tablet 719f58f34ba047c59b79ea0985e9089d (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:25.923066  7676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719f58f34ba047c59b79ea0985e9089d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.925207  7675 tablet_service.cc:1511] Processing CreateTablet for tablet 598af4ca126148c48e7945f05680f23f (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:25.926417  7675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598af4ca126148c48e7945f05680f23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.929219  7674 tablet_service.cc:1511] Processing CreateTablet for tablet 775270eee7e44f0b8be7eeb24ac165cf (DEFAULT_TABLE table=test-workload [id=7ef82991d54a41f7bcbeaf5c76eeeead]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:25.930426  7674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775270eee7e44f0b8be7eeb24ac165cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:25.975183  7882 tablet_bootstrap.cc:492] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:25.981313  7883 tablet_bootstrap.cc:492] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:25.995036  7882 tablet_bootstrap.cc:654] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.001499  7884 tablet_bootstrap.cc:492] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.007077  7884 tablet_bootstrap.cc:654] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.015282  7883 tablet_bootstrap.cc:654] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.037165  7884 tablet_bootstrap.cc:492] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.037575  7884 ts_tablet_manager.cc:1403] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.012s
I20260709 13:15:26.039553  7884 raft_consensus.cc:359] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.040119  7884 raft_consensus.cc:385] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.040407  7884 raft_consensus.cc:740] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.042639  7884 consensus_queue.cc:260] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.045856  7883 tablet_bootstrap.cc:492] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.046319  7883 ts_tablet_manager.cc:1403] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.024s
I20260709 13:15:26.049247  7883 raft_consensus.cc:359] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.049911  7883 raft_consensus.cc:385] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.050197  7883 raft_consensus.cc:740] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.051997  7718 heartbeater.cc:499] Master 127.6.233.62:33101 was elected leader, sending a full tablet report...
I20260709 13:15:26.052421  7884 ts_tablet_manager.cc:1434] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.011s
I20260709 13:15:26.053387  7884 tablet_bootstrap.cc:492] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.054154  7882 tablet_bootstrap.cc:492] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.054467  7882 ts_tablet_manager.cc:1403] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.004s
I20260709 13:15:26.052948  7883 consensus_queue.cc:260] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.056797  7882 raft_consensus.cc:359] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.057572  7882 raft_consensus.cc:385] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.057950  7882 raft_consensus.cc:740] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.059581  7884 tablet_bootstrap.cc:654] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.058991  7882 consensus_queue.cc:260] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.067629  7883 ts_tablet_manager.cc:1434] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.011s
I20260709 13:15:26.068576  7793 heartbeater.cc:499] Master 127.6.233.62:33101 was elected leader, sending a full tablet report...
I20260709 13:15:26.070930  7882 ts_tablet_manager.cc:1434] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:15:26.071616  7867 heartbeater.cc:499] Master 127.6.233.62:33101 was elected leader, sending a full tablet report...
I20260709 13:15:26.073325  7883 tablet_bootstrap.cc:492] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.081285  7883 tablet_bootstrap.cc:654] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.086431  7882 tablet_bootstrap.cc:492] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.095366  7884 tablet_bootstrap.cc:492] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.096083  7884 ts_tablet_manager.cc:1403] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.043s	user 0.030s	sys 0.012s
I20260709 13:15:26.097687  7882 tablet_bootstrap.cc:654] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.099186  7884 raft_consensus.cc:359] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.100014  7884 raft_consensus.cc:385] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.100404  7884 raft_consensus.cc:740] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.101361  7884 consensus_queue.cc:260] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.103291  7884 ts_tablet_manager.cc:1434] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:15:26.104324  7884 tablet_bootstrap.cc:492] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.104727  7883 tablet_bootstrap.cc:492] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.105186  7883 ts_tablet_manager.cc:1403] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.012s
I20260709 13:15:26.108145  7883 raft_consensus.cc:359] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.108817  7882 tablet_bootstrap.cc:492] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.108878  7883 raft_consensus.cc:385] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.109364  7883 raft_consensus.cc:740] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.109491  7882 ts_tablet_manager.cc:1403] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 13:15:26.110119  7883 consensus_queue.cc:260] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.111145  7884 tablet_bootstrap.cc:654] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.112357  7883 ts_tablet_manager.cc:1434] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:26.113409  7883 tablet_bootstrap.cc:492] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.113144  7882 raft_consensus.cc:359] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.113962  7882 raft_consensus.cc:385] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.114316  7882 raft_consensus.cc:740] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.115234  7882 consensus_queue.cc:260] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.117888  7882 ts_tablet_manager.cc:1434] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:26.118881  7882 tablet_bootstrap.cc:492] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.122076  7883 tablet_bootstrap.cc:654] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.131369  7889 raft_consensus.cc:493] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.131937  7889 raft_consensus.cc:515] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.132798  7882 tablet_bootstrap.cc:654] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.134567  7889 leader_election.cc:290] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.141721  7883 tablet_bootstrap.cc:492] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.142227  7883 ts_tablet_manager.cc:1403] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.009s
I20260709 13:15:26.142412  7882 tablet_bootstrap.cc:492] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.142915  7882 ts_tablet_manager.cc:1403] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:15:26.145212  7883 raft_consensus.cc:359] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.145962  7883 raft_consensus.cc:385] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.146268  7883 raft_consensus.cc:740] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.134588  7884 tablet_bootstrap.cc:492] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.147224  7884 ts_tablet_manager.cc:1403] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.016s
I20260709 13:15:26.146958  7882 raft_consensus.cc:359] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.147998  7882 raft_consensus.cc:385] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.148427  7882 raft_consensus.cc:740] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.150192  7884 raft_consensus.cc:359] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.150269  7882 consensus_queue.cc:260] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.150977  7884 raft_consensus.cc:385] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.151299  7884 raft_consensus.cc:740] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.152940  7882 ts_tablet_manager.cc:1434] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:15:26.153844  7882 tablet_bootstrap.cc:492] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.153748  7884 consensus_queue.cc:260] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.155117  7887 raft_consensus.cc:493] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.155385  7883 consensus_queue.cc:260] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.156555  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.155579  7887 raft_consensus.cc:515] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.157825  7883 ts_tablet_manager.cc:1434] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:15:26.158679  7883 tablet_bootstrap.cc:492] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.160920  7882 tablet_bootstrap.cc:654] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.165182  7883 tablet_bootstrap.cc:654] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.173110  7887 leader_election.cc:290] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
W20260709 13:15:26.175033  7734 leader_election.cc:343] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.180572  7890 raft_consensus.cc:493] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.181222  7890 raft_consensus.cc:515] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.192886  7890 leader_election.cc:290] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 40e01ad073c845148067fa56954db95b (127.6.233.1:38645)
I20260709 13:15:26.232646  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
W20260709 13:15:26.234762  7734 leader_election.cc:343] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.235371  7734 leader_election.cc:304] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b
I20260709 13:15:26.236402  7889 raft_consensus.cc:2749] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.245923  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
W20260709 13:15:26.248059  7658 leader_election.cc:343] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.262210  7884 ts_tablet_manager.cc:1434] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.115s	user 0.014s	sys 0.071s
I20260709 13:15:26.266893  7884 tablet_bootstrap.cc:492] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.271018  7883 tablet_bootstrap.cc:492] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.271600  7883 ts_tablet_manager.cc:1403] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.113s	user 0.038s	sys 0.034s
I20260709 13:15:26.272364  7889 raft_consensus.cc:493] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.272651  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:26.272842  7889 raft_consensus.cc:515] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
W20260709 13:15:26.274091  7659 leader_election.cc:343] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.274547  7659 leader_election.cc:304] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40e01ad073c845148067fa56954db95b; no voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.274808  7889 leader_election.cc:290] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837), 40e01ad073c845148067fa56954db95b (127.6.233.1:38645)
I20260709 13:15:26.276832  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.277442  7693 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 0.
I20260709 13:15:26.279241  7734 leader_election.cc:304] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.279969  7889 raft_consensus.cc:2804] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.280344  7889 raft_consensus.cc:493] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.280684  7889 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.280789  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:26.281407  7842 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 0.
I20260709 13:15:26.283190  7899 raft_consensus.cc:2749] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.284132  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.284530  7882 tablet_bootstrap.cc:492] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.284714  7693 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.284988  7882 ts_tablet_manager.cc:1403] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.131s	user 0.034s	sys 0.083s
I20260709 13:15:26.286046  7808 leader_election.cc:304] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 
I20260709 13:15:26.286859  7890 raft_consensus.cc:2804] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.286549  7883 raft_consensus.cc:359] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.287236  7890 raft_consensus.cc:493] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.287397  7883 raft_consensus.cc:385] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.287663  7890 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.287891  7883 raft_consensus.cc:740] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.288404  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.287905  7882 raft_consensus.cc:359] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.288962  7882 raft_consensus.cc:385] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.289331  7882 raft_consensus.cc:740] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.289037  7883 consensus_queue.cc:260] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.287801  7889 raft_consensus.cc:515] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.290186  7882 consensus_queue.cc:260] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.290711  7768 raft_consensus.cc:2393] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59b3b18534984d9990fa505361d6260b in current term 1: Already voted for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in this term.
W20260709 13:15:26.291782  7639 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:26.296295  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:26.279836  7884 tablet_bootstrap.cc:654] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.299376  7890 raft_consensus.cc:515] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.301740  7889 leader_election.cc:290] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Requested vote from peers 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837), 40e01ad073c845148067fa56954db95b (127.6.233.1:38645)
I20260709 13:15:26.302574  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.303328  7693 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.306985  7842 raft_consensus.cc:2393] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in current term 1: Already voted for candidate 59b3b18534984d9990fa505361d6260b in this term.
I20260709 13:15:26.314499  7890 leader_election.cc:290] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 40e01ad073c845148067fa56954db95b (127.6.233.1:38645)
I20260709 13:15:26.316301  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:26.317333  7768 raft_consensus.cc:2393] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59b3b18534984d9990fa505361d6260b in current term 1: Already voted for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in this term.
I20260709 13:15:26.318761  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.328658  7890 raft_consensus.cc:493] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.329303  7890 raft_consensus.cc:515] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.332851  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.333664  7692 raft_consensus.cc:2468] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.335229  7808 leader_election.cc:304] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 
I20260709 13:15:26.331894  7890 leader_election.cc:290] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.342296  7890 raft_consensus.cc:2804] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.342744  7890 raft_consensus.cc:493] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.343186  7890 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.347227  7883 ts_tablet_manager.cc:1434] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.075s	user 0.024s	sys 0.036s
I20260709 13:15:26.347745  7882 ts_tablet_manager.cc:1434] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.062s	user 0.023s	sys 0.038s
I20260709 13:15:26.348587  7883 tablet_bootstrap.cc:492] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.350809  7882 tablet_bootstrap.cc:492] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.355836  7883 tablet_bootstrap.cc:654] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.356473  7693 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 1.
I20260709 13:15:26.357388  7882 tablet_bootstrap.cc:654] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.357710  7734 leader_election.cc:304] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 59b3b18534984d9990fa505361d6260b
I20260709 13:15:26.358945  7907 raft_consensus.cc:2804] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.359473  7907 raft_consensus.cc:697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Becoming Leader. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:26.360426  7907 consensus_queue.cc:237] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:26.365665  7807 leader_election.cc:304] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59b3b18534984d9990fa505361d6260b; no voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.368582  7882 tablet_bootstrap.cc:492] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.369073  7882 ts_tablet_manager.cc:1403] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:15:26.370042  7910 raft_consensus.cc:2749] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.371950  7882 raft_consensus.cc:359] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.372673  7882 raft_consensus.cc:385] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.372967  7882 raft_consensus.cc:740] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.373847  7882 consensus_queue.cc:260] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.374711  7890 raft_consensus.cc:515] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.376010  7882 ts_tablet_manager.cc:1434] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:26.366083  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
W20260709 13:15:26.377790  7807 leader_election.cc:343] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.379937  7882 tablet_bootstrap.cc:492] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.386512  7883 tablet_bootstrap.cc:492] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.387171  7910 raft_consensus.cc:493] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.386721  7882 tablet_bootstrap.cc:654] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.387288  7883 ts_tablet_manager.cc:1403] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.022s
I20260709 13:15:26.387709  7910 raft_consensus.cc:515] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.389901  7910 leader_election.cc:290] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.391049  7883 raft_consensus.cc:359] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.391518  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.391773  7883 raft_consensus.cc:385] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.392091  7883 raft_consensus.cc:740] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
W20260709 13:15:26.392742  7808 leader_election.cc:343] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.392804  7883 consensus_queue.cc:260] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.394449  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.395085  7883 ts_tablet_manager.cc:1434] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260709 13:15:26.395813  7807 leader_election.cc:343] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.396144  7883 tablet_bootstrap.cc:492] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.396236  7807 leader_election.cc:304] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59b3b18534984d9990fa505361d6260b; no voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.396986  7910 raft_consensus.cc:2749] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.401867  7882 tablet_bootstrap.cc:492] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.402566  7882 ts_tablet_manager.cc:1403] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:15:26.403136  7883 tablet_bootstrap.cc:654] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.405835  7589 catalog_manager.cc:5697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2). New cstate: current_term: 1 leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.410246  7884 tablet_bootstrap.cc:492] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.410362  7883 tablet_bootstrap.cc:492] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.410287  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.410862  7884 ts_tablet_manager.cc:1403] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.144s	user 0.039s	sys 0.036s
I20260709 13:15:26.406553  7882 raft_consensus.cc:359] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.411144  7693 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.411391  7882 raft_consensus.cc:385] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.411754  7882 raft_consensus.cc:740] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.412286  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:26.413097  7882 consensus_queue.cc:260] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.413811  7884 raft_consensus.cc:359] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.414564  7884 raft_consensus.cc:385] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.414848  7884 raft_consensus.cc:740] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.412261  7890 leader_election.cc:290] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.415336  7882 ts_tablet_manager.cc:1434] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:15:26.415542  7884 consensus_queue.cc:260] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
W20260709 13:15:26.413746  7807 leader_election.cc:343] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.416870  7882 tablet_bootstrap.cc:492] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.417613  7883 ts_tablet_manager.cc:1403] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.007s
I20260709 13:15:26.423720  7882 tablet_bootstrap.cc:654] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.420324  7693 raft_consensus.cc:2468] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.425215  7808 leader_election.cc:304] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.426973  7890 raft_consensus.cc:2804] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.427621  7890 raft_consensus.cc:697] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:26.428668  7890 consensus_queue.cc:237] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.435766  7884 ts_tablet_manager.cc:1434] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:15:26.440136  7883 raft_consensus.cc:359] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.442775  7883 raft_consensus.cc:385] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.443681  7883 raft_consensus.cc:740] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.445353  7883 consensus_queue.cc:260] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.450474  7883 ts_tablet_manager.cc:1434] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:15:26.451713  7883 tablet_bootstrap.cc:492] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.453857  7884 tablet_bootstrap.cc:492] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.458071  7588 catalog_manager.cc:5697] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.461225  7882 tablet_bootstrap.cc:492] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.461697  7882 ts_tablet_manager.cc:1403] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.022s
I20260709 13:15:26.463316  7884 tablet_bootstrap.cc:654] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.464591  7882 raft_consensus.cc:359] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.465528  7882 raft_consensus.cc:385] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.465785  7883 tablet_bootstrap.cc:654] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.465915  7882 raft_consensus.cc:740] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.466760  7882 consensus_queue.cc:260] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.468746  7882 ts_tablet_manager.cc:1434] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:26.469570  7882 tablet_bootstrap.cc:492] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.473748  7882 tablet_bootstrap.cc:654] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.476922  7884 tablet_bootstrap.cc:492] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.477348  7884 ts_tablet_manager.cc:1403] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.002s
I20260709 13:15:26.481909  7884 raft_consensus.cc:359] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.482615  7884 raft_consensus.cc:385] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.482914  7884 raft_consensus.cc:740] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.487097  7884 consensus_queue.cc:260] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.492614  7884 ts_tablet_manager.cc:1434] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:15:26.494007  7884 tablet_bootstrap.cc:492] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.500481  7907 raft_consensus.cc:493] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.501011  7907 raft_consensus.cc:515] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.502259  7884 tablet_bootstrap.cc:654] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.503166  7907 leader_election.cc:290] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.504813  7883 tablet_bootstrap.cc:492] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.505290  7883 ts_tablet_manager.cc:1403] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.011s
I20260709 13:15:26.505586  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.506425  7693 raft_consensus.cc:2468] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 0.
I20260709 13:15:26.507644  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:26.508061  7883 raft_consensus.cc:359] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.508816  7883 raft_consensus.cc:385] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.508996  7734 leader_election.cc:304] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.509136  7883 raft_consensus.cc:740] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
W20260709 13:15:26.509977  7734 leader_election.cc:343] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.510113  7883 consensus_queue.cc:260] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.510778  7907 raft_consensus.cc:2804] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.511190  7884 tablet_bootstrap.cc:492] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.511268  7890 raft_consensus.cc:493] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.511224  7907 raft_consensus.cc:493] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.511840  7907 raft_consensus.cc:3060] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.511960  7884 ts_tablet_manager.cc:1403] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:15:26.511859  7890 raft_consensus.cc:515] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.514226  7890 leader_election.cc:290] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.515345  7884 raft_consensus.cc:359] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.516131  7884 raft_consensus.cc:385] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.516489  7884 raft_consensus.cc:740] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.517308  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.510874  7882 tablet_bootstrap.cc:492] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.517581  7884 consensus_queue.cc:260] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.518340  7882 ts_tablet_manager.cc:1403] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.013s
W20260709 13:15:26.518611  7808 leader_election.cc:343] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.516487  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.519027  7907 raft_consensus.cc:515] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.519372  7768 raft_consensus.cc:2468] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.520339  7884 ts_tablet_manager.cc:1434] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:26.520604  7807 leader_election.cc:304] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 40e01ad073c845148067fa56954db95b
I20260709 13:15:26.521420  7884 tablet_bootstrap.cc:492] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.522403  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:26.522871  7882 raft_consensus.cc:359] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.523514  7882 raft_consensus.cc:385] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:26.523691  7734 leader_election.cc:343] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.524375  7907 leader_election.cc:290] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.524401  7910 raft_consensus.cc:2804] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.524473  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.524955  7910 raft_consensus.cc:493] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.525107  7890 raft_consensus.cc:493] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.525218  7693 raft_consensus.cc:3060] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.525545  7890 raft_consensus.cc:515] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.527550  7890 leader_election.cc:290] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.528684  7884 tablet_bootstrap.cc:654] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.528643  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.529268  7883 ts_tablet_manager.cc:1434] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:15:26.523785  7882 raft_consensus.cc:740] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.530104  7882 consensus_queue.cc:260] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.532606  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.533167  7883 tablet_bootstrap.cc:492] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.533210  7768 raft_consensus.cc:2468] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
W20260709 13:15:26.537179  7808 leader_election.cc:343] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.537947  7807 leader_election.cc:304] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 40e01ad073c845148067fa56954db95b
I20260709 13:15:26.525374  7910 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.539845  7883 tablet_bootstrap.cc:654] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.542374  7907 raft_consensus.cc:493] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.542955  7907 raft_consensus.cc:515] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.545603  7907 leader_election.cc:290] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.532414  7693 raft_consensus.cc:2468] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 1.
I20260709 13:15:26.546034  7910 raft_consensus.cc:515] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.546931  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:26.547549  7842 raft_consensus.cc:2468] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 0.
I20260709 13:15:26.548246  7910 leader_election.cc:290] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.548740  7734 leader_election.cc:304] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.549455  7884 tablet_bootstrap.cc:492] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.549839  7882 ts_tablet_manager.cc:1434] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:15:26.549897  7884 ts_tablet_manager.cc:1403] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.011s
I20260709 13:15:26.550808  7882 tablet_bootstrap.cc:492] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.550971  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.551941  7734 leader_election.cc:304] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 59b3b18534984d9990fa505361d6260b
I20260709 13:15:26.549695  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.552840  7884 raft_consensus.cc:359] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.553572  7884 raft_consensus.cc:385] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.553915  7884 raft_consensus.cc:740] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.554206  7907 raft_consensus.cc:2804] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.554308  7890 raft_consensus.cc:2804] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.554756  7890 raft_consensus.cc:493] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.553016  7889 raft_consensus.cc:2804] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.554634  7884 consensus_queue.cc:260] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.555124  7890 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.555222  7889 raft_consensus.cc:493] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.555686  7889 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.555723  7908 raft_consensus.cc:493] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.556289  7908 raft_consensus.cc:515] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.553107  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:26.558658  7908 leader_election.cc:290] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.558650  7768 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.558954  7884 ts_tablet_manager.cc:1434] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:15:26.559926  7884 tablet_bootstrap.cc:492] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
W20260709 13:15:26.561116  7734 leader_election.cc:343] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.564424  7889 raft_consensus.cc:515] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
W20260709 13:15:26.565901  7808 leader_election.cc:343] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.568017  7882 tablet_bootstrap.cc:654] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.574331  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598af4ca126148c48e7945f05680f23f" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.570814  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b"
W20260709 13:15:26.576310  7807 leader_election.cc:343] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.577262  7890 raft_consensus.cc:515] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.571521  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598af4ca126148c48e7945f05680f23f" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.572078  7907 raft_consensus.cc:697] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Becoming Leader. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:26.578791  7842 raft_consensus.cc:2393] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in current term 1: Already voted for candidate 59b3b18534984d9990fa505361d6260b in this term.
I20260709 13:15:26.570976  7927 raft_consensus.cc:493] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.580350  7927 raft_consensus.cc:515] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.572268  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.578577  7693 raft_consensus.cc:2468] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.582123  7907 consensus_queue.cc:237] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.583413  7768 raft_consensus.cc:2468] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.577759  7908 raft_consensus.cc:493] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.584175  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:26.585326  7908 raft_consensus.cc:515] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
W20260709 13:15:26.583449  7734 leader_election.cc:343] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.586213  7890 leader_election.cc:290] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.572369  7884 tablet_bootstrap.cc:654] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.585449  7807 leader_election.cc:304] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 40e01ad073c845148067fa56954db95b
I20260709 13:15:26.587287  7908 leader_election.cc:290] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.585522  7910 raft_consensus.cc:493] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.588071  7910 raft_consensus.cc:515] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.572858  7883 tablet_bootstrap.cc:492] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.586308  7734 leader_election.cc:304] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b
I20260709 13:15:26.572484  7889 leader_election.cc:290] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.589788  7883 ts_tablet_manager.cc:1403] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.006s
I20260709 13:15:26.589867  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.589957  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:26.590607  7767 raft_consensus.cc:2468] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.590821  7908 raft_consensus.cc:2804] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.590021  7910 leader_election.cc:290] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.582548  7927 leader_election.cc:290] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.592638  7889 raft_consensus.cc:2749] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.592689  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.583797  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.594336  7693 raft_consensus.cc:2393] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in current term 1: Already voted for candidate 59b3b18534984d9990fa505361d6260b in this term.
I20260709 13:15:26.593688  7768 raft_consensus.cc:2393] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59b3b18534984d9990fa505361d6260b in current term 1: Already voted for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in this term.
I20260709 13:15:26.595094  7807 leader_election.cc:304] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.584498  7808 leader_election.cc:304] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.595824  7910 raft_consensus.cc:2804] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.591399  7908 raft_consensus.cc:697] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:26.596244  7910 raft_consensus.cc:493] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.596603  7910 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.597067  7882 tablet_bootstrap.cc:492] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.597602  7882 ts_tablet_manager.cc:1403] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 13:15:26.600623  7734 leader_election.cc:304] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b
I20260709 13:15:26.601485  7889 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.602900  7882 raft_consensus.cc:359] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.603271  7910 raft_consensus.cc:515] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.603716  7882 raft_consensus.cc:385] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.604086  7882 raft_consensus.cc:740] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
W20260709 13:15:26.604370  7807 leader_election.cc:343] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.601503  7883 raft_consensus.cc:359] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.605610  7883 raft_consensus.cc:385] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.605918  7883 raft_consensus.cc:740] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.606423  7910 leader_election.cc:290] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.606946  7910 raft_consensus.cc:2804] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.607336  7910 raft_consensus.cc:493] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.607757  7910 raft_consensus.cc:3060] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.608222  7882 consensus_queue.cc:260] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.597743  7908 consensus_queue.cc:237] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.610720  7882 ts_tablet_manager.cc:1434] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:26.608739  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.611747  7882 tablet_bootstrap.cc:492] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b: Bootstrap starting.
I20260709 13:15:26.609786  7889 raft_consensus.cc:2749] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.612823  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.607014  7883 consensus_queue.cc:260] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.614357  7692 raft_consensus.cc:2468] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.615530  7883 ts_tablet_manager.cc:1434] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:15:26.616118  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.616771  7692 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.617573  7910 raft_consensus.cc:515] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.616379  7883 tablet_bootstrap.cc:492] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.613592  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:26.618793  7768 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.618842  7588 catalog_manager.cc:5697] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2). New cstate: current_term: 1 leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.620671  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598af4ca126148c48e7945f05680f23f" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:26.621232  7767 raft_consensus.cc:3060] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.621966  7882 tablet_bootstrap.cc:654] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.628966  7767 raft_consensus.cc:2468] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.630136  7807 leader_election.cc:304] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.630959  7890 raft_consensus.cc:2804] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.631527  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598af4ca126148c48e7945f05680f23f" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.632332  7693 raft_consensus.cc:3060] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.636164  7883 tablet_bootstrap.cc:654] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.638057  7884 tablet_bootstrap.cc:492] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.638432  7884 ts_tablet_manager.cc:1403] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.008s
I20260709 13:15:26.630901  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.633666  7910 leader_election.cc:290] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.639917  7692 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.639838  7890 raft_consensus.cc:697] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
W20260709 13:15:26.639636  7808 leader_election.cc:343] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:26.641623  7882 tablet_bootstrap.cc:492] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b: No bootstrap required, opened a new log
I20260709 13:15:26.641920  7808 leader_election.cc:304] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59b3b18534984d9990fa505361d6260b; no voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.642132  7882 ts_tablet_manager.cc:1403] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.001s
I20260709 13:15:26.643846  7884 raft_consensus.cc:359] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.645092  7768 raft_consensus.cc:2468] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.646972  7884 raft_consensus.cc:385] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.647274  7884 raft_consensus.cc:740] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.647740  7807 leader_election.cc:304] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.648073  7884 consensus_queue.cc:260] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.648851  7808 leader_election.cc:304] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.649804  7910 raft_consensus.cc:2749] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.649981  7884 ts_tablet_manager.cc:1434] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:26.650925  7884 tablet_bootstrap.cc:492] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.650558  7890 consensus_queue.cc:237] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.651331  7933 raft_consensus.cc:2804] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.656427  7910 raft_consensus.cc:2804] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.656781  7910 raft_consensus.cc:493] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.657127  7910 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.660787  7692 raft_consensus.cc:2468] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.661892  7693 raft_consensus.cc:2468] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.658473  7882 raft_consensus.cc:359] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.672657  7882 raft_consensus.cc:385] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.673069  7882 raft_consensus.cc:740] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.673925  7882 consensus_queue.cc:260] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.677327  7933 raft_consensus.cc:697] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:26.679153  7933 consensus_queue.cc:237] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.678267  7908 raft_consensus.cc:493] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.684530  7884 tablet_bootstrap.cc:654] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.685230  7883 tablet_bootstrap.cc:492] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.684520  7590 catalog_manager.cc:5697] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.685719  7883 ts_tablet_manager.cc:1403] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.004s
I20260709 13:15:26.685658  7908 raft_consensus.cc:515] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.691555  7883 raft_consensus.cc:359] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.692163  7883 raft_consensus.cc:385] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.692490  7883 raft_consensus.cc:740] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.685093  7910 raft_consensus.cc:515] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.697372  7883 consensus_queue.cc:260] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.700094  7883 ts_tablet_manager.cc:1434] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:15:26.700958  7883 tablet_bootstrap.cc:492] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb: Bootstrap starting.
I20260709 13:15:26.706430  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.707034  7693 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.708289  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:26.708874  7768 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.712364  7908 leader_election.cc:290] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.713819  7910 leader_election.cc:290] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.718279  7882 ts_tablet_manager.cc:1434] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b: Time spent starting tablet: real 0.076s	user 0.019s	sys 0.015s
I20260709 13:15:26.719112  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.719092  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.719944  7767 raft_consensus.cc:2468] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.720118  7692 raft_consensus.cc:2468] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 0.
I20260709 13:15:26.721159  7807 leader_election.cc:304] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.722299  7939 raft_consensus.cc:2804] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.722633  7939 raft_consensus.cc:493] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.722918  7939 raft_consensus.cc:3060] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.724408  7693 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.725384  7808 leader_election.cc:304] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 
I20260709 13:15:26.726058  7910 raft_consensus.cc:2804] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.727124  7910 raft_consensus.cc:697] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:26.727960  7910 consensus_queue.cc:237] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.728749  7768 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.733172  7939 raft_consensus.cc:515] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.737425  7884 tablet_bootstrap.cc:492] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.737989  7884 ts_tablet_manager.cc:1403] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.002s
I20260709 13:15:26.742101  7939 leader_election.cc:290] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.743090  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:26.743085  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.743803  7767 raft_consensus.cc:3060] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.743836  7693 raft_consensus.cc:3060] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.742851  7884 raft_consensus.cc:359] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.745517  7884 raft_consensus.cc:385] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.745893  7884 raft_consensus.cc:740] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.747586  7884 consensus_queue.cc:260] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.750020  7884 ts_tablet_manager.cc:1434] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:26.751117  7884 tablet_bootstrap.cc:492] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b: Bootstrap starting.
I20260709 13:15:26.756448  7883 tablet_bootstrap.cc:654] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.761523  7884 tablet_bootstrap.cc:654] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:26.767045  7588 catalog_manager.cc:5697] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.771553  7767 raft_consensus.cc:2468] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.771247  7588 catalog_manager.cc:5697] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.773913  7807 leader_election.cc:304] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.775055  7910 raft_consensus.cc:2804] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.775306  7884 tablet_bootstrap.cc:492] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b: No bootstrap required, opened a new log
I20260709 13:15:26.775847  7884 ts_tablet_manager.cc:1403] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:15:26.775838  7910 raft_consensus.cc:697] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:26.771574  7693 raft_consensus.cc:2468] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 1.
I20260709 13:15:26.779878  7910 consensus_queue.cc:237] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.782531  7884 raft_consensus.cc:359] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.783409  7884 raft_consensus.cc:385] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.783700  7884 raft_consensus.cc:740] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.784349  7884 consensus_queue.cc:260] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.786348  7884 ts_tablet_manager.cc:1434] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:15:26.787034  7883 tablet_bootstrap.cc:492] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb: No bootstrap required, opened a new log
I20260709 13:15:26.790432  7910 raft_consensus.cc:493] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.790995  7910 raft_consensus.cc:515] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.787448  7883 ts_tablet_manager.cc:1403] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.007s
I20260709 13:15:26.794065  7883 raft_consensus.cc:359] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.794713  7883 raft_consensus.cc:385] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:26.794981  7883 raft_consensus.cc:740] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Initialized, Role: FOLLOWER
I20260709 13:15:26.795677  7883 consensus_queue.cc:260] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.797482  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.797819  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.798259  7693 raft_consensus.cc:2393] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59b3b18534984d9990fa505361d6260b in current term 1: Already voted for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in this term.
I20260709 13:15:26.799431  7910 leader_election.cc:290] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:26.799424  7808 leader_election.cc:304] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59b3b18534984d9990fa505361d6260b; no voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.799885  7588 catalog_manager.cc:5697] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.801075  7910 raft_consensus.cc:3060] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.802081  7588 catalog_manager.cc:5697] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 0 to 1, leader changed from <none> to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.804951  7883 ts_tablet_manager.cc:1434] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:15:26.806293  7910 raft_consensus.cc:2749] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.817399  7910 consensus_queue.cc:1048] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.820562  7907 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.844030  7908 consensus_queue.cc:1048] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.849612  7907 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:26.907652  7899 raft_consensus.cc:493] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.908233  7899 raft_consensus.cc:515] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.910420  7899 leader_election.cc:290] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.911161  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:26.911681  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:26.911811  7767 raft_consensus.cc:2393] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40e01ad073c845148067fa56954db95b in current term 1: Already voted for candidate 59b3b18534984d9990fa505361d6260b in this term.
I20260709 13:15:26.912992  7658 leader_election.cc:304] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40e01ad073c845148067fa56954db95b; no voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:26.913761  7899 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.918545  7899 raft_consensus.cc:2749] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:26.961583  7907 raft_consensus.cc:493] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:26.962073  7907 raft_consensus.cc:515] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.963914  7907 leader_election.cc:290] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.964866  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:26.964985  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:26.965456  7692 raft_consensus.cc:2468] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 0.
I20260709 13:15:26.965528  7842 raft_consensus.cc:2468] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 0.
I20260709 13:15:26.966496  7734 leader_election.cc:304] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.967144  7907 raft_consensus.cc:2804] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:26.967494  7907 raft_consensus.cc:493] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:26.967808  7907 raft_consensus.cc:3060] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.972378  7907 raft_consensus.cc:515] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.973876  7907 leader_election.cc:290] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:26.974728  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:26.974992  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:26.975270  7692 raft_consensus.cc:3060] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.975709  7842 raft_consensus.cc:3060] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:26.979728  7692 raft_consensus.cc:2468] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 1.
I20260709 13:15:26.980338  7842 raft_consensus.cc:2468] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 1.
I20260709 13:15:26.980809  7734 leader_election.cc:304] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:26.981556  7907 raft_consensus.cc:2804] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:26.982035  7907 raft_consensus.cc:697] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Becoming Leader. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:26.982811  7907 consensus_queue.cc:237] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:26.989483  7588 catalog_manager.cc:5697] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb reported cstate change: term changed from 0 to 1, leader changed from <none> to 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2). New cstate: current_term: 1 leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.013696  7908 consensus_queue.cc:1048] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.024477  7939 consensus_queue.cc:1048] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.100126  7939 consensus_queue.cc:1048] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.110533  7939 consensus_queue.cc:1048] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.115906  7907 consensus_queue.cc:1048] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.126875  7907 consensus_queue.cc:1048] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.174173  7899 raft_consensus.cc:493] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:27.174642  7899 raft_consensus.cc:515] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:27.176779  7899 leader_election.cc:290] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:27.177615  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" is_pre_election: true
I20260709 13:15:27.177688  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:27.178287  7767 raft_consensus.cc:2393] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40e01ad073c845148067fa56954db95b in current term 1: Already voted for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in this term.
I20260709 13:15:27.178326  7842 raft_consensus.cc:2393] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40e01ad073c845148067fa56954db95b in current term 1: Already voted for candidate 59b3b18534984d9990fa505361d6260b in this term.
I20260709 13:15:27.179378  7659 leader_election.cc:304] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40e01ad073c845148067fa56954db95b; no voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:27.179987  7899 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:27.185345  7899 raft_consensus.cc:2749] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:27.185438  7939 consensus_queue.cc:1048] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.191164  7939 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.197788  7910 consensus_queue.cc:1048] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:27.217242  7910 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.256428  7910 consensus_queue.cc:1048] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.267693  7908 consensus_queue.cc:1048] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:27.298864  7639 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:27.408133  7907 consensus_queue.cc:1048] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:27.417815  7907 consensus_queue.cc:1048] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:28.305895  7639 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:28.520530  7969 raft_consensus.cc:493] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:28.521042  7969 raft_consensus.cc:515] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:28.522662  7969 leader_election.cc:290] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:28.523568  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b" is_pre_election: true
I20260709 13:15:28.523871  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b" is_pre_election: true
I20260709 13:15:28.524163  7692 raft_consensus.cc:2468] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 1.
I20260709 13:15:28.524492  7842 raft_consensus.cc:2468] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 1.
I20260709 13:15:28.525295  7734 leader_election.cc:304] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:28.525972  7969 raft_consensus.cc:2804] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:28.526269  7969 raft_consensus.cc:493] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:28.526530  7969 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.530890  7969 raft_consensus.cc:515] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:28.532459  7969 leader_election.cc:290] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 2 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:28.533186  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:28.533391  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:28.533644  7692 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.533908  7842 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:28.538084  7692 raft_consensus.cc:2468] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 2.
I20260709 13:15:28.538215  7842 raft_consensus.cc:2468] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 2.
I20260709 13:15:28.539049  7734 leader_election.cc:304] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:28.539688  7969 raft_consensus.cc:2804] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:28.540650  7969 raft_consensus.cc:697] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Becoming Leader. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:28.541580  7969 consensus_queue.cc:237] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:28.548036  7588 catalog_manager.cc:5697] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb reported cstate change: term changed from 0 to 2, leader changed from <none> to 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2). New cstate: current_term: 2 leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.923722  7692 raft_consensus.cc:1275] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:28.925122  7972 consensus_queue.cc:1048] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:28.936841  7842 raft_consensus.cc:1275] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:28.938373  7969 consensus_queue.cc:1048] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:29.074383  7767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:58756
I20260709 13:15:29.074956  7767 raft_consensus.cc:606] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:29.086956  7842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:44512
I20260709 13:15:29.087414  7842 raft_consensus.cc:606] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:29.092231  7842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:44512
I20260709 13:15:29.092645  7842 raft_consensus.cc:606] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:29.097337  7842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:44512
I20260709 13:15:29.097779  7842 raft_consensus.cc:606] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:29.102108  7842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:44512
I20260709 13:15:29.102560  7842 raft_consensus.cc:606] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:29.109107  7842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
mode: GRACEFUL
new_leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
 from {username='slave'} at 127.0.0.1:44512
I20260709 13:15:29.109568  7842 raft_consensus.cc:606] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Received request to transfer leadership to TS 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:29.116178  7842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "598af4ca126148c48e7945f05680f23f"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
mode: GRACEFUL
new_leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
 from {username='slave'} at 127.0.0.1:44512
I20260709 13:15:29.116708  7842 raft_consensus.cc:606] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Received request to transfer leadership to TS 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:29.121261  7767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
mode: GRACEFUL
new_leader_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:58756
I20260709 13:15:29.121766  7767 raft_consensus.cc:606] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Received request to transfer leadership to TS 59b3b18534984d9990fa505361d6260b
I20260709 13:15:29.142318  7978 raft_consensus.cc:993] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.142817  7939 raft_consensus.cc:1081] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.144340  7692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54584
I20260709 13:15:29.144797  7692 raft_consensus.cc:493] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.145064  7692 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.149852  7692 raft_consensus.cc:515] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.151567  7692 leader_election.cc:290] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:29.152449  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:29.152613  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:29.153123  7767 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.153177  7842 raft_consensus.cc:3055] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:29.153559  7842 raft_consensus.cc:740] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:29.154270  7842 consensus_queue.cc:260] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.155180  7842 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.158309  7767 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.159439  7658 leader_election.cc:304] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:29.160254  7979 raft_consensus.cc:2804] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:29.160272  7842 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.161994  7979 raft_consensus.cc:697] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:29.162744  7979 consensus_queue.cc:237] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.170246  7590 catalog_manager.cc:5697] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 1 to 2, leader changed from 59b3b18534984d9990fa505361d6260b (127.6.233.3) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 2 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.180357  7978 raft_consensus.cc:993] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b: : Instructing follower 94e1c5ec49ed4e618ad6cb64d9927bbb to start an election
I20260709 13:15:29.180838  7939 raft_consensus.cc:1081] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Signalling peer 94e1c5ec49ed4e618ad6cb64d9927bbb to start an election
I20260709 13:15:29.182276  7767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "598af4ca126148c48e7945f05680f23f"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
 from {username='slave'} at 127.0.0.1:58754
I20260709 13:15:29.182747  7767 raft_consensus.cc:493] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.183055  7767 raft_consensus.cc:3060] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.187585  7767 raft_consensus.cc:515] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.189447  7767 leader_election.cc:290] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 2 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:29.190269  7692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598af4ca126148c48e7945f05680f23f" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:29.190485  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598af4ca126148c48e7945f05680f23f" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:29.190876  7692 raft_consensus.cc:3060] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.191045  7842 raft_consensus.cc:3055] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:29.191390  7842 raft_consensus.cc:740] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:29.192178  7842 consensus_queue.cc:260] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.193272  7842 raft_consensus.cc:3060] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.196677  7692 raft_consensus.cc:2468] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 2.
I20260709 13:15:29.197662  7734 leader_election.cc:304] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:29.198464  7969 raft_consensus.cc:2804] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:29.198537  7842 raft_consensus.cc:2468] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 2.
I20260709 13:15:29.199062  7969 raft_consensus.cc:697] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Becoming Leader. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:29.199874  7969 consensus_queue.cc:237] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.206398  7590 catalog_manager.cc:5697] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb reported cstate change: term changed from 1 to 2, leader changed from 59b3b18534984d9990fa505361d6260b (127.6.233.3) to 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2). New cstate: current_term: 2 leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.281256  7978 raft_consensus.cc:993] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.281695  7978 raft_consensus.cc:1081] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.283111  7692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54584
I20260709 13:15:29.283532  7692 raft_consensus.cc:493] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.283774  7692 raft_consensus.cc:3060] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.287990  7692 raft_consensus.cc:515] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.289644  7692 leader_election.cc:290] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:29.290580  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:29.290686  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041a43c869d448afa07aa253b37c4c67" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:29.291189  7767 raft_consensus.cc:3060] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.291260  7842 raft_consensus.cc:3055] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:29.291646  7842 raft_consensus.cc:740] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:29.292502  7842 consensus_queue.cc:260] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.293669  7842 raft_consensus.cc:3060] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.298013  7767 raft_consensus.cc:2468] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.299324  7658 leader_election.cc:304] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:29.300034  7979 raft_consensus.cc:2804] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:29.300282  7842 raft_consensus.cc:2468] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.300544  7979 raft_consensus.cc:697] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:29.301401  7979 consensus_queue.cc:237] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.302739  7939 raft_consensus.cc:993] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.303184  7939 raft_consensus.cc:1081] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.304760  7692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54584
I20260709 13:15:29.305392  7692 raft_consensus.cc:493] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.305752  7692 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.308969  7590 catalog_manager.cc:5697] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 1 to 2, leader changed from 59b3b18534984d9990fa505361d6260b (127.6.233.3) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 2 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.312687  7692 raft_consensus.cc:515] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.315615  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:29.316248  7767 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.316445  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:29.317018  7842 raft_consensus.cc:3055] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:29.317337  7842 raft_consensus.cc:740] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:29.318121  7842 consensus_queue.cc:260] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.319265  7842 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.319497  7939 raft_consensus.cc:993] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b: : Instructing follower 94e1c5ec49ed4e618ad6cb64d9927bbb to start an election
I20260709 13:15:29.319898  7939 raft_consensus.cc:1081] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Signalling peer 94e1c5ec49ed4e618ad6cb64d9927bbb to start an election
I20260709 13:15:29.321573  7768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
 from {username='slave'} at 127.0.0.1:58754
I20260709 13:15:29.322088  7768 raft_consensus.cc:493] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.322446  7768 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.323225  7767 raft_consensus.cc:2468] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.324373  7658 leader_election.cc:304] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:29.325206  7979 raft_consensus.cc:2804] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:29.325659  7979 raft_consensus.cc:697] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:29.326162  7842 raft_consensus.cc:2468] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.326829  7692 leader_election.cc:290] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:29.326426  7979 consensus_queue.cc:237] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.328986  7768 raft_consensus.cc:515] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.331099  7768 leader_election.cc:290] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 2 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:29.332319  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:29.332655  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:29.332880  7842 raft_consensus.cc:3055] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:29.333189  7693 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.333195  7842 raft_consensus.cc:740] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:29.334151  7842 consensus_queue.cc:260] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.335309  7842 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.341554  7842 raft_consensus.cc:2468] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 2.
I20260709 13:15:29.342087  7978 raft_consensus.cc:993] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.341784  7590 catalog_manager.cc:5697] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 1 to 2, leader changed from 59b3b18534984d9990fa505361d6260b (127.6.233.3) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 2 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.342555  7939 raft_consensus.cc:1081] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.342108  7693 raft_consensus.cc:2468] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 2.
I20260709 13:15:29.342801  7734 leader_election.cc:304] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:29.343935  7969 raft_consensus.cc:2804] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:29.344446  7969 raft_consensus.cc:697] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Becoming Leader. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:29.344491  7693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54584
I20260709 13:15:29.345116  7693 raft_consensus.cc:493] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.345504  7693 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.345345  7969 consensus_queue.cc:237] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.352490  7693 raft_consensus.cc:515] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.353964  7590 catalog_manager.cc:5697] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb reported cstate change: term changed from 1 to 2, leader changed from 59b3b18534984d9990fa505361d6260b (127.6.233.3) to 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2). New cstate: current_term: 2 leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.355093  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:29.355283  7693 leader_election.cc:290] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:29.355494  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:29.355684  7768 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.356062  7842 raft_consensus.cc:3055] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:29.356396  7842 raft_consensus.cc:740] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:29.357174  7842 consensus_queue.cc:260] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.358343  7842 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.362325  7768 raft_consensus.cc:2468] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.363394  7658 leader_election.cc:304] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:29.364327  7979 raft_consensus.cc:2804] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:29.364818  7979 raft_consensus.cc:697] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:29.365291  7842 raft_consensus.cc:2468] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.365504  7979 consensus_queue.cc:237] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.372918  7590 catalog_manager.cc:5697] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 1 to 2, leader changed from 59b3b18534984d9990fa505361d6260b (127.6.233.3) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 2 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.415143  7972 raft_consensus.cc:993] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.415650  7969 raft_consensus.cc:1081] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:29.417071  7693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54582
I20260709 13:15:29.417488  7693 raft_consensus.cc:493] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.417738  7693 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.422040  7693 raft_consensus.cc:515] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:29.423585  7693 leader_election.cc:290] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Requested vote from peers 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:29.424474  7842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:29.424743  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:29.425100  7842 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.425287  7768 raft_consensus.cc:3055] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:29.425640  7768 raft_consensus.cc:740] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:29.426488  7768 consensus_queue.cc:260] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:29.427690  7768 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:29.431948  7842 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.433223  7659 leader_election.cc:304] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 
I20260709 13:15:29.433976  7979 raft_consensus.cc:2804] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:29.434118  7768 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:29.434402  7979 raft_consensus.cc:697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:29.435173  7979 consensus_queue.cc:237] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:29.442138  7590 catalog_manager.cc:5697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 1 to 2, leader changed from 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 2 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.527413  7999 raft_consensus.cc:993] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb: : Instructing follower 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:29.527912  7969 raft_consensus.cc:1081] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Signalling peer 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:29.529605  7842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:44492
I20260709 13:15:29.530156  7842 raft_consensus.cc:493] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:29.530501  7842 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.534961  7842 raft_consensus.cc:515] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.536362  7842 leader_election.cc:290] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 3 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:29.537215  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:29.537408  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775270eee7e44f0b8be7eeb24ac165cf" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:29.537853  7693 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.537873  7768 raft_consensus.cc:3055] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:29.538378  7768 raft_consensus.cc:740] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:29.539191  7768 consensus_queue.cc:260] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.540360  7768 raft_consensus.cc:3060] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:29.544678  7693 raft_consensus.cc:2468] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 3.
I20260709 13:15:29.545897  7808 leader_election.cc:304] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 
I20260709 13:15:29.546571  7978 raft_consensus.cc:2804] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:29.546622  7768 raft_consensus.cc:2468] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 3.
I20260709 13:15:29.547109  7978 raft_consensus.cc:697] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:29.547963  7978 consensus_queue.cc:237] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:29.554102  7590 catalog_manager.cc:5697] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 2 to 3, leader changed from 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2) to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 3 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:29.680279  7768 raft_consensus.cc:1275] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.681613  7979 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.691269  7842 raft_consensus.cc:1275] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.692543  7979 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.695035  7693 raft_consensus.cc:1275] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.697599  7969 consensus_queue.cc:1048] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:29.707571  7842 raft_consensus.cc:1275] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.711113  7969 consensus_queue.cc:1048] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.735033  7842 raft_consensus.cc:1275] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.736268  7979 consensus_queue.cc:1048] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.744436  7768 raft_consensus.cc:1275] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.745905  7842 raft_consensus.cc:1275] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.746204  7979 consensus_queue.cc:1048] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.747711  7969 consensus_queue.cc:1048] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.753047  7841 raft_consensus.cc:1275] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.755079  7841 raft_consensus.cc:1275] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.757956  7979 consensus_queue.cc:1048] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.758785  8008 consensus_queue.cc:1048] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.761677  7693 raft_consensus.cc:1275] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.761729  7768 raft_consensus.cc:1275] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.763234  7969 consensus_queue.cc:1048] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.764479  7979 consensus_queue.cc:1048] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.793649  7767 raft_consensus.cc:1275] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:29.796095  8015 consensus_queue.cc:1048] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.029214  7842 raft_consensus.cc:1275] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:30.030462  7979 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.038375  7767 raft_consensus.cc:1275] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:30.039947  8016 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.108014  7693 raft_consensus.cc:1275] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:30.109333  7978 consensus_queue.cc:1048] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:30.120460  7767 raft_consensus.cc:1275] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:30.122043  8021 consensus_queue.cc:1048] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:32.150535  7076 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:15:32.151271  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:32.172863  7693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8"
dest_uuid: "40e01ad073c845148067fa56954db95b"
mode: GRACEFUL
new_leader_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:37358
I20260709 13:15:32.173419  7693 raft_consensus.cc:606] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Received request to transfer leadership to TS 59b3b18534984d9990fa505361d6260b
I20260709 13:15:32.175765  7693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738"
dest_uuid: "40e01ad073c845148067fa56954db95b"
mode: GRACEFUL
new_leader_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:37358
I20260709 13:15:32.176400  7693 raft_consensus.cc:606] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Received request to transfer leadership to TS 59b3b18534984d9990fa505361d6260b
I20260709 13:15:32.177472  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:32.177959  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:32.222574  8008 raft_consensus.cc:993] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b: : Instructing follower 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:32.223014  8026 raft_consensus.cc:1081] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Signalling peer 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:32.224436  7842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:44504
I20260709 13:15:32.224874  7842 raft_consensus.cc:493] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:32.225149  7842 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.230053  7842 raft_consensus.cc:515] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:32.231365  7842 leader_election.cc:290] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 3 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 40e01ad073c845148067fa56954db95b (127.6.233.1:38645)
I20260709 13:15:32.232228  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:32.232462  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:32.232817  7768 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.232982  7693 raft_consensus.cc:3055] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:32.233338  7693 raft_consensus.cc:740] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:32.233927  7693 consensus_queue.cc:260] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:32.234776  7693 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.237471  7768 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 3.
I20260709 13:15:32.238435  7807 leader_election.cc:304] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:32.238847  7693 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 3.
I20260709 13:15:32.239073  8023 raft_consensus.cc:2804] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:32.240003  8023 raft_consensus.cc:697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:32.240820  8023 consensus_queue.cc:237] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:32.247239  7588 catalog_manager.cc:5697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 2 to 3, leader changed from 40e01ad073c845148067fa56954db95b (127.6.233.1) to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 3 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:32.617237  8008 raft_consensus.cc:993] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b: : Instructing follower 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:32.618147  8008 raft_consensus.cc:1081] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Signalling peer 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:32.619788  7842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:44504
I20260709 13:15:32.620421  7842 raft_consensus.cc:493] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:32.620731  7842 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.626006  7842 raft_consensus.cc:515] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:32.627542  7842 leader_election.cc:290] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 3 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:32.629426  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:32.629490  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:32.630105  7693 raft_consensus.cc:3055] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:32.630236  7768 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.630398  7693 raft_consensus.cc:740] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:32.631249  7693 consensus_queue.cc:260] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:32.632534  7693 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:32.637048  7768 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 3.
I20260709 13:15:32.638566  7807 leader_election.cc:304] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:32.638789  7693 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 3.
I20260709 13:15:32.639514  8023 raft_consensus.cc:2804] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:32.639968  8023 raft_consensus.cc:697] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:32.640918  8023 consensus_queue.cc:237] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:32.651178  7588 catalog_manager.cc:5697] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 2 to 3, leader changed from 40e01ad073c845148067fa56954db95b (127.6.233.1) to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 3 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:32.673384  7693 raft_consensus.cc:1275] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:32.674984  8023 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:32.685806  7768 raft_consensus.cc:1275] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:32.687250  8023 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:33.037206  7693 raft_consensus.cc:1275] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:33.038529  8027 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:33.047516  7768 raft_consensus.cc:1275] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:33.049736  8041 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:33.179044  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:33.189849  7841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:44512
I20260709 13:15:33.190435  7841 raft_consensus.cc:606] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:33.197847  7841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:44512
I20260709 13:15:33.198318  7841 raft_consensus.cc:606] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:33.206779  7768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:58756
I20260709 13:15:33.207207  7768 raft_consensus.cc:606] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:33.211478  7768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:58756
I20260709 13:15:33.211947  7768 raft_consensus.cc:606] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:33.216406  7768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
mode: GRACEFUL
new_leader_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:58756
I20260709 13:15:33.216854  7768 raft_consensus.cc:606] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Received request to transfer leadership to TS 40e01ad073c845148067fa56954db95b
I20260709 13:15:33.319164  7972 raft_consensus.cc:993] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.319579  7972 raft_consensus.cc:1081] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.321153  7693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54582
I20260709 13:15:33.321605  7693 raft_consensus.cc:493] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.321868  7693 raft_consensus.cc:3060] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.326004  7693 raft_consensus.cc:515] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.327540  7693 leader_election.cc:290] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:33.328656  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:33.328670  7841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719f58f34ba047c59b79ea0985e9089d" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:33.329212  7768 raft_consensus.cc:3055] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:33.329300  7841 raft_consensus.cc:3060] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.329504  7768 raft_consensus.cc:740] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:33.330325  7768 consensus_queue.cc:260] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.331235  7768 raft_consensus.cc:3060] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.334159  7841 raft_consensus.cc:2468] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:33.335301  7659 leader_election.cc:304] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 
I20260709 13:15:33.336113  8026 raft_consensus.cc:2804] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:33.336033  7768 raft_consensus.cc:2468] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:33.337263  8026 raft_consensus.cc:697] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:33.338109  8026 consensus_queue.cc:237] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.345044  7590 catalog_manager.cc:5697] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 1 to 2, leader changed from 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 2 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.405911  8043 raft_consensus.cc:993] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.406397  7972 raft_consensus.cc:1081] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.407968  7693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54582
I20260709 13:15:33.408541  7693 raft_consensus.cc:493] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.408809  7693 raft_consensus.cc:3060] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.413033  7693 raft_consensus.cc:515] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.414443  7693 leader_election.cc:290] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:33.415305  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:33.415375  7841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf258cfe3d04587a2fd2f09e6f65eae" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:33.416064  7841 raft_consensus.cc:3060] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.416019  7768 raft_consensus.cc:3055] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:33.416586  7768 raft_consensus.cc:740] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:33.417443  7768 consensus_queue.cc:260] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.418632  7768 raft_consensus.cc:3060] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:33.422716  7841 raft_consensus.cc:2468] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:33.423807  7659 leader_election.cc:304] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 
I20260709 13:15:33.424432  7768 raft_consensus.cc:2468] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 2.
I20260709 13:15:33.424574  8026 raft_consensus.cc:2804] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:33.425024  8026 raft_consensus.cc:697] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:33.425987  8026 consensus_queue.cc:237] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.432369  7590 catalog_manager.cc:5697] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 1 to 2, leader changed from 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 2 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.529304  8043 raft_consensus.cc:993] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.529867  7972 raft_consensus.cc:1081] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.531208  7693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54582
I20260709 13:15:33.531649  7693 raft_consensus.cc:493] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.531917  7693 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:33.535805  7693 raft_consensus.cc:515] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.537277  7693 leader_election.cc:290] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 3 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:33.537943  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:33.538338  7841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f9140408e040218ea2dbfbc63f111b" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:33.538470  7768 raft_consensus.cc:3055] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:33.538849  7841 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:33.538841  7768 raft_consensus.cc:740] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:33.539768  7768 consensus_queue.cc:260] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.540673  7768 raft_consensus.cc:3060] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:33.543562  7841 raft_consensus.cc:2468] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 3.
I20260709 13:15:33.544536  7768 raft_consensus.cc:2468] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 3.
I20260709 13:15:33.544531  7659 leader_election.cc:304] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 59b3b18534984d9990fa505361d6260b; no voters: 
I20260709 13:15:33.545396  8026 raft_consensus.cc:2804] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:33.545919  8026 raft_consensus.cc:697] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 3 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:33.546667  8026 consensus_queue.cc:237] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.553740  7590 catalog_manager.cc:5697] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 2 to 3, leader changed from 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 3 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.565547  8023 raft_consensus.cc:993] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.566025  8041 raft_consensus.cc:1081] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.567606  7693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54584
I20260709 13:15:33.568178  7693 raft_consensus.cc:493] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.568483  7693 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.572801  7693 raft_consensus.cc:515] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.574244  7693 leader_election.cc:290] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 4 election: Requested vote from peers 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:33.575098  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:33.575265  7841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:33.575646  7768 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.575790  7841 raft_consensus.cc:3055] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:33.576149  7841 raft_consensus.cc:740] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:33.576916  7841 consensus_queue.cc:260] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.578122  7841 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.581990  7768 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 4.
I20260709 13:15:33.583186  7658 leader_election.cc:304] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:33.583972  8026 raft_consensus.cc:2804] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:33.584442  8026 raft_consensus.cc:697] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:33.585039  7841 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 4.
I20260709 13:15:33.585143  8026 consensus_queue.cc:237] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:33.591115  7590 catalog_manager.cc:5697] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 3 to 4, leader changed from 59b3b18534984d9990fa505361d6260b (127.6.233.3) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 4 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.656224  8023 raft_consensus.cc:993] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b: : Instructing follower 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.656641  8041 raft_consensus.cc:1081] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Signalling peer 40e01ad073c845148067fa56954db95b to start an election
I20260709 13:15:33.658071  7693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8"
dest_uuid: "40e01ad073c845148067fa56954db95b"
 from {username='slave'} at 127.0.0.1:54584
I20260709 13:15:33.658561  7693 raft_consensus.cc:493] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:33.658883  7693 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.663085  7693 raft_consensus.cc:515] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:33.664760  7693 leader_election.cc:290] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 4 election: Requested vote from peers 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:33.665486  7841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:33.666038  7841 raft_consensus.cc:3055] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:33.666054  7768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "40e01ad073c845148067fa56954db95b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:33.666320  7841 raft_consensus.cc:740] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:33.666715  7768 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.667001  7841 consensus_queue.cc:260] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:33.667850  7841 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:33.671134  7768 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 4.
I20260709 13:15:33.672361  7658 leader_election.cc:304] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40e01ad073c845148067fa56954db95b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:33.672859  7841 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e01ad073c845148067fa56954db95b in term 4.
I20260709 13:15:33.673185  8026 raft_consensus.cc:2804] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:33.675067  8026 raft_consensus.cc:697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Becoming Leader. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:33.675835  8026 consensus_queue.cc:237] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:33.681999  7590 catalog_manager.cc:5697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b reported cstate change: term changed from 3 to 4, leader changed from 59b3b18534984d9990fa505361d6260b (127.6.233.3) to 40e01ad073c845148067fa56954db95b (127.6.233.1). New cstate: current_term: 4 leader_uuid: "40e01ad073c845148067fa56954db95b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:33.717839  7768 raft_consensus.cc:1275] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:33.718909  8026 consensus_queue.cc:1048] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.728124  7841 raft_consensus.cc:1275] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:33.729791  8051 consensus_queue.cc:1048] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.959043  7841 raft_consensus.cc:1275] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:33.960232  8051 consensus_queue.cc:1048] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.970487  7768 raft_consensus.cc:1275] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:33.971632  8051 consensus_queue.cc:1048] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.978315  7768 raft_consensus.cc:1275] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:33.979460  8051 consensus_queue.cc:1048] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:33.987910  7841 raft_consensus.cc:1275] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:33.990756  8026 consensus_queue.cc:1048] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:34.023092  7767 raft_consensus.cc:1275] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 4 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:34.024257  8026 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:34.032394  7841 raft_consensus.cc:1275] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 4 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:34.033872  8061 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:34.055292  7767 raft_consensus.cc:1275] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 4 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:34.056473  8061 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:34.064307  7841 raft_consensus.cc:1275] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 4 FOLLOWER]: Refusing update from remote peer 40e01ad073c845148067fa56954db95b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:34.065801  8061 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:36.223006  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:36.229832  7693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8"
dest_uuid: "40e01ad073c845148067fa56954db95b"
mode: GRACEFUL
new_leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
 from {username='slave'} at 127.0.0.1:37358
I20260709 13:15:36.230289  7693 raft_consensus.cc:606] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Received request to transfer leadership to TS 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:36.232463  7693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738"
dest_uuid: "40e01ad073c845148067fa56954db95b"
mode: GRACEFUL
new_leader_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:37358
I20260709 13:15:36.232867  7693 raft_consensus.cc:606] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Received request to transfer leadership to TS 59b3b18534984d9990fa505361d6260b
I20260709 13:15:36.234689  7693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a"
dest_uuid: "40e01ad073c845148067fa56954db95b"
mode: GRACEFUL
new_leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
 from {username='slave'} at 127.0.0.1:37358
I20260709 13:15:36.235075  7693 raft_consensus.cc:606] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Received request to transfer leadership to TS 94e1c5ec49ed4e618ad6cb64d9927bbb
I20260709 13:15:36.236917  7693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5"
dest_uuid: "40e01ad073c845148067fa56954db95b"
mode: GRACEFUL
new_leader_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:37358
I20260709 13:15:36.237300  7693 raft_consensus.cc:606] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Received request to transfer leadership to TS 59b3b18534984d9990fa505361d6260b
I20260709 13:15:36.238217  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:36.238590  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:36.250402  8067 raft_consensus.cc:993] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b: : Instructing follower 94e1c5ec49ed4e618ad6cb64d9927bbb to start an election
I20260709 13:15:36.250885  8065 raft_consensus.cc:1081] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Signalling peer 94e1c5ec49ed4e618ad6cb64d9927bbb to start an election
I20260709 13:15:36.252337  7767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
 from {username='slave'} at 127.0.0.1:58740
I20260709 13:15:36.252779  7767 raft_consensus.cc:493] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:36.253047  7767 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.257534  7767 raft_consensus.cc:515] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:36.258931  7767 leader_election.cc:290] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 5 election: Requested vote from peers 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837), 40e01ad073c845148067fa56954db95b (127.6.233.1:38645)
I20260709 13:15:36.259761  7841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:36.259989  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd306e2d63141a99951fe3ab8bee1e8" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:36.260329  7841 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.260515  7693 raft_consensus.cc:3055] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:36.260836  7693 raft_consensus.cc:740] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:36.261469  7693 consensus_queue.cc:260] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:36.262259  7693 raft_consensus.cc:3060] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.265069  7841 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 5.
I20260709 13:15:36.266156  7693 raft_consensus.cc:2468] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 5.
I20260709 13:15:36.266188  7734 leader_election.cc:304] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:36.266981  8068 raft_consensus.cc:2804] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:36.267903  8068 raft_consensus.cc:697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 LEADER]: Becoming Leader. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:36.268778  8068 consensus_queue.cc:237] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } }
I20260709 13:15:36.275243  7588 catalog_manager.cc:5697] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb reported cstate change: term changed from 4 to 5, leader changed from 40e01ad073c845148067fa56954db95b (127.6.233.1) to 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2). New cstate: current_term: 5 leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.557768  8067 raft_consensus.cc:993] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b: : Instructing follower 94e1c5ec49ed4e618ad6cb64d9927bbb to start an election
I20260709 13:15:36.558187  8065 raft_consensus.cc:1081] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Signalling peer 94e1c5ec49ed4e618ad6cb64d9927bbb to start an election
I20260709 13:15:36.559573  7767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a"
dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
 from {username='slave'} at 127.0.0.1:58740
I20260709 13:15:36.560035  7767 raft_consensus.cc:493] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:36.560318  7767 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.564927  7767 raft_consensus.cc:515] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.566278  7767 leader_election.cc:290] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 3 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 59b3b18534984d9990fa505361d6260b (127.6.233.3:35837)
I20260709 13:15:36.566915  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:36.567438  7693 raft_consensus.cc:3055] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:36.567386  7841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cad1fa8779948188c5dc1205e7db50a" candidate_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59b3b18534984d9990fa505361d6260b"
I20260709 13:15:36.567835  7693 raft_consensus.cc:740] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:36.568008  7841 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.568610  7693 consensus_queue.cc:260] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.569761  7693 raft_consensus.cc:3060] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.574549  7841 raft_consensus.cc:2468] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 3.
I20260709 13:15:36.575663  7734 leader_election.cc:304] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:36.575841  7693 raft_consensus.cc:2468] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94e1c5ec49ed4e618ad6cb64d9927bbb in term 3.
I20260709 13:15:36.576531  8068 raft_consensus.cc:2804] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:36.576993  8068 raft_consensus.cc:697] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 LEADER]: Becoming Leader. State: Replica: 94e1c5ec49ed4e618ad6cb64d9927bbb, State: Running, Role: LEADER
I20260709 13:15:36.577790  8068 consensus_queue.cc:237] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.587050  7588 catalog_manager.cc:5697] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb reported cstate change: term changed from 2 to 3, leader changed from 40e01ad073c845148067fa56954db95b (127.6.233.1) to 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2). New cstate: current_term: 3 leader_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.590246  8067 raft_consensus.cc:993] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b: : Instructing follower 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:36.590708  8065 raft_consensus.cc:1081] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Signalling peer 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:36.592298  7841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:44504
I20260709 13:15:36.592741  7841 raft_consensus.cc:493] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:36.593041  7841 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.597882  7841 raft_consensus.cc:515] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.599226  7841 leader_election.cc:290] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 3 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:36.600060  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:36.600294  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2e7bff8785e4c7db11248adb1b8eac5" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:36.600612  7693 raft_consensus.cc:3055] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:36.600728  7767 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.600930  7693 raft_consensus.cc:740] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:36.601652  7693 consensus_queue.cc:260] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.602689  7693 raft_consensus.cc:3060] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.606809  7767 raft_consensus.cc:2468] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 3.
I20260709 13:15:36.608162  7807 leader_election.cc:304] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:36.608675  7693 raft_consensus.cc:2468] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 3.
I20260709 13:15:36.608999  8041 raft_consensus.cc:2804] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:36.610287  8041 raft_consensus.cc:697] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:36.611205  8041 consensus_queue.cc:237] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.619109  7588 catalog_manager.cc:5697] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 2 to 3, leader changed from 40e01ad073c845148067fa56954db95b (127.6.233.1) to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 3 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.809652  7693 raft_consensus.cc:1275] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 5 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:36.810914  8068 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:36.820514  7841 raft_consensus.cc:1275] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 5 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:36.822283  8068 consensus_queue.cc:1048] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:36.833909  8067 raft_consensus.cc:993] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b: : Instructing follower 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:36.834414  8065 raft_consensus.cc:1081] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Signalling peer 59b3b18534984d9990fa505361d6260b to start an election
I20260709 13:15:36.835824  7841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738"
dest_uuid: "59b3b18534984d9990fa505361d6260b"
 from {username='slave'} at 127.0.0.1:44504
I20260709 13:15:36.836277  7841 raft_consensus.cc:493] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:36.836553  7841 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.840837  7841 raft_consensus.cc:515] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.842128  7841 leader_election.cc:290] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 5 election: Requested vote from peers 40e01ad073c845148067fa56954db95b (127.6.233.1:38645), 94e1c5ec49ed4e618ad6cb64d9927bbb (127.6.233.2:44895)
I20260709 13:15:36.842922  7693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "40e01ad073c845148067fa56954db95b"
I20260709 13:15:36.843115  7767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c3ee1ba73c4438c81c04e494930f738" candidate_uuid: "59b3b18534984d9990fa505361d6260b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb"
I20260709 13:15:36.843398  7693 raft_consensus.cc:3055] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:36.843608  7767 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.843714  7693 raft_consensus.cc:740] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40e01ad073c845148067fa56954db95b, State: Running, Role: LEADER
I20260709 13:15:36.844473  7693 consensus_queue.cc:260] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.845264  7693 raft_consensus.cc:3060] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:36.848361  7767 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 5.
I20260709 13:15:36.849323  7693 raft_consensus.cc:2468] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59b3b18534984d9990fa505361d6260b in term 5.
I20260709 13:15:36.849385  7807 leader_election.cc:304] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b3b18534984d9990fa505361d6260b, 94e1c5ec49ed4e618ad6cb64d9927bbb; no voters: 
I20260709 13:15:36.850210  8041 raft_consensus.cc:2804] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:36.850651  8041 raft_consensus.cc:697] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 5 LEADER]: Becoming Leader. State: Replica: 59b3b18534984d9990fa505361d6260b, State: Running, Role: LEADER
I20260709 13:15:36.851338  8041 consensus_queue.cc:237] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } }
I20260709 13:15:36.857146  7590 catalog_manager.cc:5697] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b reported cstate change: term changed from 4 to 5, leader changed from 40e01ad073c845148067fa56954db95b (127.6.233.1) to 59b3b18534984d9990fa505361d6260b (127.6.233.3). New cstate: current_term: 5 leader_uuid: "59b3b18534984d9990fa505361d6260b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.976132  7841 raft_consensus.cc:1275] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:36.977458  8068 consensus_queue.cc:1048] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b3b18534984d9990fa505361d6260b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:36.987486  7693 raft_consensus.cc:1275] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Refusing update from remote peer 94e1c5ec49ed4e618ad6cb64d9927bbb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:36.989358  8068 consensus_queue.cc:1048] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:37.121057  7693 raft_consensus.cc:1275] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:37.122221  8041 consensus_queue.cc:1048] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e01ad073c845148067fa56954db95b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 38645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:37.131893  7767 raft_consensus.cc:1275] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:37.133576  8076 consensus_queue.cc:1048] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:37.239270  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:37.245201  7076 tablet_server.cc:179] TabletServer@127.6.233.1:0 shutting down...
I20260709 13:15:37.252125  7767 raft_consensus.cc:1275] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 FOLLOWER]: Refusing update from remote peer 59b3b18534984d9990fa505361d6260b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:37.253322  8076 consensus_queue.cc:1048] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [LEADER]: Connected to new peer: Peer: permanent_uuid: "94e1c5ec49ed4e618ad6cb64d9927bbb" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 44895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:15:37.269484  7808 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:15:37.273061  7808 consensus_peers.cc:597] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b -> Peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Couldn't send request to peer 40e01ad073c845148067fa56954db95b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:37.281492  7734 consensus_peers.cc:597] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb -> Peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Couldn't send request to peer 40e01ad073c845148067fa56954db95b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:37.283156  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:37.284000  7076 tablet_replica.cc:333] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.284909  7076 raft_consensus.cc:2243] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.285449  7076 raft_consensus.cc:2272] T 775270eee7e44f0b8be7eeb24ac165cf P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.287343  7076 tablet_replica.cc:333] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.287818  7076 raft_consensus.cc:2243] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.288605  7076 raft_consensus.cc:2272] T fdf258cfe3d04587a2fd2f09e6f65eae P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.290127  7076 tablet_replica.cc:333] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.290663  7076 raft_consensus.cc:2243] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.291245  7076 raft_consensus.cc:2272] T 37f9140408e040218ea2dbfbc63f111b P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.292760  7076 tablet_replica.cc:333] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.293183  7076 raft_consensus.cc:2243] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.293512  7076 raft_consensus.cc:2272] T 598af4ca126148c48e7945f05680f23f P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.294970  7076 tablet_replica.cc:333] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.295444  7076 raft_consensus.cc:2243] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.295745  7076 raft_consensus.cc:2272] T 3c3ee1ba73c4438c81c04e494930f738 P 40e01ad073c845148067fa56954db95b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.297297  7076 tablet_replica.cc:333] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.297905  7076 raft_consensus.cc:2243] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.298614  7076 raft_consensus.cc:2272] T 719f58f34ba047c59b79ea0985e9089d P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.300009  7076 tablet_replica.cc:333] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.300455  7076 raft_consensus.cc:2243] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.300766  7076 raft_consensus.cc:2272] T c2e7bff8785e4c7db11248adb1b8eac5 P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.303154  7076 tablet_replica.cc:333] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.303563  7076 raft_consensus.cc:2243] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.304298  7076 raft_consensus.cc:2272] T 041a43c869d448afa07aa253b37c4c67 P 40e01ad073c845148067fa56954db95b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.305825  7076 tablet_replica.cc:333] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.306216  7076 raft_consensus.cc:2243] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.306519  7076 raft_consensus.cc:2272] T 1bd306e2d63141a99951fe3ab8bee1e8 P 40e01ad073c845148067fa56954db95b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.308640  7076 tablet_replica.cc:333] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b: stopping tablet replica
I20260709 13:15:37.309123  7076 raft_consensus.cc:2243] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.309508  7076 raft_consensus.cc:2272] T 9cad1fa8779948188c5dc1205e7db50a P 40e01ad073c845148067fa56954db95b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:37.323311  7808 consensus_peers.cc:597] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b -> Peer 40e01ad073c845148067fa56954db95b (127.6.233.1:38645): Couldn't send request to peer 40e01ad073c845148067fa56954db95b. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:37.339833  7076 tablet_server.cc:196] TabletServer@127.6.233.1:0 shutdown complete.
I20260709 13:15:37.357854  7076 tablet_server.cc:179] TabletServer@127.6.233.2:0 shutting down...
I20260709 13:15:37.380954  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:37.381536  7076 tablet_replica.cc:333] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.382025  7076 raft_consensus.cc:2243] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.382393  7076 raft_consensus.cc:2272] T 3c3ee1ba73c4438c81c04e494930f738 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.384430  7076 tablet_replica.cc:333] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.384883  7076 raft_consensus.cc:2243] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.385526  7076 raft_consensus.cc:2272] T 598af4ca126148c48e7945f05680f23f P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.387029  7076 tablet_replica.cc:333] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.387457  7076 raft_consensus.cc:2243] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.387791  7076 raft_consensus.cc:2272] T 37f9140408e040218ea2dbfbc63f111b P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.389359  7076 tablet_replica.cc:333] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.389853  7076 raft_consensus.cc:2243] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.390221  7076 raft_consensus.cc:2272] T 041a43c869d448afa07aa253b37c4c67 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.391980  7076 tablet_replica.cc:333] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.392481  7076 raft_consensus.cc:2243] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.392791  7076 raft_consensus.cc:2272] T fdf258cfe3d04587a2fd2f09e6f65eae P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.394260  7076 tablet_replica.cc:333] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.394654  7076 raft_consensus.cc:2243] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.395071  7076 raft_consensus.cc:2272] T 775270eee7e44f0b8be7eeb24ac165cf P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.396731  7076 tablet_replica.cc:333] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.397205  7076 raft_consensus.cc:2243] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.397881  7076 raft_consensus.cc:2272] T 9cad1fa8779948188c5dc1205e7db50a P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.399802  7076 tablet_replica.cc:333] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.400314  7076 raft_consensus.cc:2243] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.401007  7076 raft_consensus.cc:2272] T 1bd306e2d63141a99951fe3ab8bee1e8 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.402856  7076 tablet_replica.cc:333] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.403301  7076 raft_consensus.cc:2243] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.403671  7076 raft_consensus.cc:2272] T 719f58f34ba047c59b79ea0985e9089d P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.405166  7076 tablet_replica.cc:333] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb: stopping tablet replica
I20260709 13:15:37.405581  7076 raft_consensus.cc:2243] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.405965  7076 raft_consensus.cc:2272] T c2e7bff8785e4c7db11248adb1b8eac5 P 94e1c5ec49ed4e618ad6cb64d9927bbb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.434230  7076 tablet_server.cc:196] TabletServer@127.6.233.2:0 shutdown complete.
I20260709 13:15:37.451364  7076 tablet_server.cc:179] TabletServer@127.6.233.3:0 shutting down...
I20260709 13:15:37.474159  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:37.474857  7076 tablet_replica.cc:333] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.475418  7076 raft_consensus.cc:2243] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.475870  7076 raft_consensus.cc:2272] T 041a43c869d448afa07aa253b37c4c67 P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.477514  7076 tablet_replica.cc:333] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.478037  7076 raft_consensus.cc:2243] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.478426  7076 raft_consensus.cc:2272] T 719f58f34ba047c59b79ea0985e9089d P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.479949  7076 tablet_replica.cc:333] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.480504  7076 raft_consensus.cc:2243] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.481179  7076 raft_consensus.cc:2272] T c2e7bff8785e4c7db11248adb1b8eac5 P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.482960  7076 tablet_replica.cc:333] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.483472  7076 raft_consensus.cc:2243] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.483868  7076 raft_consensus.cc:2272] T 37f9140408e040218ea2dbfbc63f111b P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.485347  7076 tablet_replica.cc:333] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.485831  7076 raft_consensus.cc:2243] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.486469  7076 raft_consensus.cc:2272] T 775270eee7e44f0b8be7eeb24ac165cf P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.488005  7076 tablet_replica.cc:333] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.488533  7076 raft_consensus.cc:2243] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.488905  7076 raft_consensus.cc:2272] T fdf258cfe3d04587a2fd2f09e6f65eae P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.490442  7076 tablet_replica.cc:333] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.490893  7076 raft_consensus.cc:2243] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.491250  7076 raft_consensus.cc:2272] T 1bd306e2d63141a99951fe3ab8bee1e8 P 59b3b18534984d9990fa505361d6260b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.493286  7076 tablet_replica.cc:333] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.493736  7076 raft_consensus.cc:2243] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.494128  7076 raft_consensus.cc:2272] T 9cad1fa8779948188c5dc1205e7db50a P 59b3b18534984d9990fa505361d6260b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.496161  7076 tablet_replica.cc:333] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.496588  7076 raft_consensus.cc:2243] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:37.496995  7076 raft_consensus.cc:2272] T 598af4ca126148c48e7945f05680f23f P 59b3b18534984d9990fa505361d6260b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.498854  7076 tablet_replica.cc:333] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b: stopping tablet replica
I20260709 13:15:37.499372  7076 raft_consensus.cc:2243] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.499975  7076 raft_consensus.cc:2272] T 3c3ee1ba73c4438c81c04e494930f738 P 59b3b18534984d9990fa505361d6260b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.526794  7076 tablet_server.cc:196] TabletServer@127.6.233.3:0 shutdown complete.
I20260709 13:15:37.543735  7076 master.cc:562] Master@127.6.233.62:33101 shutting down...
I20260709 13:15:37.561940  7076 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:37.562465  7076 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:37.562790  7076 tablet_replica.cc:333] T 00000000000000000000000000000000 P 216c44cd7e3c45c9aef6913a66a6b2ac: stopping tablet replica
I20260709 13:15:37.581686  7076 master.cc:584] Master@127.6.233.62:33101 shutdown complete.
40e01ad073c845148067fa56954db95b  5
59b3b18534984d9990fa505361d6260b  1
94e1c5ec49ed4e618ad6cb64d9927bbb  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (12447 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:15:37.621951  7076 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.233.62:38939
I20260709 13:15:37.623063  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:37.628846  8094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:37.628952  8093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:37.629199  8096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:37.630450  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:37.631295  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:37.631466  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:37.631664  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602937631631 us; error 0 us; skew 500 ppm
I20260709 13:15:37.632268  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:37.634625  7076 webserver.cc:533] Webserver started at http://127.6.233.62:37737/ using document root <none> and password file <none>
I20260709 13:15:37.635149  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:37.635330  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:37.635643  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:37.636781  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/master-0-root/instance:
uuid: "e8c3cea2f3524d70be8a4a6e5be1c492"
format_stamp: "Formatted at 2026-07-09 13:15:37 on dist-test-slave-sjgx"
I20260709 13:15:37.640905  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:15:37.643996  8101 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:37.644812  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:37.645079  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/master-0-root
uuid: "e8c3cea2f3524d70be8a4a6e5be1c492"
format_stamp: "Formatted at 2026-07-09 13:15:37 on dist-test-slave-sjgx"
I20260709 13:15:37.645361  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:37.658078  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:37.659190  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:37.696143  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.62:38939
I20260709 13:15:37.696297  8152 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.62:38939 every 8 connection(s)
I20260709 13:15:37.700014  8153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:37.709151  8153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Bootstrap starting.
I20260709 13:15:37.713963  8153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.717981  8153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: No bootstrap required, opened a new log
I20260709 13:15:37.719933  8153 raft_consensus.cc:359] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c3cea2f3524d70be8a4a6e5be1c492" member_type: VOTER }
I20260709 13:15:37.720391  8153 raft_consensus.cc:385] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.720631  8153 raft_consensus.cc:740] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8c3cea2f3524d70be8a4a6e5be1c492, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.721233  8153 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c3cea2f3524d70be8a4a6e5be1c492" member_type: VOTER }
I20260709 13:15:37.721714  8153 raft_consensus.cc:399] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:37.721937  8153 raft_consensus.cc:493] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:37.722210  8153 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.726892  8153 raft_consensus.cc:515] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c3cea2f3524d70be8a4a6e5be1c492" member_type: VOTER }
I20260709 13:15:37.727411  8153 leader_election.cc:304] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8c3cea2f3524d70be8a4a6e5be1c492; no voters: 
I20260709 13:15:37.728485  8153 leader_election.cc:290] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:37.728788  8156 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.730065  8156 raft_consensus.cc:697] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 1 LEADER]: Becoming Leader. State: Replica: e8c3cea2f3524d70be8a4a6e5be1c492, State: Running, Role: LEADER
I20260709 13:15:37.730748  8156 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c3cea2f3524d70be8a4a6e5be1c492" member_type: VOTER }
I20260709 13:15:37.731324  8153 sys_catalog.cc:565] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:37.735534  8158 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8c3cea2f3524d70be8a4a6e5be1c492. Latest consensus state: current_term: 1 leader_uuid: "e8c3cea2f3524d70be8a4a6e5be1c492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c3cea2f3524d70be8a4a6e5be1c492" member_type: VOTER } }
I20260709 13:15:37.736232  8158 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:37.736569  8157 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8c3cea2f3524d70be8a4a6e5be1c492" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8c3cea2f3524d70be8a4a6e5be1c492" member_type: VOTER } }
I20260709 13:15:37.737088  8157 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:37.738658  8163 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:37.743283  8163 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:37.746414  7076 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:37.751526  8163 catalog_manager.cc:1383] Generated new cluster ID: acad539d8c1546158327b8f11dde09ca
I20260709 13:15:37.751838  8163 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:37.773499  8163 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:37.774703  8163 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:37.800508  8163 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Generated new TSK 0
I20260709 13:15:37.801128  8163 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:37.812934  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:37.818672  8174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:37.819634  8175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:37.823184  8177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:37.823390  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:37.824383  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:37.824568  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:37.824684  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602937824673 us; error 0 us; skew 500 ppm
I20260709 13:15:37.825151  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:37.827373  7076 webserver.cc:533] Webserver started at http://127.6.233.1:43203/ using document root <none> and password file <none>
I20260709 13:15:37.827816  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:37.827968  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:37.828263  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:37.829264  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/instance:
uuid: "9e95b04d03d241329435b6d08dd1f236"
format_stamp: "Formatted at 2026-07-09 13:15:37 on dist-test-slave-sjgx"
I20260709 13:15:37.833602  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:15:37.836794  8182 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:37.837527  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:37.837819  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "9e95b04d03d241329435b6d08dd1f236"
format_stamp: "Formatted at 2026-07-09 13:15:37 on dist-test-slave-sjgx"
I20260709 13:15:37.838063  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:37.848728  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:37.849944  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:37.851394  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:37.853628  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:37.853852  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:37.854097  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:37.854280  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:37.893133  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:43925
I20260709 13:15:37.893222  8244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:43925 every 8 connection(s)
I20260709 13:15:37.897879  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:37.905385  8249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:37.907660  8250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:37.909629  8252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:37.910615  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:37.911540  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:37.911757  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:37.912489  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602937911929 us; error 0 us; skew 500 ppm
I20260709 13:15:37.913226  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:37.914266  8245 heartbeater.cc:344] Connected to a master server at 127.6.233.62:38939
I20260709 13:15:37.914692  8245 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:37.915546  8245 heartbeater.cc:507] Master 127.6.233.62:38939 requested a full tablet report, sending...
I20260709 13:15:37.915940  7076 webserver.cc:533] Webserver started at http://127.6.233.2:43581/ using document root <none> and password file <none>
I20260709 13:15:37.916590  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:37.916791  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:37.917074  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:37.917979  8118 ts_manager.cc:194] Registered new tserver with Master: 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:15:37.918553  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/instance:
uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
format_stamp: "Formatted at 2026-07-09 13:15:37 on dist-test-slave-sjgx"
I20260709 13:15:37.920370  8118 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46474
I20260709 13:15:37.923923  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:15:37.927016  8257 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:37.927738  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:37.928017  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root
uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
format_stamp: "Formatted at 2026-07-09 13:15:37 on dist-test-slave-sjgx"
I20260709 13:15:37.928368  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:37.952737  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:37.953888  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:37.955322  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:37.957496  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:37.957713  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:37.957958  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:37.958127  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:37.999863  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.2:40391
I20260709 13:15:37.999960  8319 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.2:40391 every 8 connection(s)
I20260709 13:15:38.004980  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:38.012100  8323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.013478  8324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.016484  7076 server_base.cc:1061] running on GCE node
W20260709 13:15:38.016917  8326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.018054  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:38.018309  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:38.018493  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602938018471 us; error 0 us; skew 500 ppm
I20260709 13:15:38.018996  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:38.019160  8320 heartbeater.cc:344] Connected to a master server at 127.6.233.62:38939
I20260709 13:15:38.019542  8320 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:38.020550  8320 heartbeater.cc:507] Master 127.6.233.62:38939 requested a full tablet report, sending...
I20260709 13:15:38.021760  7076 webserver.cc:533] Webserver started at http://127.6.233.3:42673/ using document root <none> and password file <none>
I20260709 13:15:38.022261  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:38.022449  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:38.022717  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:38.022837  8118 ts_manager.cc:194] Registered new tserver with Master: 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:38.023841  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/instance:
uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-sjgx"
I20260709 13:15:38.024250  8118 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46484
I20260709 13:15:38.028371  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:15:38.031616  8331 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.032418  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:38.032784  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root
uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-sjgx"
I20260709 13:15:38.033069  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:38.043143  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:38.044358  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:38.045763  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:38.048027  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:38.048297  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.048544  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:38.048727  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.110338  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.3:43697
I20260709 13:15:38.110491  8393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.3:43697 every 8 connection(s)
I20260709 13:15:38.124342  8394 heartbeater.cc:344] Connected to a master server at 127.6.233.62:38939
I20260709 13:15:38.124718  8394 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:38.125418  8394 heartbeater.cc:507] Master 127.6.233.62:38939 requested a full tablet report, sending...
I20260709 13:15:38.127207  8118 ts_manager.cc:194] Registered new tserver with Master: 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:38.127771  7076 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014261651s
I20260709 13:15:38.128595  8118 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46486
I20260709 13:15:38.153548  8118 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46502:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:38.159355  8118 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:38.356937  8285 tablet_service.cc:1511] Processing CreateTablet for tablet caf02b6ca7a34be9bbac5771e91f767a (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:38.358407  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf02b6ca7a34be9bbac5771e91f767a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.358114  8284 tablet_service.cc:1511] Processing CreateTablet for tablet 46e06d1a840c4315837a871dc31b4497 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:38.359823  8284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e06d1a840c4315837a871dc31b4497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.361470  8283 tablet_service.cc:1511] Processing CreateTablet for tablet e1ab3ddb872e454ab0de56eb9ba4ccf3 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:38.363276  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ab3ddb872e454ab0de56eb9ba4ccf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.365937  8282 tablet_service.cc:1511] Processing CreateTablet for tablet ee0be2dae2824fd89d658f949f717dfc (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:38.367393  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0be2dae2824fd89d658f949f717dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.370020  8210 tablet_service.cc:1511] Processing CreateTablet for tablet caf02b6ca7a34be9bbac5771e91f767a (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:38.371533  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf02b6ca7a34be9bbac5771e91f767a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.382403  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 46e06d1a840c4315837a871dc31b4497 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:38.383862  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e06d1a840c4315837a871dc31b4497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.389022  8359 tablet_service.cc:1511] Processing CreateTablet for tablet caf02b6ca7a34be9bbac5771e91f767a (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:38.390458  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf02b6ca7a34be9bbac5771e91f767a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.390846  8207 tablet_service.cc:1511] Processing CreateTablet for tablet ee0be2dae2824fd89d658f949f717dfc (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:38.392177  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0be2dae2824fd89d658f949f717dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.392833  8358 tablet_service.cc:1511] Processing CreateTablet for tablet 46e06d1a840c4315837a871dc31b4497 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:38.394060  8358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e06d1a840c4315837a871dc31b4497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.389179  8208 tablet_service.cc:1511] Processing CreateTablet for tablet e1ab3ddb872e454ab0de56eb9ba4ccf3 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:38.396905  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ab3ddb872e454ab0de56eb9ba4ccf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.389014  8357 tablet_service.cc:1511] Processing CreateTablet for tablet e1ab3ddb872e454ab0de56eb9ba4ccf3 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:38.398674  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ab3ddb872e454ab0de56eb9ba4ccf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.402155  8356 tablet_service.cc:1511] Processing CreateTablet for tablet ee0be2dae2824fd89d658f949f717dfc (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:38.403461  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0be2dae2824fd89d658f949f717dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.403924  8281 tablet_service.cc:1511] Processing CreateTablet for tablet a7984a0dbb5d4008936cec86daf790e9 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:38.405261  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7984a0dbb5d4008936cec86daf790e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.405121  8206 tablet_service.cc:1511] Processing CreateTablet for tablet a7984a0dbb5d4008936cec86daf790e9 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:38.406414  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7984a0dbb5d4008936cec86daf790e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.409880  8205 tablet_service.cc:1511] Processing CreateTablet for tablet ff5614e6d15c446ba2addddda765efdd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:38.410501  8280 tablet_service.cc:1511] Processing CreateTablet for tablet ff5614e6d15c446ba2addddda765efdd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:38.411247  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5614e6d15c446ba2addddda765efdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.411773  8280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5614e6d15c446ba2addddda765efdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.413199  8204 tablet_service.cc:1511] Processing CreateTablet for tablet cfe43428b7ca43928b7eeb8cce815e8d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:38.417526  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe43428b7ca43928b7eeb8cce815e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.421334  8355 tablet_service.cc:1511] Processing CreateTablet for tablet a7984a0dbb5d4008936cec86daf790e9 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:38.422662  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7984a0dbb5d4008936cec86daf790e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.422170  8354 tablet_service.cc:1511] Processing CreateTablet for tablet ff5614e6d15c446ba2addddda765efdd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:38.423620  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5614e6d15c446ba2addddda765efdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.431818  8353 tablet_service.cc:1511] Processing CreateTablet for tablet cfe43428b7ca43928b7eeb8cce815e8d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:38.433351  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe43428b7ca43928b7eeb8cce815e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.434484  8203 tablet_service.cc:1511] Processing CreateTablet for tablet be0d0091520f4d6ea7668120e21a6aa0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:38.435815  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0d0091520f4d6ea7668120e21a6aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.438148  8279 tablet_service.cc:1511] Processing CreateTablet for tablet be0d0091520f4d6ea7668120e21a6aa0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:38.439453  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0d0091520f4d6ea7668120e21a6aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.441187  8352 tablet_service.cc:1511] Processing CreateTablet for tablet be0d0091520f4d6ea7668120e21a6aa0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:38.442500  8352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0d0091520f4d6ea7668120e21a6aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.442618  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 7feffaf779354992809fb6a460399626 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:38.445114  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7feffaf779354992809fb6a460399626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.445226  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 7feffaf779354992809fb6a460399626 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:38.446543  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7feffaf779354992809fb6a460399626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.457258  8282 tablet_service.cc:1511] Processing CreateTablet for tablet cfe43428b7ca43928b7eeb8cce815e8d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:38.458609  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe43428b7ca43928b7eeb8cce815e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.458668  8351 tablet_service.cc:1511] Processing CreateTablet for tablet 7feffaf779354992809fb6a460399626 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:38.460026  8351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7feffaf779354992809fb6a460399626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.488925  8409 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:38.514577  8201 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81beec7fc64c498918eb3ea356d2c7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:38.516521  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81beec7fc64c498918eb3ea356d2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.517127  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81beec7fc64c498918eb3ea356d2c7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:38.525195  8350 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81beec7fc64c498918eb3ea356d2c7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:38.526861  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81beec7fc64c498918eb3ea356d2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.533871  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81beec7fc64c498918eb3ea356d2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.540983  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 133eb5f61ebc499ab283df4c068d5be7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:38.542655  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133eb5f61ebc499ab283df4c068d5be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.548712  8410 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:38.555078  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 133eb5f61ebc499ab283df4c068d5be7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:38.557456  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133eb5f61ebc499ab283df4c068d5be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.563648  8410 tablet_bootstrap.cc:654] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.568987  8284 tablet_service.cc:1511] Processing CreateTablet for tablet 8942278c55614601a1290e32997fe007 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:38.575145  8353 tablet_service.cc:1511] Processing CreateTablet for tablet 133eb5f61ebc499ab283df4c068d5be7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:38.579744  8284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8942278c55614601a1290e32997fe007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.579905  8411 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:38.582078  8356 tablet_service.cc:1511] Processing CreateTablet for tablet 8942278c55614601a1290e32997fe007 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:38.585135  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 8942278c55614601a1290e32997fe007 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:38.586058  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8942278c55614601a1290e32997fe007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.586479  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8942278c55614601a1290e32997fe007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.586508  8205 tablet_service.cc:1511] Processing CreateTablet for tablet 509edc927d524436b819a0e96e615799 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:38.587848  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509edc927d524436b819a0e96e615799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.589926  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 509edc927d524436b819a0e96e615799 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:38.591178  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509edc927d524436b819a0e96e615799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.592916  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133eb5f61ebc499ab283df4c068d5be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.610622  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 509edc927d524436b819a0e96e615799 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:38.612428  8409 tablet_bootstrap.cc:654] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.626039  8279 tablet_service.cc:1511] Processing CreateTablet for tablet 3caa82d776714435898936cb4c6041c0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:38.628664  8411 tablet_bootstrap.cc:654] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.629160  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3caa82d776714435898936cb4c6041c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.628151  8410 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:38.624820  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509edc927d524436b819a0e96e615799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.640447  8409 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:38.640937  8409 ts_tablet_manager.cc:1403] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.000s
I20260709 13:15:38.643798  8409 raft_consensus.cc:359] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.644601  8409 raft_consensus.cc:385] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.644913  8409 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.651507  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 3caa82d776714435898936cb4c6041c0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:38.652952  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3caa82d776714435898936cb4c6041c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.656908  8409 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.660290  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 3caa82d776714435898936cb4c6041c0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:38.666939  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3caa82d776714435898936cb4c6041c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.665483  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 5da6736db6d7413682f6b3e035ca2084 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:38.646641  8410 ts_tablet_manager.cc:1403] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.098s	user 0.000s	sys 0.012s
I20260709 13:15:38.671464  8409 ts_tablet_manager.cc:1434] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:15:38.675282  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 5da6736db6d7413682f6b3e035ca2084 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:38.675968  8410 raft_consensus.cc:359] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.676597  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da6736db6d7413682f6b3e035ca2084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.676612  8356 tablet_service.cc:1511] Processing CreateTablet for tablet 5da6736db6d7413682f6b3e035ca2084 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:38.677376  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da6736db6d7413682f6b3e035ca2084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.678301  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da6736db6d7413682f6b3e035ca2084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.680761  8320 heartbeater.cc:499] Master 127.6.233.62:38939 was elected leader, sending a full tablet report...
I20260709 13:15:38.676834  8410 raft_consensus.cc:385] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.683971  8410 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.684695  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 29a17bfa374c4aa6a25b919a48f0583c (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:38.684875  8410 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.685902  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a17bfa374c4aa6a25b919a48f0583c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.695645  8409 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:38.696717  8359 tablet_service.cc:1511] Processing CreateTablet for tablet 29a17bfa374c4aa6a25b919a48f0583c (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:38.700763  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a17bfa374c4aa6a25b919a48f0583c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.695533  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 29a17bfa374c4aa6a25b919a48f0583c (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:38.706631  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a17bfa374c4aa6a25b919a48f0583c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.706489  8201 tablet_service.cc:1511] Processing CreateTablet for tablet b7f77585d3144b70a0f742dcd66411d0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:38.707769  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f77585d3144b70a0f742dcd66411d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.713069  8284 tablet_service.cc:1511] Processing CreateTablet for tablet b7f77585d3144b70a0f742dcd66411d0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:38.714416  8284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f77585d3144b70a0f742dcd66411d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.716689  8355 tablet_service.cc:1511] Processing CreateTablet for tablet b7f77585d3144b70a0f742dcd66411d0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:38.719008  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 5bded28881ef4440a713698e8088bd77 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:38.720371  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bded28881ef4440a713698e8088bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.723832  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 5bded28881ef4440a713698e8088bd77 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:38.727965  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bded28881ef4440a713698e8088bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.729149  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 5bded28881ef4440a713698e8088bd77 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:38.733193  8410 ts_tablet_manager.cc:1434] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.002s
I20260709 13:15:38.704967  8409 tablet_bootstrap.cc:654] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.726696  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f77585d3144b70a0f742dcd66411d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.735652  8245 heartbeater.cc:499] Master 127.6.233.62:38939 was elected leader, sending a full tablet report...
I20260709 13:15:38.736243  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bded28881ef4440a713698e8088bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.735994  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 3c999e73d071475d9e848e7e83e79be3 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:38.737387  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c999e73d071475d9e848e7e83e79be3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:38.742193  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:38.745893  8411 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:38.746380  8411 ts_tablet_manager.cc:1403] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.031s
I20260709 13:15:38.748735  8410 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:38.757509  8411 raft_consensus.cc:359] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.758260  8411 raft_consensus.cc:385] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.758569  8411 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.759508  8411 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.767879  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 3c999e73d071475d9e848e7e83e79be3 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:38.769670  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c999e73d071475d9e848e7e83e79be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.770526  8410 tablet_bootstrap.cc:654] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.778293  8394 heartbeater.cc:499] Master 127.6.233.62:38939 was elected leader, sending a full tablet report...
I20260709 13:15:38.780969  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 3c999e73d071475d9e848e7e83e79be3 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:38.782258  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c999e73d071475d9e848e7e83e79be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.789459  8203 tablet_service.cc:1511] Processing CreateTablet for tablet f62f6597a8604eb9b9228657a7c3a7eb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:38.790782  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62f6597a8604eb9b9228657a7c3a7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.796802  8411 ts_tablet_manager.cc:1434] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.001s
I20260709 13:15:38.797314  8409 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:38.797806  8409 ts_tablet_manager.cc:1403] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.007s
I20260709 13:15:38.798077  8411 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:38.800657  8409 raft_consensus.cc:359] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.801388  8409 raft_consensus.cc:385] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.801680  8409 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.804519  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:38.805967  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.805672  8279 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:38.806936  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.807922  8278 tablet_service.cc:1511] Processing CreateTablet for tablet f62f6597a8604eb9b9228657a7c3a7eb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:38.809185  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62f6597a8604eb9b9228657a7c3a7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.813062  8359 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:38.815640  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.826960  8354 tablet_service.cc:1511] Processing CreateTablet for tablet f62f6597a8604eb9b9228657a7c3a7eb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:38.832386  8409 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.834828  8415 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.835687  8415 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.838248  8415 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:38.844497  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62f6597a8604eb9b9228657a7c3a7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.827909  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 54a6cfa6f2cf49b6b8ad9a3beb86c0be (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:38.859211  8409 ts_tablet_manager.cc:1434] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:15:38.864511  8409 tablet_bootstrap.cc:492] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:38.873121  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a6cfa6f2cf49b6b8ad9a3beb86c0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.874852  8411 tablet_bootstrap.cc:654] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.883347  8359 tablet_service.cc:1511] Processing CreateTablet for tablet 54a6cfa6f2cf49b6b8ad9a3beb86c0be (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:38.884744  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a6cfa6f2cf49b6b8ad9a3beb86c0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.881686  8416 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.886379  8416 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.890903  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3403855d4147a9b056dc8678880fdf (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:38.891206  8201 tablet_service.cc:1511] Processing CreateTablet for tablet d81288332c1b4610a2fe2b09dba77503 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:38.893126  8284 tablet_service.cc:1511] Processing CreateTablet for tablet 7dca780f49cb4f62912f333b3185e48f (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:38.893457  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 7dca780f49cb4f62912f333b3185e48f (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:38.894387  8284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dca780f49cb4f62912f333b3185e48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.895411  8279 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3403855d4147a9b056dc8678880fdf (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:38.896063  8416 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:38.896695  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3403855d4147a9b056dc8678880fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.897114  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 7dca780f49cb4f62912f333b3185e48f (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:38.898339  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dca780f49cb4f62912f333b3185e48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.892211  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3403855d4147a9b056dc8678880fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.903215  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81288332c1b4610a2fe2b09dba77503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.903892  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dca780f49cb4f62912f333b3185e48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.904795  8409 tablet_bootstrap.cc:654] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.909880  8410 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:38.910465  8410 ts_tablet_manager.cc:1403] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.027s
I20260709 13:15:38.920881  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 8d3403855d4147a9b056dc8678880fdf (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:38.924877  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3403855d4147a9b056dc8678880fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.925040  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 54a6cfa6f2cf49b6b8ad9a3beb86c0be (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:38.933892  8285 tablet_service.cc:1511] Processing CreateTablet for tablet d81288332c1b4610a2fe2b09dba77503 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:38.935289  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81288332c1b4610a2fe2b09dba77503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.945490  8410 raft_consensus.cc:359] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.952469  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a6cfa6f2cf49b6b8ad9a3beb86c0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.956636  8410 raft_consensus.cc:385] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.957373  8410 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.964654  8410 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:38.963634  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:38.966311  8220 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:38.958782  8359 tablet_service.cc:1511] Processing CreateTablet for tablet d81288332c1b4610a2fe2b09dba77503 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:38.966876  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:38.967947  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81288332c1b4610a2fe2b09dba77503. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:38.968533  8261 leader_election.cc:343] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.973268  8410 ts_tablet_manager.cc:1434] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:15:38.975555  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 1a722bdfa4d04d60b64682ee5868136f (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:38.976631  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:38.978508  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 1a722bdfa4d04d60b64682ee5868136f (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:38.983537  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 57b9174dc54540e597799ccc6b10b419 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:38.984344  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a722bdfa4d04d60b64682ee5868136f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.985119  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b9174dc54540e597799ccc6b10b419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.988219  8415 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.988606  8415 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.988948  8415 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.979171  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 1a722bdfa4d04d60b64682ee5868136f (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:38.992863  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a722bdfa4d04d60b64682ee5868136f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.993896  8410 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:39.000145  8409 tablet_bootstrap.cc:492] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:39.000681  8409 ts_tablet_manager.cc:1403] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.136s	user 0.041s	sys 0.010s
I20260709 13:15:39.003916  8409 raft_consensus.cc:359] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.004748  8409 raft_consensus.cc:385] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.005062  8409 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.005823  8409 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.009271  8415 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.012383  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:39.012989  8220 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.015249  8409 ts_tablet_manager.cc:1434] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.006s
I20260709 13:15:39.017316  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a722bdfa4d04d60b64682ee5868136f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.020845  8220 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:39.022147  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:39.023193  8428 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.029037  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:39.029541  8411 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:39.030079  8411 ts_tablet_manager.cc:1403] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.005s
W20260709 13:15:39.030704  8186 leader_election.cc:343] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.032383  8410 tablet_bootstrap.cc:654] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.033759  8411 raft_consensus.cc:359] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.034678  8411 raft_consensus.cc:385] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.035018  8411 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.035833  8411 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.038089  8409 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:39.038138  8411 ts_tablet_manager.cc:1434] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:39.039310  8411 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:39.045145  8428 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:39.047701  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:39.047822  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 57b9174dc54540e597799ccc6b10b419 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:39.049506  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b9174dc54540e597799ccc6b10b419. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:39.049558  8261 leader_election.cc:343] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.049115  8428 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.051072  8415 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:39.062939  8409 tablet_bootstrap.cc:654] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.063093  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 57b9174dc54540e597799ccc6b10b419 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:39.064424  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b9174dc54540e597799ccc6b10b419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.064380  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 48e600fe8a934349bb2d4d18d10815a6 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:39.065879  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e600fe8a934349bb2d4d18d10815a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.068910  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:39.070719  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:39.072201  8416 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.078599  8411 tablet_bootstrap.cc:654] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.079332  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 48e600fe8a934349bb2d4d18d10815a6 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:39.082710  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e600fe8a934349bb2d4d18d10815a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.091691  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 62e8a922b99844e085b2b1e126cfb02e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:39.093150  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e8a922b99844e085b2b1e126cfb02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.093775  8410 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:39.093321  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 62e8a922b99844e085b2b1e126cfb02e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:39.094270  8410 ts_tablet_manager.cc:1403] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.007s
I20260709 13:15:39.096931  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e8a922b99844e085b2b1e126cfb02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.096989  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 48e600fe8a934349bb2d4d18d10815a6 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:39.097600  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 62e8a922b99844e085b2b1e126cfb02e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:39.098280  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e600fe8a934349bb2d4d18d10815a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.098934  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e8a922b99844e085b2b1e126cfb02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.106875  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9e53d1d8204518834e32e1ef952157 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:39.109668  8428 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.110148  8428 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.110213  8410 raft_consensus.cc:359] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.111042  8410 raft_consensus.cc:385] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.111372  8410 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.110646  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9e53d1d8204518834e32e1ef952157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.110927  8115 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:39.112128  8410 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.112939  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:39.113758  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:39.115260  8261 leader_election.cc:343] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:39.117786  8258 leader_election.cc:343] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.118216  8258 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:39.115778  8428 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:39.121037  8429 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.122637  8409 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:39.128491  8409 ts_tablet_manager.cc:1403] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.010s
I20260709 13:15:39.130327  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9e53d1d8204518834e32e1ef952157 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:39.127099  8415 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.133836  8415 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.134316  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9e53d1d8204518834e32e1ef952157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.137550  8415 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:39.137487  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 3becc403d217418988bb94be41c015e9 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:39.138844  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3becc403d217418988bb94be41c015e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.139475  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:39.130419  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 749a008ddc4d4f31a1bcd1a446b5916d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:39.131419  8409 raft_consensus.cc:359] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.123385  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 749a008ddc4d4f31a1bcd1a446b5916d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:39.141795  8410 ts_tablet_manager.cc:1434] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:15:39.144912  8418 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.145385  8418 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.148692  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749a008ddc4d4f31a1bcd1a446b5916d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:39.152256  8261 leader_election.cc:343] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.135368  8359 tablet_service.cc:1511] Processing CreateTablet for tablet 749a008ddc4d4f31a1bcd1a446b5916d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:39.153709  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:39.154778  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749a008ddc4d4f31a1bcd1a446b5916d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:39.155704  8258 leader_election.cc:343] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.156335  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:39.142627  8409 raft_consensus.cc:385] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.156615  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749a008ddc4d4f31a1bcd1a446b5916d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.156610  8410 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:39.157861  8415 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.147977  8418 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.169780  8409 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.170737  8409 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.172909  8409 ts_tablet_manager.cc:1434] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.005s
I20260709 13:15:39.173840  8409 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:39.185256  8410 tablet_bootstrap.cc:654] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.189348  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 0e9e53d1d8204518834e32e1ef952157 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:39.190987  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9e53d1d8204518834e32e1ef952157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.194268  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 3becc403d217418988bb94be41c015e9 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:39.195554  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3becc403d217418988bb94be41c015e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.195401  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 3becc403d217418988bb94be41c015e9 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:39.196662  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3becc403d217418988bb94be41c015e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.201628  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 64f8ae67f51c4ec482dada7787dc153e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:39.202934  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f8ae67f51c4ec482dada7787dc153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.221104  8411 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:39.221882  8411 ts_tablet_manager.cc:1403] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.183s	user 0.010s	sys 0.014s
I20260709 13:15:39.225806  8411 raft_consensus.cc:359] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.228482  8411 raft_consensus.cc:385] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.229415  8411 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.230813  8418 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.231297  8418 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.231729  8411 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.233362  8418 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.296492  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 64f8ae67f51c4ec482dada7787dc153e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:39.298018  8411 ts_tablet_manager.cc:1434] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.027s
I20260709 13:15:39.298034  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f8ae67f51c4ec482dada7787dc153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.299520  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 64f8ae67f51c4ec482dada7787dc153e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:39.302428  8410 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:39.302911  8410 ts_tablet_manager.cc:1403] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.007s
I20260709 13:15:39.315477  8410 raft_consensus.cc:359] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.316332  8410 raft_consensus.cc:385] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.316629  8410 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.316895  8203 tablet_service.cc:1511] Processing CreateTablet for tablet c802b19bdf2e4f69b169d31056091820 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:39.317435  8410 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.318367  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c802b19bdf2e4f69b169d31056091820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.300786  8409 tablet_bootstrap.cc:654] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.322252  8410 ts_tablet_manager.cc:1434] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:15:39.323243  8410 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:39.325049  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f8ae67f51c4ec482dada7787dc153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.331203  8410 tablet_bootstrap.cc:654] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.341933  8411 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:39.344092  8285 tablet_service.cc:1511] Processing CreateTablet for tablet c802b19bdf2e4f69b169d31056091820 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:39.345481  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c802b19bdf2e4f69b169d31056091820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.345585  8207 tablet_service.cc:1511] Processing CreateTablet for tablet a15d60ee93c04debb4b2f6a595555fbb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:39.346910  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a15d60ee93c04debb4b2f6a595555fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.348815  8354 tablet_service.cc:1511] Processing CreateTablet for tablet c802b19bdf2e4f69b169d31056091820 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:39.350435  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c802b19bdf2e4f69b169d31056091820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.360734  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:15:39.362221  8332 leader_election.cc:343] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.351778  8409 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:39.354035  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:39.355520  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:39.363530  8219 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:39.359388  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:39.364892  8295 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:39.365012  8282 tablet_service.cc:1511] Processing CreateTablet for tablet a15d60ee93c04debb4b2f6a595555fbb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:39.366248  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a15d60ee93c04debb4b2f6a595555fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.366058  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:39.366573  8359 tablet_service.cc:1511] Processing CreateTablet for tablet a15d60ee93c04debb4b2f6a595555fbb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:39.367038  8418 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.367445  8418 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.367812  8418 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.368069  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a15d60ee93c04debb4b2f6a595555fbb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:39.372960  8332 leader_election.cc:343] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.374245  8409 ts_tablet_manager.cc:1403] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.201s	user 0.017s	sys 0.001s
I20260709 13:15:39.378942  8410 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:39.379405  8410 ts_tablet_manager.cc:1403] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.007s
I20260709 13:15:39.378974  8418 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.381500  8418 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.382237  8410 raft_consensus.cc:359] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.388878  8410 raft_consensus.cc:385] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.389115  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:15:39.389374  8410 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.390223  8410 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.379539  8409 raft_consensus.cc:359] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.391258  8409 raft_consensus.cc:385] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.391597  8409 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.392369  8409 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.396764  8418 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.397630  8206 tablet_service.cc:1511] Processing CreateTablet for tablet ef2eafec27ce4eb48cfb13c576f7cefb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:39.402626  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2eafec27ce4eb48cfb13c576f7cefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.402209  8418 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.405197  8418 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.408205  8282 tablet_service.cc:1511] Processing CreateTablet for tablet ef2eafec27ce4eb48cfb13c576f7cefb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:39.409128  8418 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.409511  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 282a740dc06c41f0b77f4880423e4395 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:39.399039  8409 ts_tablet_manager.cc:1434] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 13:15:39.411827  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 282a740dc06c41f0b77f4880423e4395 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:39.413039  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282a740dc06c41f0b77f4880423e4395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.415624  8409 tablet_bootstrap.cc:492] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:39.409457  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2eafec27ce4eb48cfb13c576f7cefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.401624  8411 tablet_bootstrap.cc:654] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.410188  8418 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.418799  8418 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.419544  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282a740dc06c41f0b77f4880423e4395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.423938  8359 tablet_service.cc:1511] Processing CreateTablet for tablet ef2eafec27ce4eb48cfb13c576f7cefb (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:39.435341  8410 ts_tablet_manager.cc:1434] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.005s
I20260709 13:15:39.436554  8410 tablet_bootstrap.cc:492] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:39.436973  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 282a740dc06c41f0b77f4880423e4395 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:39.441905  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 1924d44c50904ed09f8f93dd9b4928ca (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:39.442673  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 1924d44c50904ed09f8f93dd9b4928ca (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:39.443266  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1924d44c50904ed09f8f93dd9b4928ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.443866  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1924d44c50904ed09f8f93dd9b4928ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:39.444320  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 56019us
I20260709 13:15:39.446050  8416 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.446563  8416 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.446961  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:39.447400  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef2eafec27ce4eb48cfb13c576f7cefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.447547  8219 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.459717  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 1924d44c50904ed09f8f93dd9b4928ca (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:39.461011  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1924d44c50904ed09f8f93dd9b4928ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.448618  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:39.448971  8416 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:39.450428  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:15:39.464375  8183 leader_election.cc:343] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.452122  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:39.465255  8369 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:39.454252  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:39.466451  8294 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.455160  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:39.467448  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282a740dc06c41f0b77f4880423e4395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.468922  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:15:39.456487  8409 tablet_bootstrap.cc:654] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.462951  8220 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
W20260709 13:15:39.472330  8332 leader_election.cc:343] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.473201  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 1f62e72429d24920b32bee17b0d2aadd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:39.473875  8418 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.489030  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f62e72429d24920b32bee17b0d2aadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.488986  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:15:39.476724  8294 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:39.492213  8443 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.492626  8443 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.492936  8443 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.492877  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:39.493587  8416 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.493458  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:39.494161  8294 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.494292  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:39.494927  8220 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.495949  8416 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.496363  8416 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.477787  8410 tablet_bootstrap.cc:654] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.501523  8294 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:39.489886  8418 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.502965  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:39.503945  8442 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.478915  8219 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:39.503067  8418 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.491119  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 1f62e72429d24920b32bee17b0d2aadd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:39.509049  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f62e72429d24920b32bee17b0d2aadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.503729  8443 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.514808  8442 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:39.516762  8442 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.518239  8411 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:39.518786  8411 ts_tablet_manager.cc:1403] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.007s
I20260709 13:15:39.522228  8207 tablet_service.cc:1511] Processing CreateTablet for tablet fea6012070404ef6b810517d977625da (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:39.522459  8411 raft_consensus.cc:359] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.531008  8282 tablet_service.cc:1511] Processing CreateTablet for tablet fea6012070404ef6b810517d977625da (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:39.532685  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea6012070404ef6b810517d977625da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.533828  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 5da27e18b189452598381f95fe6f22cf (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:39.538224  8359 tablet_service.cc:1511] Processing CreateTablet for tablet 1f62e72429d24920b32bee17b0d2aadd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:39.538973  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f62e72429d24920b32bee17b0d2aadd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.524266  8411 raft_consensus.cc:385] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.546532  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 5da27e18b189452598381f95fe6f22cf (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:39.547528  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da27e18b189452598381f95fe6f22cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.537174  8418 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:39.549589  8354 tablet_service.cc:1511] Processing CreateTablet for tablet fea6012070404ef6b810517d977625da (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:39.550642  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea6012070404ef6b810517d977625da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.545917  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da27e18b189452598381f95fe6f22cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.552321  8416 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.552896  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 5da27e18b189452598381f95fe6f22cf (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:39.554039  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da27e18b189452598381f95fe6f22cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.555019  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:39.541467  8411 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
W20260709 13:15:39.556403  8183 leader_election.cc:343] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.556856  8411 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:39.557895  8261 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:39.559680  8411 ts_tablet_manager.cc:1434] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:15:39.557400  8220 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:39.564282  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 4c96431d125f4d169be8f25647f9371e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:39.565205  8411 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:39.564388  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 4c96431d125f4d169be8f25647f9371e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:39.574396  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:39.575997  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c96431d125f4d169be8f25647f9371e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.576148  8219 raft_consensus.cc:2393] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:39.567561  8418 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.578153  8209 tablet_service.cc:1511] Processing CreateTablet for tablet 47a3ff85da594e17a687e7c116983565 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:39.578619  8443 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.579072  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:39.567008  8410 tablet_bootstrap.cc:492] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:39.579852  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 4c96431d125f4d169be8f25647f9371e (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:39.572785  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea6012070404ef6b810517d977625da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.585538  8410 ts_tablet_manager.cc:1403] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.015s
I20260709 13:15:39.588455  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a3ff85da594e17a687e7c116983565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.588482  8410 raft_consensus.cc:359] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.589468  8410 raft_consensus.cc:385] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.589828  8410 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.592800  8410 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:39.584906  8332 leader_election.cc:343] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.596298  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:39.596858  8416 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:39.581823  8411 tablet_bootstrap.cc:654] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.595551  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:39.597653  8443 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.598045  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c96431d125f4d169be8f25647f9371e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.598696  8369 raft_consensus.cc:2393] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:15:39.600010  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:39.606680  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 47a3ff85da594e17a687e7c116983565 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:39.608605  8356 tablet_service.cc:1511] Processing CreateTablet for tablet 47a3ff85da594e17a687e7c116983565 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:39.609978  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c96431d125f4d169be8f25647f9371e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.610656  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a3ff85da594e17a687e7c116983565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.610224  8116 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.612689  8279 tablet_service.cc:1511] Processing CreateTablet for tablet c4b32c39d3034dc0b1e48b0daa2308c0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:39.613807  8353 tablet_service.cc:1511] Processing CreateTablet for tablet c4b32c39d3034dc0b1e48b0daa2308c0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:39.615008  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b32c39d3034dc0b1e48b0daa2308c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.614426  8416 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.607981  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a3ff85da594e17a687e7c116983565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.620574  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b32c39d3034dc0b1e48b0daa2308c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.620848  8409 tablet_bootstrap.cc:492] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:39.621331  8409 ts_tablet_manager.cc:1403] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.206s	user 0.008s	sys 0.010s
I20260709 13:15:39.611958  8116 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.628125  8409 raft_consensus.cc:359] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.628882  8409 raft_consensus.cc:385] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.636432  8409 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.629954  8410 ts_tablet_manager.cc:1434] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:15:39.639668  8410 tablet_bootstrap.cc:492] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:39.644310  8206 tablet_service.cc:1511] Processing CreateTablet for tablet c4b32c39d3034dc0b1e48b0daa2308c0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:39.644556  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 55586274911e4f2eb326f0741d200c17 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:39.637234  8409 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.649657  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b32c39d3034dc0b1e48b0daa2308c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.655431  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55586274911e4f2eb326f0741d200c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.669279  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 55586274911e4f2eb326f0741d200c17 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:39.672457  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55586274911e4f2eb326f0741d200c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.673942  8409 ts_tablet_manager.cc:1434] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.002s
I20260709 13:15:39.674955  8409 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:39.681241  8410 tablet_bootstrap.cc:654] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.684363  8451 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.684835  8451 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.686815  8415 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.688220  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:15:39.689706  8183 leader_election.cc:343] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.692373  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:39.693055  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 55586274911e4f2eb326f0741d200c17 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:15:39.693607  8186 leader_election.cc:343] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.694298  8186 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:39.695057  8416 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.695318  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55586274911e4f2eb326f0741d200c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.696092  8451 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:39.696740  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 019e9c29effc40928d5f5e795b8aeed0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:39.697816  8411 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:39.701026  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 019e9c29effc40928d5f5e795b8aeed0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:39.702443  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019e9c29effc40928d5f5e795b8aeed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.704149  8411 ts_tablet_manager.cc:1403] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.139s	user 0.010s	sys 0.012s
I20260709 13:15:39.707103  8411 raft_consensus.cc:359] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.718015  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 019e9c29effc40928d5f5e795b8aeed0 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:39.719269  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019e9c29effc40928d5f5e795b8aeed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.719378  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019e9c29effc40928d5f5e795b8aeed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.707875  8411 raft_consensus.cc:385] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.721333  8411 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.721743  8203 tablet_service.cc:1511] Processing CreateTablet for tablet eadd35a48bd34475b97994ba7c427ae5 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:39.723058  8411 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.723752  8284 tablet_service.cc:1511] Processing CreateTablet for tablet eadd35a48bd34475b97994ba7c427ae5 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:39.724977  8284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadd35a48bd34475b97994ba7c427ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.726716  8359 tablet_service.cc:1511] Processing CreateTablet for tablet eadd35a48bd34475b97994ba7c427ae5 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:39.727806  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadd35a48bd34475b97994ba7c427ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.732656  8281 tablet_service.cc:1511] Processing CreateTablet for tablet 73873ecf3459400d839d6e8c0d8743b4 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:39.733819  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73873ecf3459400d839d6e8c0d8743b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.734849  8411 ts_tablet_manager.cc:1434] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:15:39.736147  8356 tablet_service.cc:1511] Processing CreateTablet for tablet 73873ecf3459400d839d6e8c0d8743b4 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:39.737319  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73873ecf3459400d839d6e8c0d8743b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.741398  8410 tablet_bootstrap.cc:492] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:39.741868  8410 ts_tablet_manager.cc:1403] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.102s	user 0.004s	sys 0.008s
I20260709 13:15:39.744397  8418 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.744863  8418 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.746201  8206 tablet_service.cc:1511] Processing CreateTablet for tablet 73873ecf3459400d839d6e8c0d8743b4 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:39.746577  8202 tablet_service.cc:1511] Processing CreateTablet for tablet afeb2f98236845469440c44ada463b5c (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:39.748265  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadd35a48bd34475b97994ba7c427ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.750506  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afeb2f98236845469440c44ada463b5c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:39.755367  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:39.756698  8285 tablet_service.cc:1511] Processing CreateTablet for tablet afeb2f98236845469440c44ada463b5c (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:39.757875  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afeb2f98236845469440c44ada463b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.761060  8354 tablet_service.cc:1511] Processing CreateTablet for tablet afeb2f98236845469440c44ada463b5c (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:39.762274  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afeb2f98236845469440c44ada463b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.765550  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:39.766372  8409 tablet_bootstrap.cc:654] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:39.766979  8332 leader_election.cc:343] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.774899  8418 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.775482  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:39.776114  8294 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:39.776379  8206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73873ecf3459400d839d6e8c0d8743b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.777413  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:39.778566  8418 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.779000  8418 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.779377  8418 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.784546  8411 tablet_bootstrap.cc:492] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:39.797005  8209 tablet_service.cc:1511] Processing CreateTablet for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:39.798444  8209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.810400  8201 tablet_service.cc:1511] Processing CreateTablet for tablet 1d693bc5288d40ae98bb93862716c589 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:39.811946  8201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d693bc5288d40ae98bb93862716c589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.810309  8410 raft_consensus.cc:359] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.820627  8353 tablet_service.cc:1511] Processing CreateTablet for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:39.822034  8353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.825826  8281 tablet_service.cc:1511] Processing CreateTablet for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:39.826534  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 1d693bc5288d40ae98bb93862716c589 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:39.827207  8281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.828056  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d693bc5288d40ae98bb93862716c589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.832285  8359 tablet_service.cc:1511] Processing CreateTablet for tablet 1d693bc5288d40ae98bb93862716c589 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:39.800078  8418 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.833774  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d693bc5288d40ae98bb93862716c589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.835557  8207 tablet_service.cc:1511] Processing CreateTablet for tablet e36ea2a6e04a442397de5d29398d0314 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:39.836611  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36ea2a6e04a442397de5d29398d0314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.838927  8411 tablet_bootstrap.cc:654] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.840088  8282 tablet_service.cc:1511] Processing CreateTablet for tablet e36ea2a6e04a442397de5d29398d0314 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:39.841180  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36ea2a6e04a442397de5d29398d0314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.818934  8410 raft_consensus.cc:385] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.848449  8418 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.848767  8202 tablet_service.cc:1511] Processing CreateTablet for tablet 53535408ea514f8db7292852927e7743 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:39.851824  8202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53535408ea514f8db7292852927e7743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.849041  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:39.858889  8354 tablet_service.cc:1511] Processing CreateTablet for tablet e36ea2a6e04a442397de5d29398d0314 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:39.860158  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36ea2a6e04a442397de5d29398d0314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.850867  8410 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.867856  8359 tablet_service.cc:1511] Processing CreateTablet for tablet 53535408ea514f8db7292852927e7743 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:39.870059  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53535408ea514f8db7292852927e7743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.869519  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:15:39.869443  8332 leader_election.cc:343] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.885422  8285 tablet_service.cc:1511] Processing CreateTablet for tablet 53535408ea514f8db7292852927e7743 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:39.886627  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53535408ea514f8db7292852927e7743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.890887  8207 tablet_service.cc:1511] Processing CreateTablet for tablet 83404a77373349799a8b3ee06b2a7ccd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:39.892177  8410 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.894692  8410 ts_tablet_manager.cc:1434] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.153s	user 0.000s	sys 0.008s
I20260709 13:15:39.895607  8354 tablet_service.cc:1511] Processing CreateTablet for tablet 83404a77373349799a8b3ee06b2a7ccd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:39.896819  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83404a77373349799a8b3ee06b2a7ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.899309  8356 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac72d56568b4857a1bd70aadbb026c1 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:39.899576  8357 tablet_service.cc:1511] Processing CreateTablet for tablet 4c835fd22b7643a981b446089ad74066 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:39.883293  8294 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.900689  8356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac72d56568b4857a1bd70aadbb026c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.905857  8203 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac72d56568b4857a1bd70aadbb026c1 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:39.907452  8207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83404a77373349799a8b3ee06b2a7ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.908769  8205 tablet_service.cc:1511] Processing CreateTablet for tablet 4c835fd22b7643a981b446089ad74066 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:39.910581  8208 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9006ab90a84d6fae17b6b86c0530b8 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:39.912417  8210 tablet_service.cc:1511] Processing CreateTablet for tablet eacbb7965099474082590e4b50221087 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:39.913992  8278 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac72d56568b4857a1bd70aadbb026c1 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:39.914412  8284 tablet_service.cc:1511] Processing CreateTablet for tablet 4c835fd22b7643a981b446089ad74066 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:39.915179  8278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac72d56568b4857a1bd70aadbb026c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.916296  8282 tablet_service.cc:1511] Processing CreateTablet for tablet 83404a77373349799a8b3ee06b2a7ccd (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:39.917531  8282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83404a77373349799a8b3ee06b2a7ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.918138  8284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c835fd22b7643a981b446089ad74066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.919935  8409 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:39.920415  8357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c835fd22b7643a981b446089ad74066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.921005  8283 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9006ab90a84d6fae17b6b86c0530b8 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:39.922151  8283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9006ab90a84d6fae17b6b86c0530b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.926076  8418 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.926513  8418 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.927014  8294 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:39.928460  8418 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:39.929952  8355 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9006ab90a84d6fae17b6b86c0530b8 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:39.930366  8279 tablet_service.cc:1511] Processing CreateTablet for tablet eacbb7965099474082590e4b50221087 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:39.931041  8355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9006ab90a84d6fae17b6b86c0530b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.931665  8279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacbb7965099474082590e4b50221087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.930414  8350 tablet_service.cc:1511] Processing CreateTablet for tablet eacbb7965099474082590e4b50221087 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:39.920436  8409 ts_tablet_manager.cc:1403] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.246s	user 0.019s	sys 0.013s
I20260709 13:15:39.941347  8350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacbb7965099474082590e4b50221087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.940140  8410 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:39.945139  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:39.945464  8453 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.945900  8453 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.964998  8204 tablet_service.cc:1511] Processing CreateTablet for tablet bd269c56db8748ddba9b5528d4c49916 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:39.966358  8204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd269c56db8748ddba9b5528d4c49916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.980656  8205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c835fd22b7643a981b446089ad74066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.981261  8203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac72d56568b4857a1bd70aadbb026c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.983253  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacbb7965099474082590e4b50221087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.984342  8208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9006ab90a84d6fae17b6b86c0530b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.987789  8410 tablet_bootstrap.cc:654] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.993254  8354 tablet_service.cc:1511] Processing CreateTablet for tablet bd269c56db8748ddba9b5528d4c49916 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:39.994398  8354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd269c56db8748ddba9b5528d4c49916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.997299  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:39.998083  8443 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.998539  8443 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:39.999311  8443 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:39.934911  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:15:40.009112  8332 leader_election.cc:343] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.010424  8409 raft_consensus.cc:359] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.011132  8409 raft_consensus.cc:385] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:40.028461  8332 leader_election.cc:343] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.028349  8409 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.035548  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.037097  8409 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.037424  8285 tablet_service.cc:1511] Processing CreateTablet for tablet bd269c56db8748ddba9b5528d4c49916 (DEFAULT_TABLE table=test-workload [id=4a48956e092241caaba46fad01c0b37e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:40.039431  8409 ts_tablet_manager.cc:1434] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.099s	user 0.011s	sys 0.002s
I20260709 13:15:40.041071  8411 tablet_bootstrap.cc:492] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.041554  8411 ts_tablet_manager.cc:1403] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.257s	user 0.008s	sys 0.012s
I20260709 13:15:40.041718  8409 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.044292  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.045501  8285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd269c56db8748ddba9b5528d4c49916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.045768  8418 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.045877  8219 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.046464  8418 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.050225  8116 catalog_manager.cc:5697] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.054075  8258 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.055276  8415 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.055716  8415 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.056130  8415 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.062299  8443 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.070593  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.066538  8453 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:15:40.072466  8261 leader_election.cc:343] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.075531  8410 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.079496  8411 raft_consensus.cc:359] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.080299  8411 raft_consensus.cc:385] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.080166  8410 ts_tablet_manager.cc:1403] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.140s	user 0.022s	sys 0.012s
I20260709 13:15:40.080627  8411 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.086362  8411 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.092551  8411 ts_tablet_manager.cc:1434] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 13:15:40.093705  8415 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.093997  8409 tablet_bootstrap.cc:654] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.096325  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.096877  8219 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.106123  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.107105  8411 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
W20260709 13:15:40.107453  8261 leader_election.cc:343] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.103809  8219 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.100972  8415 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.112751  8258 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:40.114903  8453 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.116674  8415 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.117169  8415 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.119901  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:15:40.123577  8258 leader_election.cc:343] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.117568  8411 tablet_bootstrap.cc:654] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.111014  8410 raft_consensus.cc:359] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.128435  8415 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.128307  8409 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.129539  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.130028  8409 ts_tablet_manager.cc:1403] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.026s
I20260709 13:15:40.130142  8369 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.131332  8261 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.124616  8453 raft_consensus.cc:697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:40.132537  8453 consensus_queue.cc:237] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.133904  8443 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.136541  8409 raft_consensus.cc:359] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.137233  8409 raft_consensus.cc:385] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.137573  8409 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.138226  8409 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.141469  8409 ts_tablet_manager.cc:1434] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:40.143970  8409 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.124676  8410 raft_consensus.cc:385] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.146628  8410 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.141084  8465 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.147544  8465 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.147734  8410 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.148110  8465 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.161857  8410 ts_tablet_manager.cc:1434] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 13:15:40.163175  8410 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.168078  8470 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.168999  8418 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.169502  8418 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.171945  8418 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:40.174592  8465 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.155966  8409 tablet_bootstrap.cc:654] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.178460  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:15:40.180019  8258 leader_election.cc:343] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.181146  8465 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.182590  8411 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.183104  8411 ts_tablet_manager.cc:1403] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.076s	user 0.020s	sys 0.035s
I20260709 13:15:40.185669  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.186430  8369 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.186332  8411 raft_consensus.cc:359] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.187206  8411 raft_consensus.cc:385] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.187553  8411 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.188508  8410 tablet_bootstrap.cc:654] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.188462  8411 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.191149  8411 ts_tablet_manager.cc:1434] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:40.192442  8411 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.196152  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:40.196862  8294 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:40.196883  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.197926  8219 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:40.198510  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:40.199259  8470 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.199589  8470 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.199914  8470 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.201429  8411 tablet_bootstrap.cc:654] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.203415  8115 catalog_manager.cc:5697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.214633  8409 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.215273  8409 ts_tablet_manager.cc:1403] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.008s
I20260709 13:15:40.216734  8369 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.218158  8261 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.219622  8465 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.220268  8465 raft_consensus.cc:697] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:40.221314  8465 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.222847  8409 raft_consensus.cc:359] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.223484  8409 raft_consensus.cc:385] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.223737  8409 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.226732  8409 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.211872  8470 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.230072  8409 ts_tablet_manager.cc:1434] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:15:40.230070  8410 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.231096  8409 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.231110  8410 ts_tablet_manager.cc:1403] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.019s
I20260709 13:15:40.235833  8410 raft_consensus.cc:359] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.236703  8410 raft_consensus.cc:385] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.237010  8410 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.237509  8411 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.237686  8409 tablet_bootstrap.cc:654] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.237919  8411 ts_tablet_manager.cc:1403] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 13:15:40.238324  8410 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.241560  8470 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:40.240571  8411 raft_consensus.cc:359] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.242362  8411 raft_consensus.cc:385] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.242615  8411 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.243218  8410 ts_tablet_manager.cc:1434] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:40.243358  8411 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.243865  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:40.244441  8294 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.244496  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.245317  8220 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.248459  8411 ts_tablet_manager.cc:1434] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:40.249356  8411 tablet_bootstrap.cc:492] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.251171  8294 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:40.252446  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:40.253213  8470 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.253671  8470 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:40.253867  8410 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.254462  8470 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.260057  8410 tablet_bootstrap.cc:654] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.260967  8411 tablet_bootstrap.cc:654] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.271631  8410 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.272313  8410 ts_tablet_manager.cc:1403] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:15:40.274205  8411 tablet_bootstrap.cc:492] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.274634  8411 ts_tablet_manager.cc:1403] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:15:40.274822  8410 raft_consensus.cc:359] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.275498  8410 raft_consensus.cc:385] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.275183  8220 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:40.275789  8410 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.275718  8117 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.276841  8410 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.277158  8411 raft_consensus.cc:359] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.277766  8411 raft_consensus.cc:385] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.278041  8411 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.282444  8410 ts_tablet_manager.cc:1434] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:40.283308  8410 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.285646  8116 catalog_manager.cc:5697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.288657  8410 tablet_bootstrap.cc:654] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.290323  8409 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.290793  8409 ts_tablet_manager.cc:1403] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.060s	user 0.027s	sys 0.016s
I20260709 13:15:40.290431  8411 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.293202  8411 ts_tablet_manager.cc:1434] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:15:40.293378  8409 raft_consensus.cc:359] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.294045  8409 raft_consensus.cc:385] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.294199  8411 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.294302  8409 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.295011  8409 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.297075  8409 ts_tablet_manager.cc:1434] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:15:40.297881  8409 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.300007  8411 tablet_bootstrap.cc:654] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.303409  8409 tablet_bootstrap.cc:654] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.304750  8410 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.305188  8410 ts_tablet_manager.cc:1403] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.006s
I20260709 13:15:40.307786  8410 raft_consensus.cc:359] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.308458  8410 raft_consensus.cc:385] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.308704  8410 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.309484  8410 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.311991  8410 ts_tablet_manager.cc:1434] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:40.313294  8410 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.317133  8409 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.317641  8409 ts_tablet_manager.cc:1403] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:15:40.320186  8410 tablet_bootstrap.cc:654] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.320261  8409 raft_consensus.cc:359] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.321183  8409 raft_consensus.cc:385] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.321506  8409 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.322295  8409 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.324340  8409 ts_tablet_manager.cc:1434] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:40.325259  8409 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.327304  8465 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.327808  8465 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.329963  8465 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.331453  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.331923  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.332219  8220 raft_consensus.cc:2393] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:40.332412  8409 tablet_bootstrap.cc:654] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.332638  8369 raft_consensus.cc:2393] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:15:40.333755  8261 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.334837  8465 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.335647  8410 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.335702  8451 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.336257  8410 ts_tablet_manager.cc:1403] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:15:40.336400  8451 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.339040  8451 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.339550  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:40.339972  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.340034  8410 raft_consensus.cc:359] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.340865  8369 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:40.340914  8410 raft_consensus.cc:385] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.341586  8410 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.342299  8410 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.342418  8186 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:40.344245  8451 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.344581  8410 ts_tablet_manager.cc:1434] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:40.345598  8410 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.352489  8465 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.353015  8410 tablet_bootstrap.cc:654] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.358418  8451 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.362457  8411 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.363090  8411 ts_tablet_manager.cc:1403] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.024s
I20260709 13:15:40.366828  8411 raft_consensus.cc:359] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.367585  8411 raft_consensus.cc:385] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.367923  8411 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.368130  8465 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.368774  8465 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.368855  8411 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.371091  8411 ts_tablet_manager.cc:1434] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:15:40.372773  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.373584  8220 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.375322  8258 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.376443  8453 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.376899  8453 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.377305  8453 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.378144  8411 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.385044  8486 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.387216  8409 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.387743  8409 ts_tablet_manager.cc:1403] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.063s	user 0.027s	sys 0.026s
I20260709 13:15:40.387290  8486 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.390378  8409 raft_consensus.cc:359] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.391026  8409 raft_consensus.cc:385] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.391295  8409 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.392840  8411 tablet_bootstrap.cc:654] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.393759  8409 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.395617  8220 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.397351  8486 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.398204  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:40.398602  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:40.399744  8183 leader_election.cc:343] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.400352  8465 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:15:40.400403  8186 leader_election.cc:343] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.400602  8470 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.400919  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:40.401250  8470 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.401932  8486 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.405397  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.405539  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.405980  8219 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:40.406327  8369 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.403774  8470 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:40.408612  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:40.410585  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.411428  8470 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.411724  8409 ts_tablet_manager.cc:1434] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:15:40.411777  8470 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.412211  8470 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.412712  8409 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.412420  8453 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.413941  8294 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:40.419046  8471 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.420749  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.421298  8219 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.421552  8465 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.422144  8465 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.423624  8409 tablet_bootstrap.cc:654] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.425460  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.433352  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.434998  8218 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.433393  8465 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.426725  8453 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.437650  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.443735  8471 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.445897  8411 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.446457  8411 ts_tablet_manager.cc:1403] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.035s
I20260709 13:15:40.449914  8411 raft_consensus.cc:359] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.450560  8411 raft_consensus.cc:385] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.450817  8411 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.451362  8219 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.451462  8411 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.453718  8411 ts_tablet_manager.cc:1434] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:15:40.455052  8411 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.442195  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.456612  8453 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.456847  8258 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.457024  8453 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.457628  8465 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:40.458109  8261 leader_election.cc:343] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.455574  8470 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.458410  8465 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:40.460469  8410 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.460963  8410 ts_tablet_manager.cc:1403] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.116s	user 0.022s	sys 0.015s
I20260709 13:15:40.462000  8369 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:15:40.463661  8465 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.463783  8410 raft_consensus.cc:359] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.465292  8410 raft_consensus.cc:385] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.465545  8410 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.466039  8410 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.458786  8453 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.468132  8411 tablet_bootstrap.cc:654] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.469635  8410 ts_tablet_manager.cc:1434] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:40.471078  8410 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.473498  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:40.475227  8470 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:40.480355  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.480492  8453 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.481122  8219 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:40.482298  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.486940  8409 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.487514  8409 ts_tablet_manager.cc:1403] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.075s	user 0.007s	sys 0.012s
I20260709 13:15:40.488276  8470 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.488842  8443 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.489315  8443 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.491482  8443 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:15:40.492924  8453 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.493532  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.494051  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.494115  8220 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.495793  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:40.496142  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.497531  8369 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.497850  8332 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.498759  8443 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.501382  8409 raft_consensus.cc:359] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.502012  8409 raft_consensus.cc:385] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.502278  8409 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.502882  8409 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.505419  8409 ts_tablet_manager.cc:1434] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:15:40.506282  8409 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.507694  8411 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.508144  8411 ts_tablet_manager.cc:1403] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.008s
I20260709 13:15:40.510241  8369 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.509622  8115 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.510641  8411 raft_consensus.cc:359] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.511359  8411 raft_consensus.cc:385] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.511650  8411 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.512549  8410 tablet_bootstrap.cc:654] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.515409  8261 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:40.516260  8453 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.516399  8220 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.516727  8453 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:40.517554  8453 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.512418  8411 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.524194  8411 ts_tablet_manager.cc:1434] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:40.525331  8411 tablet_bootstrap.cc:492] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.525717  8409 tablet_bootstrap.cc:654] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.531548  8411 tablet_bootstrap.cc:654] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.537058  8443 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.537240  8369 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.537535  8443 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.539546  8443 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:40.539764  8410 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.540275  8410 ts_tablet_manager.cc:1403] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.003s
I20260709 13:15:40.541154  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.541764  8220 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:40.541960  8409 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.542472  8409 ts_tablet_manager.cc:1403] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.006s
I20260709 13:15:40.542690  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:40.543313  8294 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:40.544731  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:40.545171  8409 raft_consensus.cc:359] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.545943  8409 raft_consensus.cc:385] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.546182  8443 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.546247  8409 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.546626  8443 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.547034  8443 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.547073  8410 raft_consensus.cc:359] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.547442  8411 tablet_bootstrap.cc:492] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.547824  8410 raft_consensus.cc:385] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.547395  8409 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.548094  8411 ts_tablet_manager.cc:1403] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
I20260709 13:15:40.548154  8410 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.549031  8410 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.550117  8409 ts_tablet_manager.cc:1434] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:40.551012  8409 tablet_bootstrap.cc:492] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.550758  8411 raft_consensus.cc:359] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.551420  8411 raft_consensus.cc:385] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.551690  8411 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.552451  8411 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.544690  8116 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.556674  8443 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.557842  8409 tablet_bootstrap.cc:654] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.559332  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.559916  8220 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.561926  8443 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:40.564990  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:40.565706  8294 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.566203  8411 ts_tablet_manager.cc:1434] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:15:40.567086  8411 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.575408  8411 tablet_bootstrap.cc:654] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.577978  8470 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.578555  8470 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.580996  8409 tablet_bootstrap.cc:492] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.581130  8486 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.581482  8409 ts_tablet_manager.cc:1403] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.031s	user 0.025s	sys 0.003s
I20260709 13:15:40.581631  8486 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.583755  8486 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.584625  8409 raft_consensus.cc:359] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.585270  8409 raft_consensus.cc:385] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.585541  8409 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.585641  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:40.585917  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:40.586748  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.587720  8219 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:40.583950  8470 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:40.586234  8293 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:40.589075  8220 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:40.589202  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.589700  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.590320  8411 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.590562  8486 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.590786  8411 ts_tablet_manager.cc:1403] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 13:15:40.590746  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.591202  8443 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.591727  8418 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.592288  8418 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:40.593082  8418 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.593490  8411 raft_consensus.cc:359] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.594125  8411 raft_consensus.cc:385] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.594405  8411 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.595011  8411 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.595482  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.586197  8409 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:40.596696  8186 leader_election.cc:343] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.590929  8486 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.598064  8486 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.598157  8409 ts_tablet_manager.cc:1434] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:40.599052  8409 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.599825  8294 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:40.604501  8410 ts_tablet_manager.cc:1434] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:15:40.604796  8409 tablet_bootstrap.cc:654] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.606081  8410 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.607411  8443 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.608968  8411 ts_tablet_manager.cc:1434] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:15:40.609874  8411 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.610124  8486 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.615521  8411 tablet_bootstrap.cc:654] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.615782  8453 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.616305  8453 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.620633  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:40.621367  8294 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.625299  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.626144  8368 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.626300  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.626959  8220 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.627486  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:40.628466  8465 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.628916  8465 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.629456  8465 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.630942  8453 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.634280  8117 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.643721  8410 tablet_bootstrap.cc:654] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.645323  8453 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.648558  8443 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.648885  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.650275  8294 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:40.653250  8409 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.653818  8409 ts_tablet_manager.cc:1403] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.011s
I20260709 13:15:40.645362  8486 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:15:40.650419  8186 leader_election.cc:343] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.657279  8409 raft_consensus.cc:359] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.657953  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:40.658195  8409 raft_consensus.cc:385] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.658579  8409 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.658886  8451 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.663054  8453 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.659387  8409 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.663602  8453 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.665927  8409 ts_tablet_manager.cc:1434] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:40.667143  8409 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.667479  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:15:40.670167  8258 leader_election.cc:343] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.674674  8409 tablet_bootstrap.cc:654] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.679507  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.680234  8369 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.681599  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.646701  8465 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.684398  8415 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.684762  8415 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.685204  8415 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.686792  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.687424  8219 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.694124  8418 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.697017  8219 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.698251  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.706707  8510 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.707212  8510 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:40.709311  8453 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.710557  8453 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.713150  8415 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.714221  8453 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.716144  8453 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.724180  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.716154  8415 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.735216  8451 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:40.736496  8451 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:40.752713  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 54557.8us
I20260709 13:15:40.754546  8411 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.754765  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.757575  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.758378  8219 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.755062  8411 ts_tablet_manager.cc:1403] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.145s	user 0.036s	sys 0.080s
I20260709 13:15:40.762614  8411 raft_consensus.cc:359] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.710165  8510 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.763509  8411 raft_consensus.cc:385] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.725925  8367 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.764608  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.765311  8411 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.766170  8409 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.725174  8465 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.766698  8409 ts_tablet_manager.cc:1403] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.000s
I20260709 13:15:40.765985  8411 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.766111  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:15:40.770303  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:40.770411  8409 raft_consensus.cc:359] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.771307  8409 raft_consensus.cc:385] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.771535  8409 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.772177  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:40.767488  8369 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.773065  8411 ts_tablet_manager.cc:1434] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:15:40.773749  8409 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.768338  8366 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.777031  8409 ts_tablet_manager.cc:1434] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:40.779052  8409 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.774765  8465 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.782516  8465 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.783100  8465 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.786031  8409 tablet_bootstrap.cc:654] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.789767  8117 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:40.796205  8258 leader_election.cc:343] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.797688  8409 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.798175  8409 ts_tablet_manager.cc:1403] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:15:40.798411  8509 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.800652  8411 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.801105  8409 raft_consensus.cc:359] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.804271  8409 raft_consensus.cc:385] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.804579  8409 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.805405  8409 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.807729  8369 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.808014  8409 ts_tablet_manager.cc:1434] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:40.809047  8409 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.810002  8410 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.810422  8410 ts_tablet_manager.cc:1403] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.205s	user 0.025s	sys 0.029s
I20260709 13:15:40.813028  8410 raft_consensus.cc:359] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.813674  8410 raft_consensus.cc:385] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.813943  8410 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.814505  8410 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.816015  8116 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.816857  8410 ts_tablet_manager.cc:1434] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:15:40.817682  8410 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.820516  8366 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.820919  8509 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.823027  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.823488  8510 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.824106  8415 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.824606  8415 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:40.825379  8415 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.819607  8409 tablet_bootstrap.cc:654] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.831964  8465 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.835202  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.836019  8220 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.837039  8453 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.837517  8453 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.838759  8410 tablet_bootstrap.cc:654] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.839694  8453 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.842582  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:40.843302  8367 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.843128  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.844539  8261 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:40.845062  8465 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.845587  8465 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.846318  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.847007  8369 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:40.848035  8258 leader_election.cc:343] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.844550  8411 tablet_bootstrap.cc:654] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.855389  8220 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.858799  8369 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.865943  8410 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.866099  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:40.866400  8410 ts_tablet_manager.cc:1403] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.001s
I20260709 13:15:40.866917  8510 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.867386  8510 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:40.868278  8510 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.869200  8410 raft_consensus.cc:359] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.869832  8410 raft_consensus.cc:385] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.870090  8410 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.845921  8465 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.870802  8410 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.871423  8465 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.872869  8410 ts_tablet_manager.cc:1434] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:15:40.873769  8410 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.873550  8453 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.874255  8453 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.864159  8411 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:40.876554  8411 ts_tablet_manager.cc:1403] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.000s
I20260709 13:15:40.879079  8411 raft_consensus.cc:359] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.879663  8411 raft_consensus.cc:385] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.879948  8410 tablet_bootstrap.cc:654] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.882211  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:40.882459  8453 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.882902  8219 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:40.883016  8465 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.884227  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:40.885057  8453 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.885674  8453 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.886174  8453 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.879928  8411 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.892972  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.893563  8410 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.893983  8410 ts_tablet_manager.cc:1403] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
W20260709 13:15:40.894124  8258 leader_election.cc:343] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.889575  8411 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.884244  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:40.896915  8261 leader_election.cc:343] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.897423  8411 ts_tablet_manager.cc:1434] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:40.896975  8410 raft_consensus.cc:359] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.897751  8410 raft_consensus.cc:385] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.897996  8410 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.898288  8411 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:40.898772  8410 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.901017  8410 ts_tablet_manager.cc:1434] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:40.901955  8410 tablet_bootstrap.cc:492] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.901872  8465 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.905583  8409 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.905622  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.906193  8409 ts_tablet_manager.cc:1403] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.036s
I20260709 13:15:40.906529  8369 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.909221  8410 tablet_bootstrap.cc:654] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.908996  8409 raft_consensus.cc:359] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.909741  8409 raft_consensus.cc:385] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.910072  8409 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.910825  8409 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.911594  8465 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.913372  8409 ts_tablet_manager.cc:1434] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:40.914287  8409 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.919834  8409 tablet_bootstrap.cc:654] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.924678  8453 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.926227  8411 tablet_bootstrap.cc:654] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.930421  8410 tablet_bootstrap.cc:492] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.931979  8509 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.950068  8410 ts_tablet_manager.cc:1403] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.011s
I20260709 13:15:40.952610  8410 raft_consensus.cc:359] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.953251  8410 raft_consensus.cc:385] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.953522  8410 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.954146  8410 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.956082  8410 ts_tablet_manager.cc:1434] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:40.956938  8410 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:40.959508  8510 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.961381  8409 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:40.961812  8409 ts_tablet_manager.cc:1403] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.017s
I20260709 13:15:40.964385  8409 raft_consensus.cc:359] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.964850  8409 raft_consensus.cc:385] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.965106  8409 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.965735  8409 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.967253  8409 ts_tablet_manager.cc:1434] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:40.968134  8409 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:40.973457  8410 tablet_bootstrap.cc:654] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.973838  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:40.974623  8219 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.977835  8118 catalog_manager.cc:5697] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.980402  8409 tablet_bootstrap.cc:654] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.981150  8118 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.985033  8453 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:40.986184  8369 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:40.994118  8410 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:40.994558  8410 ts_tablet_manager.cc:1403] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.003s
I20260709 13:15:40.991010  8261 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:40.997498  8510 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.997434  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:40.998044  8510 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:40.998211  8465 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:40.998850  8261 leader_election.cc:343] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.998871  8510 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:40.999846  8410 raft_consensus.cc:359] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.000541  8410 raft_consensus.cc:385] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.000810  8410 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.001452  8410 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.003870  8410 ts_tablet_manager.cc:1434] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:41.003996  8219 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:41.005409  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:41.006812  8453 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.009549  8453 raft_consensus.cc:697] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:41.010744  8453 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.012965  8410 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:41.020553  8465 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.021199  8465 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.026024  8465 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.026031  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.037339  8410 tablet_bootstrap.cc:654] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.044317  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:41.044557  8411 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:41.045181  8411 ts_tablet_manager.cc:1403] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.147s	user 0.033s	sys 0.030s
W20260709 13:15:41.042732  8261 leader_election.cc:343] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.052948  8418 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:41.055116  8258 leader_election.cc:343] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.056300  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:41.056463  8411 raft_consensus.cc:359] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.057150  8411 raft_consensus.cc:385] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.057258  8409 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:41.057452  8411 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.057757  8409 ts_tablet_manager.cc:1403] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.017s
I20260709 13:15:41.058123  8411 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.060611  8411 ts_tablet_manager.cc:1434] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:41.061106  8465 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.064702  8411 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:41.066563  8409 raft_consensus.cc:359] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.067449  8409 raft_consensus.cc:385] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.067899  8409 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.068764  8409 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.071431  8409 ts_tablet_manager.cc:1434] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:15:41.072631  8409 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:41.079736  8411 tablet_bootstrap.cc:654] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.084635  8115 catalog_manager.cc:5697] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.086880  8115 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.097862  8409 tablet_bootstrap.cc:654] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.101593  8410 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:41.102203  8410 ts_tablet_manager.cc:1403] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.089s	user 0.025s	sys 0.005s
I20260709 13:15:41.107743  8410 raft_consensus.cc:359] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.108799  8410 raft_consensus.cc:385] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.109143  8410 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.110105  8410 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.112609  8410 ts_tablet_manager.cc:1434] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:41.113059  8409 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:41.113495  8409 ts_tablet_manager.cc:1403] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.041s	user 0.005s	sys 0.005s
I20260709 13:15:41.113581  8410 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:41.116448  8409 raft_consensus.cc:359] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.117159  8409 raft_consensus.cc:385] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.117439  8409 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.117911  8451 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.118345  8451 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.118243  8409 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.119743  8471 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.120270  8451 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.120615  8409 ts_tablet_manager.cc:1434] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:41.121546  8409 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:41.123040  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.123795  8369 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:41.124455  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.126933  8186 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:41.128024  8451 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.128427  8409 tablet_bootstrap.cc:654] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.130462  8471 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.130915  8471 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.132952  8471 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:41.135044  8411 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:41.135473  8411 ts_tablet_manager.cc:1403] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.000s
I20260709 13:15:41.136056  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.136636  8295 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:41.137223  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:41.137822  8219 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:41.139984  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:41.141012  8470 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.141355  8470 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.141724  8470 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.137828  8411 raft_consensus.cc:359] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.142184  8411 raft_consensus.cc:385] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.142470  8411 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.143066  8451 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.143110  8411 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.145761  8409 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:41.145766  8411 ts_tablet_manager.cc:1434] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:15:41.146509  8409 ts_tablet_manager.cc:1403] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:15:41.146926  8411 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:41.145569  8410 tablet_bootstrap.cc:654] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.149180  8451 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.149915  8409 raft_consensus.cc:359] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.150650  8409 raft_consensus.cc:385] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.150981  8409 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.151044  8451 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.151718  8409 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.151887  8470 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.153765  8470 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:41.153723  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.154407  8295 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:41.154784  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.155514  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.155857  8294 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.156565  8505 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.155560  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:41.156945  8505 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.157222  8219 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.157289  8505 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.157644  8411 tablet_bootstrap.cc:654] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.162665  8294 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:41.163971  8219 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:41.164369  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:41.164651  8505 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.166153  8409 ts_tablet_manager.cc:1434] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:15:41.166504  8471 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.166957  8471 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:41.167464  8409 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:41.168157  8410 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:41.167760  8471 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.168551  8410 ts_tablet_manager.cc:1403] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:15:41.171028  8410 raft_consensus.cc:359] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.171654  8410 raft_consensus.cc:385] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.174556  8409 tablet_bootstrap.cc:654] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.171921  8410 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.177282  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.178073  8293 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.177858  8410 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.192329  8410 ts_tablet_manager.cc:1434] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:15:41.193461  8410 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:41.179947  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.189152  8509 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:41.199913  8186 leader_election.cc:343] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.207782  8410 tablet_bootstrap.cc:654] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.189908  8451 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.209565  8505 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.211030  8509 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.210976  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:41.211624  8509 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:41.212966  8186 leader_election.cc:343] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.213703  8509 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.215039  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:15:41.225044  8258 leader_election.cc:343] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.226661  8411 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:41.227111  8411 ts_tablet_manager.cc:1403] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.014s
I20260709 13:15:41.225046  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.230587  8293 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.231117  8470 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:41.231134  8261 leader_election.cc:343] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.231750  8470 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.232553  8261 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:41.233306  8509 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.234138  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:41.235328  8451 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.235941  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:41.235962  8505 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.235647  8116 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.236224  8451 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.236697  8505 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:41.237515  8505 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.238255  8451 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.239358  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.240420  8470 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:41.241137  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.246089  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.246860  8294 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:41.248032  8219 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.250358  8486 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.250979  8486 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.253458  8332 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:41.243291  8293 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:41.255798  8486 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.257182  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.258499  8486 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.258967  8486 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.258916  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.259588  8486 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.259863  8294 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.257282  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.260565  8471 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.261133  8367 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.263403  8183 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.264567  8411 raft_consensus.cc:359] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.265189  8411 raft_consensus.cc:385] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.265434  8411 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.266579  8505 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:41.267113  8505 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.267614  8505 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.266069  8411 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.269627  8411 ts_tablet_manager.cc:1434] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:15:41.270481  8411 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:41.270073  8118 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.273576  8366 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:41.278252  8509 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.279671  8451 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.279500  8505 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.280205  8451 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.282230  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.283073  8294 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.283519  8411 tablet_bootstrap.cc:654] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.279533  8509 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.282480  8505 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.285475  8509 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.287477  8509 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.288386  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.282474  8451 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.293493  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:41.291002  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:41.292372  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.302394  8471 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.307992  8367 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.308379  8366 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.309590  8186 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.289553  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.302765  8409 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:41.312083  8409 ts_tablet_manager.cc:1403] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.145s	user 0.026s	sys 0.000s
I20260709 13:15:41.304812  8486 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.313024  8505 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.314958  8409 raft_consensus.cc:359] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.315642  8409 raft_consensus.cc:385] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.314484  8486 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.315899  8409 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
W20260709 13:15:41.289484  8261 leader_election.cc:343] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:41.316807  8258 leader_election.cc:343] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.316618  8409 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.317062  8367 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:15:41.317642  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:41.318629  8409 ts_tablet_manager.cc:1434] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:15:41.299300  8410 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:41.318796  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.319156  8510 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.319380  8410 ts_tablet_manager.cc:1403] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.006s
I20260709 13:15:41.319424  8295 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.320924  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:41.321648  8366 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.322054  8410 raft_consensus.cc:359] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.323753  8409 tablet_bootstrap.cc:492] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:41.322697  8410 raft_consensus.cc:385] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.289988  8294 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:15:41.326829  8410 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.333774  8453 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.342862  8366 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.335675  8486 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:41.344252  8183 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.345230  8505 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.345721  8505 raft_consensus.cc:697] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:41.334698  8295 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.346855  8505 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.349764  8410 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.353549  8410 ts_tablet_manager.cc:1434] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 13:15:41.354277  8410 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:41.360579  8411 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:41.361063  8411 ts_tablet_manager.cc:1403] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.003s
I20260709 13:15:41.362588  8409 tablet_bootstrap.cc:654] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.360103  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.371042  8549 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.371526  8549 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:41.372351  8549 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.372777  8486 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.373263  8486 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.373682  8411 raft_consensus.cc:359] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.374563  8411 raft_consensus.cc:385] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.374873  8411 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.375288  8486 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.375550  8411 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.377133  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.377846  8411 ts_tablet_manager.cc:1434] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:15:41.377727  8294 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:41.378839  8411 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:41.378978  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.382798  8505 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.384990  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.384622  8505 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.388401  8505 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:41.390540  8186 leader_election.cc:343] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.408950  8411 tablet_bootstrap.cc:654] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.412588  8510 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.425544  8410 tablet_bootstrap.cc:654] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.430367  8409 tablet_bootstrap.cc:492] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:41.430913  8409 ts_tablet_manager.cc:1403] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.006s
I20260709 13:15:41.431555  8465 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.430437  8510 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.438751  8505 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.444169  8451 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:41.445415  8486 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.445895  8486 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.446301  8451 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:15:41.446794  8451 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.448942  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.449574  8294 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:41.450181  8505 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.452008  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:41.452064  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.452956  8409 raft_consensus.cc:359] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.447913  8486 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.453644  8409 raft_consensus.cc:385] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.453938  8409 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
W20260709 13:15:41.453984  8186 leader_election.cc:343] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:41.454658  8186 leader_election.cc:343] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.454843  8409 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.455613  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:41.456065  8453 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.456600  8486 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.456948  8486 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.457270  8486 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.446655  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.458614  8295 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.459472  8409 ts_tablet_manager.cc:1434] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:15:41.460471  8409 tablet_bootstrap.cc:492] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:41.469871  8453 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.475688  8486 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.490235  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.490265  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:41.490828  8294 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.492568  8411 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:41.493124  8411 ts_tablet_manager.cc:1403] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.114s	user 0.032s	sys 0.018s
I20260709 13:15:41.495756  8411 raft_consensus.cc:359] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.496501  8411 raft_consensus.cc:385] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.496728  8486 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.496977  8411 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.497753  8294 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.497828  8411 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.499030  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.499372  8410 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:41.499871  8410 ts_tablet_manager.cc:1403] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.146s	user 0.007s	sys 0.004s
I20260709 13:15:41.496376  8409 tablet_bootstrap.cc:654] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.500517  8411 ts_tablet_manager.cc:1434] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:41.501541  8411 tablet_bootstrap.cc:492] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:41.503175  8295 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.499833  8486 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.504490  8486 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:41.504776  8451 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:41.505975  8186 leader_election.cc:343] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.506129  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:41.511729  8557 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.512296  8557 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:41.505316  8486 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.521579  8557 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.524739  8510 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.536010  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.543190  8410 raft_consensus.cc:359] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.544152  8410 raft_consensus.cc:385] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.544490  8410 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.571606  8451 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.571893  8471 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.572966  8410 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.580658  8410 ts_tablet_manager.cc:1434] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.080s	user 0.023s	sys 0.010s
I20260709 13:15:41.581967  8410 tablet_bootstrap.cc:492] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:41.572432  8471 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.574869  8418 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.601430  8471 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:41.608067  8367 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.608189  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:41.597759  8418 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.617568  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:41.621268  8409 tablet_bootstrap.cc:492] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:41.621728  8409 ts_tablet_manager.cc:1403] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.010s
I20260709 13:15:41.621631  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.623045  8418 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:41.629016  8332 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:41.629588  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:41.631539  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.633172  8294 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:41.634320  8332 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:41.639870  8216 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.636968  8443 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.644855  8411 tablet_bootstrap.cc:654] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.646497  8418 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.656131  8186 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:41.665719  8557 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.681857  8557 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.682322  8451 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.650430  8443 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.719370  8471 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.726399  8409 raft_consensus.cc:359] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.727092  8409 raft_consensus.cc:385] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.727362  8409 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.728055  8409 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.729210  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.729790  8295 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:41.730382  8411 tablet_bootstrap.cc:492] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:41.730829  8411 ts_tablet_manager.cc:1403] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.229s	user 0.015s	sys 0.009s
I20260709 13:15:41.731011  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:15:41.731238  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 75219.7us
I20260709 13:15:41.731930  8486 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.732301  8486 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.732708  8486 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.732515  8571 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.734541  8409 ts_tablet_manager.cc:1434] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.000s
I20260709 13:15:41.732372  8509 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.735422  8409 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:41.735671  8509 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.736183  8411 raft_consensus.cc:359] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.736833  8453 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.754390  8509 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:41.755230  8509 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.756479  8509 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.730849  8557 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.739288  8486 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.759435  8486 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.760610  8411 raft_consensus.cc:385] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.761729  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.761967  8409 tablet_bootstrap.cc:654] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.762241  8411 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.742522  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.763994  8411 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.766088  8411 ts_tablet_manager.cc:1434] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:15:41.765930  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:41.767119  8411 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
W20260709 13:15:41.767552  8186 leader_election.cc:343] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.740190  8410 tablet_bootstrap.cc:654] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.749400  8451 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.762296  8295 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.744165  8118 catalog_manager.cc:5697] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.773981  8118 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.776712  8118 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.779340  8411 tablet_bootstrap.cc:654] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:41.784587  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:41.785861  8295 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.778656  8118 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.786290  8186 leader_election.cc:343] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.790266  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:41.791285  8451 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.791795  8451 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:41.792838  8451 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.795015  8410 tablet_bootstrap.cc:492] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:41.795584  8410 ts_tablet_manager.cc:1403] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.214s	user 0.018s	sys 0.000s
I20260709 13:15:41.796943  8409 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:41.799510  8409 ts_tablet_manager.cc:1403] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.004s
I20260709 13:15:41.806963  8557 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.804803  8410 raft_consensus.cc:359] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.808347  8410 raft_consensus.cc:385] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.808624  8410 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.807994  8411 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:41.809182  8411 ts_tablet_manager.cc:1403] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.011s
I20260709 13:15:41.809336  8410 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.811748  8410 ts_tablet_manager.cc:1434] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:15:41.811725  8411 raft_consensus.cc:359] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.812480  8411 raft_consensus.cc:385] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.812757  8411 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.813002  8410 tablet_bootstrap.cc:492] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:41.813396  8411 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.802639  8409 raft_consensus.cc:359] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.816085  8409 raft_consensus.cc:385] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.816838  8409 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.815650  8411 ts_tablet_manager.cc:1434] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:15:41.818634  8411 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:41.819726  8410 tablet_bootstrap.cc:654] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.822847  8409 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.825001  8409 ts_tablet_manager.cc:1434] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:15:41.825341  8411 tablet_bootstrap.cc:654] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.825888  8409 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:41.826746  8410 tablet_bootstrap.cc:492] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:41.827145  8410 ts_tablet_manager.cc:1403] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:15:41.829789  8410 raft_consensus.cc:359] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.830492  8410 raft_consensus.cc:385] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.830755  8410 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.831355  8410 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.833500  8410 ts_tablet_manager.cc:1434] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:41.833871  8409 tablet_bootstrap.cc:654] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.834414  8410 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:41.836709  8557 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.837312  8557 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.840106  8410 tablet_bootstrap.cc:654] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.841578  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.842449  8295 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:41.847434  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.848603  8451 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.849057  8451 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.849491  8451 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.854893  8557 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.856647  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:41.859252  8186 leader_election.cc:343] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.864259  8557 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.872506  8367 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:41.873890  8509 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.874557  8509 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.874775  8505 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.878908  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.879720  8369 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:41.881292  8261 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:41.882535  8465 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.883037  8465 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.883694  8465 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.889328  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:41.890206  8216 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:41.895686  8509 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.896938  8505 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.897542  8505 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.899276  8409 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:41.891671  8451 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.899798  8409 ts_tablet_manager.cc:1403] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.002s
I20260709 13:15:41.903123  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:41.926702  8369 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:41.925065  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:41.927934  8409 raft_consensus.cc:359] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.928661  8409 raft_consensus.cc:385] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.900954  8505 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.928488  8293 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.930960  8411 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:41.931416  8411 ts_tablet_manager.cc:1403] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.113s	user 0.030s	sys 0.048s
I20260709 13:15:41.907557  8549 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:15:41.934094  8411 raft_consensus.cc:359] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.934736  8411 raft_consensus.cc:385] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.934985  8411 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.935621  8411 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.937520  8411 ts_tablet_manager.cc:1434] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:15:41.938469  8411 tablet_bootstrap.cc:492] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:41.942991  8293 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:41.949313  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.949574  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:41.950218  8549 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.951858  8549 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:41.952936  8549 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.944849  8411 tablet_bootstrap.cc:654] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.945151  8409 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.956804  8409 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.958494  8409 ts_tablet_manager.cc:1434] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.000s
I20260709 13:15:41.959553  8409 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:41.945804  8186 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:41.982007  8505 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.982441  8505 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.982806  8505 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.903299  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:41.924356  8451 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:41.984743  8115 catalog_manager.cc:5697] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.922173  8294 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:41.910022  8465 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:41.998785  8410 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:41.999432  8410 ts_tablet_manager.cc:1403] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.165s	user 0.039s	sys 0.104s
I20260709 13:15:42.002806  8418 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.003458  8418 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.005761  8418 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:42.008473  8295 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:42.008329  8505 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.009505  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.013823  8505 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.018090  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.018543  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:42.018877  8294 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:42.019097  8367 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.020409  8332 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.021579  8571 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.007627  8465 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.015519  8410 raft_consensus.cc:359] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.024219  8410 raft_consensus.cc:385] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.024603  8410 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.025431  8410 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.040576  8410 ts_tablet_manager.cc:1434] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:15:42.041742  8410 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
W20260709 13:15:42.044960  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 99232.4us
I20260709 13:15:42.050611  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:42.076498  8453 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.078056  8453 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.095449  8465 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.095994  8465 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.098781  8409 tablet_bootstrap.cc:654] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.100476  8453 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.105706  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.106805  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:42.108322  8261 leader_election.cc:343] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:42.110649  8261 leader_election.cc:343] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.110855  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:42.050956  8549 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260709 13:15:42.103390  8294 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:42.100476  8465 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.119347  8410 tablet_bootstrap.cc:654] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.111845  8367 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:42.119375  8571 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:42.103740  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46735.5us
I20260709 13:15:42.123782  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:42.124626  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:15:42.125545  8186 leader_election.cc:343] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.125597  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.129317  8217 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:42.128870  8261 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:42.131729  8465 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.132334  8465 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:42.133342  8465 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.134614  8116 catalog_manager.cc:5697] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.138100  8409 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:42.138528  8409 ts_tablet_manager.cc:1403] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.011s
I20260709 13:15:42.141427  8409 raft_consensus.cc:359] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.141901  8409 raft_consensus.cc:385] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.142055  8409 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.142427  8409 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.143988  8409 ts_tablet_manager.cc:1434] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:15:42.144866  8409 tablet_bootstrap.cc:492] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:42.148650  8571 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.149226  8571 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.150980  8409 tablet_bootstrap.cc:654] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.155301  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.156263  8451 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.158208  8549 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.165145  8409 tablet_bootstrap.cc:492] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:42.165582  8409 ts_tablet_manager.cc:1403] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.013s
I20260709 13:15:42.167585  8571 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:42.168176  8409 raft_consensus.cc:359] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.168838  8409 raft_consensus.cc:385] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.169106  8409 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.169351  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.169886  8409 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:42.171980  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 46477.5us
I20260709 13:15:42.172278  8409 ts_tablet_manager.cc:1434] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:15:42.174636  8186 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:42.176761  8451 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.177186  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.179790  8368 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.180622  8116 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.175676  8409 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:42.184320  8411 tablet_bootstrap.cc:492] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:42.184737  8411 ts_tablet_manager.cc:1403] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.246s	user 0.027s	sys 0.022s
W20260709 13:15:42.186106  8258 leader_election.cc:343] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.186573  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.187217  8411 raft_consensus.cc:359] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:42.187606  8258 leader_election.cc:343] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.189355  8510 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.190198  8410 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:42.190295  8509 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.190657  8410 ts_tablet_manager.cc:1403] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.149s	user 0.022s	sys 0.011s
I20260709 13:15:42.190843  8509 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.193311  8509 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.193725  8258 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.194376  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:42.195745  8261 leader_election.cc:343] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.193208  8410 raft_consensus.cc:359] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.196858  8410 raft_consensus.cc:385] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.197115  8410 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.197820  8410 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.187902  8411 raft_consensus.cc:385] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.200249  8411 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.200450  8453 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.201112  8411 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.202004  8471 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.207608  8411 ts_tablet_manager.cc:1434] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:15:42.208516  8411 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:42.212153  8571 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.212440  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.212621  8571 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.215708  8451 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.217571  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.199874  8410 ts_tablet_manager.cc:1434] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:15:42.219084  8410 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:42.221437  8451 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.224941  8410 tablet_bootstrap.cc:654] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:42.225162  8258 leader_election.cc:343] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.225601  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.226352  8510 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.227890  8571 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:42.229604  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.230443  8292 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:42.231726  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.232811  8418 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.241835  8418 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.190371  8409 tablet_bootstrap.cc:654] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.250945  8451 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.251314  8411 tablet_bootstrap.cc:654] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.258661  8451 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.259128  8451 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.261627  8451 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.262663  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.263278  8292 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.264513  8183 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:42.265692  8549 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.266124  8549 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.266532  8549 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.268625  8409 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:42.269179  8409 ts_tablet_manager.cc:1403] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.019s
I20260709 13:15:42.271888  8411 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:42.272326  8411 ts_tablet_manager.cc:1403] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.004s
I20260709 13:15:42.277675  8410 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:42.278229  8410 ts_tablet_manager.cc:1403] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.001s
I20260709 13:15:42.279394  8549 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.279511  8409 raft_consensus.cc:359] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.280483  8409 raft_consensus.cc:385] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.280848  8409 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.280709  8411 raft_consensus.cc:359] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.281422  8411 raft_consensus.cc:385] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.281701  8411 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.281644  8409 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.283252  8410 raft_consensus.cc:359] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.283780  8409 ts_tablet_manager.cc:1434] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:15:42.283887  8410 raft_consensus.cc:385] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.284307  8410 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.284907  8410 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.287046  8410 ts_tablet_manager.cc:1434] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:15:42.287484  8411 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.288913  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:42.289687  8292 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.290565  8411 ts_tablet_manager.cc:1434] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:15:42.291442  8411 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:42.288915  8410 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:42.293227  8409 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:42.296666  8292 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:42.297811  8183 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:42.298530  8451 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.298725  8410 tablet_bootstrap.cc:654] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.299023  8451 raft_consensus.cc:697] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:42.300345  8451 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.303776  8409 tablet_bootstrap.cc:654] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.303797  8411 tablet_bootstrap.cc:654] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.308574  8549 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.321918  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.321750  8116 catalog_manager.cc:5697] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.329458  8411 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:42.331988  8410 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:42.332465  8410 ts_tablet_manager.cc:1403] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.044s	user 0.003s	sys 0.011s
I20260709 13:15:42.333289  8465 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.333750  8465 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.335114  8410 raft_consensus.cc:359] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.335760  8410 raft_consensus.cc:385] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.336092  8411 ts_tablet_manager.cc:1403] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.002s
I20260709 13:15:42.336555  8465 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.337352  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.338105  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:15:42.338554  8261 leader_election.cc:343] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.338636  8411 raft_consensus.cc:359] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.339346  8411 raft_consensus.cc:385] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.339628  8411 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.340677  8410 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.341439  8410 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.343528  8410 ts_tablet_manager.cc:1434] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:15:42.344435  8410 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:42.340487  8411 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.349314  8411 ts_tablet_manager.cc:1434] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:15:42.349670  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.350188  8369 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.350340  8216 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
W20260709 13:15:42.351341  8186 leader_election.cc:343] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.352643  8410 tablet_bootstrap.cc:654] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.356950  8411 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:42.361838  8549 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.362991  8411 tablet_bootstrap.cc:654] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.371631  8411 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:42.372119  8411 ts_tablet_manager.cc:1403] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.009s
I20260709 13:15:42.375733  8258 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:42.376546  8465 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.376901  8465 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.377225  8465 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.382155  8594 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.382658  8594 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.384760  8594 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.385357  8411 raft_consensus.cc:359] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.386018  8411 raft_consensus.cc:385] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.386288  8411 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.387017  8411 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.387945  8465 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.389317  8411 ts_tablet_manager.cc:1434] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:15:42.390233  8411 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:42.390913  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:15:42.392086  8261 leader_election.cc:343] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.393082  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.393728  8292 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.394819  8183 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:42.395720  8549 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.396093  8549 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.396503  8549 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.401392  8411 tablet_bootstrap.cc:654] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.400590  8465 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.416072  8410 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:42.416543  8410 ts_tablet_manager.cc:1403] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.007s
I20260709 13:15:42.416749  8369 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:42.420787  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:42.421406  8216 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.424031  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.420838  8410 raft_consensus.cc:359] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.425186  8368 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.424990  8410 raft_consensus.cc:385] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.430263  8410 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.430876  8410 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.433068  8410 ts_tablet_manager.cc:1434] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:15:42.433923  8410 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:42.438777  8409 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:42.440603  8409 ts_tablet_manager.cc:1403] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.148s	user 0.027s	sys 0.061s
I20260709 13:15:42.436354  8216 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:42.446439  8258 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:42.447444  8465 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.447899  8465 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:42.449322  8465 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.453940  8549 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.458889  8411 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:42.458591  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:42.459358  8411 ts_tablet_manager.cc:1403] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.000s
I20260709 13:15:42.460031  8409 raft_consensus.cc:359] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.460732  8409 raft_consensus.cc:385] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.461068  8409 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.461726  8409 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.463795  8409 ts_tablet_manager.cc:1434] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 13:15:42.463852  8294 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.464874  8409 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:42.472728  8411 raft_consensus.cc:359] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.473399  8411 raft_consensus.cc:385] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.473676  8411 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.474417  8294 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:42.474311  8411 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.475875  8409 tablet_bootstrap.cc:654] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.477926  8183 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:42.479089  8451 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.479687  8451 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:42.480809  8451 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.484170  8118 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.490466  8594 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.492762  8410 tablet_bootstrap.cc:654] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.494592  8411 ts_tablet_manager.cc:1434] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 13:15:42.495515  8411 tablet_bootstrap.cc:492] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:42.493531  8549 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.498756  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:42.499428  8369 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.514701  8410 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:42.515185  8410 ts_tablet_manager.cc:1403] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.002s
I20260709 13:15:42.515110  8369 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:42.527609  8411 tablet_bootstrap.cc:654] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.532225  8410 raft_consensus.cc:359] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.533136  8410 raft_consensus.cc:385] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.533531  8410 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.532920  8409 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:42.534848  8409 ts_tablet_manager.cc:1403] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.004s
I20260709 13:15:42.535080  8410 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.537587  8410 ts_tablet_manager.cc:1434] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:42.537295  8409 raft_consensus.cc:359] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.537946  8409 raft_consensus.cc:385] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.538203  8409 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.538821  8409 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.540251  8409 ts_tablet_manager.cc:1434] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:42.540467  8369 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.541034  8409 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:42.547263  8409 tablet_bootstrap.cc:654] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.550036  8451 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.550171  8510 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.551491  8410 tablet_bootstrap.cc:492] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:42.554373  8118 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.556550  8571 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.557026  8571 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.559017  8571 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:42.560266  8410 tablet_bootstrap.cc:654] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.561118  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.578208  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.580000  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.604180  8571 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.608549  8409 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:42.609174  8409 ts_tablet_manager.cc:1403] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.047s
I20260709 13:15:42.612380  8409 raft_consensus.cc:359] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.613250  8409 raft_consensus.cc:385] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.613595  8409 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.614593  8409 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.617388  8409 ts_tablet_manager.cc:1434] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:42.619336  8409 tablet_bootstrap.cc:492] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:42.621708  8510 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.622332  8510 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.626338  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:42.628592  8261 leader_election.cc:343] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.629302  8510 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.631660  8411 tablet_bootstrap.cc:492] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:42.632181  8411 ts_tablet_manager.cc:1403] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.137s	user 0.009s	sys 0.012s
I20260709 13:15:42.636386  8592 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.645133  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:15:42.646420  8258 leader_election.cc:343] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.646896  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.649088  8409 tablet_bootstrap.cc:654] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.650240  8592 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.652802  8411 raft_consensus.cc:359] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.654896  8411 raft_consensus.cc:385] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.655156  8411 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.655788  8411 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.657953  8411 ts_tablet_manager.cc:1434] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:15:42.658250  8410 tablet_bootstrap.cc:492] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:42.658694  8410 ts_tablet_manager.cc:1403] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.063s
I20260709 13:15:42.659754  8411 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:42.665789  8411 tablet_bootstrap.cc:654] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.666172  8410 raft_consensus.cc:359] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.667063  8410 raft_consensus.cc:385] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.667340  8410 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.668521  8410 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.669672  8409 tablet_bootstrap.cc:492] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:42.670279  8411 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:42.670431  8409 ts_tablet_manager.cc:1403] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.008s
I20260709 13:15:42.670683  8411 ts_tablet_manager.cc:1403] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:15:42.670821  8410 ts_tablet_manager.cc:1434] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:42.672812  8411 raft_consensus.cc:359] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.672808  8409 raft_consensus.cc:359] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.673620  8411 raft_consensus.cc:385] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.673743  8409 raft_consensus.cc:385] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.673941  8411 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.674185  8410 tablet_bootstrap.cc:492] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:42.674129  8409 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.674726  8411 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.675040  8409 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.677054  8411 ts_tablet_manager.cc:1434] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:42.677637  8409 ts_tablet_manager.cc:1434] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:15:42.678172  8411 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:42.711493  8451 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.754693  8451 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.716033  8596 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.716133  8505 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.731434  8453 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.734057  8510 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.737110  8471 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.765910  8596 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.767520  8451 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.768455  8505 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.770103  8471 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.771975  8505 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.772881  8471 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:42.772665  8453 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.775197  8453 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.779527  8596 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.783555  8410 tablet_bootstrap.cc:654] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.783751  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.775691  8510 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.776873  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.785090  8367 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.790366  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.790696  8510 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.791148  8369 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.791092  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.805941  8409 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
W20260709 13:15:42.811728  8186 leader_election.cc:343] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.813908  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.810499  8453 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.814483  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.814777  8294 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.815058  8453 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.815927  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.816246  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.817734  8293 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.818089  8292 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.817739  8595 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:42.818982  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.819641  8216 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:42.812597  8186 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:42.824558  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.826355  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.828336  8293 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:42.829022  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:42.826834  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.836021  8596 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.837344  8596 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.837711  8596 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.837577  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:42.839028  8505 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.839489  8505 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.840072  8505 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.842088  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:42.843557  8418 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.844157  8418 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.844707  8418 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.854628  8411 tablet_bootstrap.cc:654] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.836623  8595 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:42.859578  8258 leader_election.cc:343] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.858928  8595 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.863509  8595 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:42.864753  8258 leader_election.cc:343] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.867323  8409 tablet_bootstrap.cc:654] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.882520  8453 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.883479  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.875713  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.884195  8365 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
W20260709 13:15:42.886842  8261 leader_election.cc:343] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.887347  8261 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.897665  8453 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:42.899170  8261 leader_election.cc:343] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.899633  8261 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.900447  8453 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.868935  8418 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.906395  8594 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:15:42.906116  8505 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.912096  8505 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.914412  8505 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.914981  8505 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.917865  8505 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.921614  8261 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:42.922070  8418 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:42.923780  8453 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.926046  8453 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.925755  8596 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.926493  8453 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.928241  8596 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.928345  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:42.929185  8366 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:42.931270  8411 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:42.931082  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:42.932063  8366 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:15:42.931793  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:42.938861  8595 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.940320  8216 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:42.942680  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:42.943318  8294 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.944715  8409 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:42.945235  8409 ts_tablet_manager.cc:1403] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.007s
I20260709 13:15:42.942003  8186 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:42.949574  8411 ts_tablet_manager.cc:1403] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.272s	user 0.012s	sys 0.016s
I20260709 13:15:42.948236  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:42.950364  8216 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:15:42.952026  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:42.952737  8418 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.952775  8411 raft_consensus.cc:359] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.957444  8411 raft_consensus.cc:385] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.957086  8418 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:42.959030  8186 leader_election.cc:343] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.959590  8418 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:42.948364  8505 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.964138  8505 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.964497  8505 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.965272  8592 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.966202  8453 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.968534  8453 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.970054  8410 tablet_bootstrap.cc:492] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:42.970660  8410 ts_tablet_manager.cc:1403] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.297s	user 0.014s	sys 0.002s
I20260709 13:15:42.970613  8409 raft_consensus.cc:359] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.971089  8294 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:42.971540  8409 raft_consensus.cc:385] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.971922  8409 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.972720  8409 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.975596  8409 ts_tablet_manager.cc:1434] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.030s	user 0.001s	sys 0.005s
I20260709 13:15:42.975185  8410 raft_consensus.cc:359] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.976022  8410 raft_consensus.cc:385] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.976368  8410 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.977082  8410 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.977885  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:42.978778  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:42.979107  8410 ts_tablet_manager.cc:1434] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:15:42.979140  8549 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.980068  8409 tablet_bootstrap.cc:492] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:42.980659  8410 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:42.980085  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:42.957801  8411 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.983269  8366 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.990471  8505 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:42.992260  8216 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:42.992880  8505 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:42.995870  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:42.978820  8418 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.998620  8411 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.003410  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:43.003774  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:43.004088  8368 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.004366  8367 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.997319  8595 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.007692  8418 raft_consensus.cc:697] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:43.012624  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.014557  8295 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:43.016422  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.017043  8292 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.018126  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.019063  8291 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:15:43.029626  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.030587  8295 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.033139  8292 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.034300  8367 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.011440  8418 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.035843  8186 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.037233  8595 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.037817  8411 ts_tablet_manager.cc:1434] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.002s
W20260709 13:15:43.041312  8637 log.cc:927] Time spent T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:15:43.038321  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.043048  8571 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.040117  8595 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:43.045112  8368 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.045544  8595 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.056668  8411 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:43.058557  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.059623  8291 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:43.085968  8510 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.086637  8510 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.096441  8510 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.100232  8409 tablet_bootstrap.cc:654] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.107182  8410 tablet_bootstrap.cc:654] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.111265  8409 tablet_bootstrap.cc:492] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:43.111730  8409 ts_tablet_manager.cc:1403] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.017s
I20260709 13:15:43.115821  8410 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:43.114356  8409 raft_consensus.cc:359] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.116565  8409 raft_consensus.cc:385] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.116890  8409 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.117626  8410 ts_tablet_manager.cc:1403] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.137s	user 0.006s	sys 0.011s
I20260709 13:15:43.117564  8409 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.120136  8409 ts_tablet_manager.cc:1434] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:43.121186  8409 tablet_bootstrap.cc:492] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:43.121695  8410 raft_consensus.cc:359] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.122452  8410 raft_consensus.cc:385] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.121749  8116 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.122725  8410 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.123440  8410 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.125636  8410 ts_tablet_manager.cc:1434] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:43.128618  8409 tablet_bootstrap.cc:654] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.131695  8410 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:43.133303  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:43.134189  8369 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:43.137282  8186 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.138566  8595 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.139082  8595 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:43.139953  8595 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.145876  8295 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.149115  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:43.156663  8596 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.156811  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:43.157646  8549 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.158198  8549 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:43.154563  8418 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.159091  8549 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.159631  8571 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:15:43.160130  8571 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.162240  8571 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:43.162315  8594 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.159242  8418 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.163528  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.164513  8218 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:43.164816  8418 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:43.165153  8510 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.167372  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.168644  8411 tablet_bootstrap.cc:654] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.170989  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.176055  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.159770  8410 tablet_bootstrap.cc:654] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.177320  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.178231  8293 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:43.179276  8332 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.180243  8418 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.183699  8261 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.184541  8592 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:15:43.186781  8258 leader_election.cc:343] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.187806  8409 tablet_bootstrap.cc:492] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:43.188263  8409 ts_tablet_manager.cc:1403] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.001s
I20260709 13:15:43.188328  8418 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.176795  8295 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:15:43.189635  8654 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.190078  8654 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.190793  8409 raft_consensus.cc:359] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.191423  8409 raft_consensus.cc:385] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.191679  8409 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.193540  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.195152  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.196154  8571 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:43.196308  8409 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:43.196494  8258 leader_election.cc:343] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.196537  8571 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:15:43.197290  8571 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.198311  8409 ts_tablet_manager.cc:1434] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:15:43.199272  8409 tablet_bootstrap.cc:492] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:43.205019  8409 tablet_bootstrap.cc:654] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.206807  8410 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:43.207232  8410 ts_tablet_manager.cc:1403] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.003s
I20260709 13:15:43.209769  8410 raft_consensus.cc:359] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.210389  8410 raft_consensus.cc:385] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.210645  8410 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.204407  8571 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.211823  8411 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:43.212818  8571 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:43.214416  8411 ts_tablet_manager.cc:1403] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.158s	user 0.014s	sys 0.005s
I20260709 13:15:43.213498  8654 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.214702  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:43.214010  8410 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.215894  8409 tablet_bootstrap.cc:492] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:43.216346  8409 ts_tablet_manager.cc:1403] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:15:43.217458  8410 ts_tablet_manager.cc:1434] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:43.218422  8410 tablet_bootstrap.cc:492] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:43.218219  8411 raft_consensus.cc:359] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.218585  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.218953  8411 raft_consensus.cc:385] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.218761  8409 raft_consensus.cc:359] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.219337  8411 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.219506  8409 raft_consensus.cc:385] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.219858  8409 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.220227  8411 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.220602  8409 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.215921  8216 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:43.222178  8409 ts_tablet_manager.cc:1434] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:15:43.222720  8411 ts_tablet_manager.cc:1434] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:15:43.223105  8409 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:43.223841  8411 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:43.225257  8295 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:15:43.226485  8410 tablet_bootstrap.cc:654] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.229627  8409 tablet_bootstrap.cc:654] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.231084  8411 tablet_bootstrap.cc:654] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.238591  8410 tablet_bootstrap.cc:492] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:43.239123  8410 ts_tablet_manager.cc:1403] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 13:15:43.244980  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.242592  8410 raft_consensus.cc:359] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.245733  8410 raft_consensus.cc:385] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.245810  8571 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.246145  8410 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.246424  8571 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:43.247396  8571 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.248837  8409 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:43.249897  8410 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:43.249944  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 66340.2us
I20260709 13:15:43.251974  8410 ts_tablet_manager.cc:1434] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:15:43.253288  8410 tablet_bootstrap.cc:492] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:43.257138  8409 ts_tablet_manager.cc:1403] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.000s
I20260709 13:15:43.257710  8418 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.258167  8418 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.258961  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.259758  8409 raft_consensus.cc:359] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.260118  8418 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:43.260428  8409 raft_consensus.cc:385] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.261413  8409 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.261540  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.262182  8216 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:43.262051  8409 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.263641  8409 ts_tablet_manager.cc:1434] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:15:43.264590  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.265158  8295 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:43.266475  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:43.267760  8410 tablet_bootstrap.cc:654] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.267735  8418 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.268254  8418 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.268631  8418 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.269235  8411 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:43.269748  8411 ts_tablet_manager.cc:1403] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.016s
I20260709 13:15:43.274061  8411 raft_consensus.cc:359] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.274981  8411 raft_consensus.cc:385] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.275378  8411 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.277504  8411 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.281296  8411 ts_tablet_manager.cc:1434] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:43.282696  8411 tablet_bootstrap.cc:492] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:43.287475  8418 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.289011  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.290060  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:43.290699  8216 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.292276  8411 tablet_bootstrap.cc:654] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.298568  8216 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:43.299319  8409 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:43.300631  8418 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:43.301080  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.301717  8292 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.301934  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.302722  8418 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.303484  8418 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:43.304183  8418 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.306310  8409 tablet_bootstrap.cc:654] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.311230  8292 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
W20260709 13:15:43.334847  8261 leader_election.cc:343] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.335322  8261 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.336998  8409 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:43.336234  8656 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.337491  8409 ts_tablet_manager.cc:1403] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.010s
W20260709 13:15:43.339039  8261 leader_election.cc:343] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.339531  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.340366  8656 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.340304  8409 raft_consensus.cc:359] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.341051  8409 raft_consensus.cc:385] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.341337  8409 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.341951  8409 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.344383  8656 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.344832  8656 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.346660  8410 tablet_bootstrap.cc:492] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:43.347174  8410 ts_tablet_manager.cc:1403] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.031s
I20260709 13:15:43.347257  8656 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.364454  8409 ts_tablet_manager.cc:1434] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.027s	user 0.014s	sys 0.003s
I20260709 13:15:43.365592  8409 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:43.365959  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.367193  8411 tablet_bootstrap.cc:492] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
W20260709 13:15:43.367444  8258 leader_election.cc:343] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.367776  8411 ts_tablet_manager.cc:1403] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.005s
I20260709 13:15:43.369841  8115 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.371575  8409 tablet_bootstrap.cc:654] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.371474  8549 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.372073  8549 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.373212  8410 raft_consensus.cc:359] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.373859  8410 raft_consensus.cc:385] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.374095  8549 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.374133  8410 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.373956  8411 raft_consensus.cc:359] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.374672  8411 raft_consensus.cc:385] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.375061  8411 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.374931  8410 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.375674  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.375797  8411 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.376596  8369 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:43.376099  8115 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.377627  8186 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.378034  8411 ts_tablet_manager.cc:1434] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:43.377701  8115 catalog_manager.cc:5697] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.379011  8411 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:43.380985  8549 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.381346  8549 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.381664  8549 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.389668  8549 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.392105  8549 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.393378  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:43.393996  8369 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.400622  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.407384  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.408249  8293 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.418088  8118 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.422842  8369 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.426854  8410 ts_tablet_manager.cc:1434] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.079s	user 0.020s	sys 0.007s
I20260709 13:15:43.428808  8186 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.429152  8410 tablet_bootstrap.cc:492] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:43.428349  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.429773  8293 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.430011  8549 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.430896  8549 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:43.430675  8118 catalog_manager.cc:5697] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:43.431691  8261 leader_election.cc:343] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.431908  8549 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.434779  8409 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:43.435230  8409 ts_tablet_manager.cc:1403] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.002s
I20260709 13:15:43.432546  8411 tablet_bootstrap.cc:654] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.437772  8409 raft_consensus.cc:359] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.438537  8409 raft_consensus.cc:385] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.438850  8409 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.432183  8261 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.439535  8409 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.440153  8654 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.439268  8410 tablet_bootstrap.cc:654] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.441916  8409 ts_tablet_manager.cc:1434] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:43.442929  8409 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:43.448736  8409 tablet_bootstrap.cc:654] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.452190  8411 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:43.454028  8411 ts_tablet_manager.cc:1403] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.005s
I20260709 13:15:43.458037  8411 raft_consensus.cc:359] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.463639  8411 raft_consensus.cc:385] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.460726  8654 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.473769  8411 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.473783  8654 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.475793  8411 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.477303  8654 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.478034  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.478626  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:43.479377  8258 leader_election.cc:343] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:43.479936  8261 leader_election.cc:343] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.480455  8261 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.481166  8654 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.482059  8411 ts_tablet_manager.cc:1434] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:15:43.483839  8411 tablet_bootstrap.cc:492] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:43.490939  8549 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.491616  8549 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.497100  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.497864  8293 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:43.502115  8116 catalog_manager.cc:5697] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.505652  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.506989  8596 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.507344  8596 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.507691  8596 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.509603  8549 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.520480  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.521129  8369 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:43.523814  8596 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.526908  8596 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.528309  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.528980  8292 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.530148  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:43.531832  8365 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.535532  8549 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.538756  8418 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.539417  8410 tablet_bootstrap.cc:492] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:43.540305  8409 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:43.539940  8410 ts_tablet_manager.cc:1403] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.111s	user 0.032s	sys 0.031s
I20260709 13:15:43.540844  8409 ts_tablet_manager.cc:1403] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.098s	user 0.030s	sys 0.026s
I20260709 13:15:43.543871  8410 raft_consensus.cc:359] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.544606  8410 raft_consensus.cc:385] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.544875  8410 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.545492  8410 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.546644  8571 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.548410  8410 ts_tablet_manager.cc:1434] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:43.550594  8409 raft_consensus.cc:359] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.553067  8409 raft_consensus.cc:385] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.553352  8409 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.554034  8409 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.555634  8409 ts_tablet_manager.cc:1434] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.000s
I20260709 13:15:43.551136  8418 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.556720  8409 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:43.558806  8410 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:43.556818  8418 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.562800  8596 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.565191  8418 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:43.565593  8410 tablet_bootstrap.cc:654] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.565784  8451 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.565903  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.565188  8505 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:15:43.567739  8332 leader_election.cc:343] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.564328  8596 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.570683  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.573885  8291 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:43.575223  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.576296  8571 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.576776  8571 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.577126  8571 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.582134  8365 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.583534  8186 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.584383  8549 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.585090  8549 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:43.585384  8571 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.586685  8656 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.589269  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.590147  8596 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.590961  8451 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.573086  8292 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.598781  8411 tablet_bootstrap.cc:654] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.563802  8409 tablet_bootstrap.cc:654] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.604344  8654 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.606228  8410 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:43.606851  8410 ts_tablet_manager.cc:1403] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.029s
I20260709 13:15:43.605631  8291 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:43.607224  8451 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.602018  8656 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.606694  8654 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.616950  8656 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.617836  8654 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.619552  8571 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:43.586020  8549 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.622864  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.623588  8219 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:43.625008  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.625474  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:43.626506  8261 leader_election.cc:343] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:43.627839  8261 leader_election.cc:343] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.628880  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.633749  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.634862  8595 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.635211  8595 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.635537  8595 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.620414  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.639453  8596 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:15:43.649448  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.650117  8295 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.650575  8410 raft_consensus.cc:359] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.651292  8410 raft_consensus.cc:385] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.651561  8410 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.651680  8596 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.652263  8410 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.654604  8410 ts_tablet_manager.cc:1434] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.000s
I20260709 13:15:43.655592  8410 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:43.655510  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:43.656250  8216 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.659158  8451 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:15:43.662523  8186 leader_election.cc:343] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.663036  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.655926  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:15:43.671285  8258 leader_election.cc:343] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.671728  8258 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.672596  8510 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.673753  8510 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.674098  8510 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.674479  8291 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:43.674623  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.675895  8654 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:43.677608  8186 leader_election.cc:343] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.682672  8505 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:43.685659  8654 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.690903  8654 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.712188  8505 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.712985  8592 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.712878  8505 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:43.727595  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 56342.1us
I20260709 13:15:43.713616  8592 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.735823  8505 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.739212  8183 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:43.759764  8505 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.760354  8505 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.760782  8505 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.762434  8592 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.764286  8635 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.750228  8295 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:43.777338  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:43.778034  8289 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:15:43.787298  8409 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:43.772552  8217 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:43.796140  8216 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:43.801690  8409 ts_tablet_manager.cc:1403] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.245s	user 0.014s	sys 0.033s
I20260709 13:15:43.781894  8505 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.825863  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:43.826910  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.827757  8571 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.828284  8571 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:43.829582  8654 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.832634  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.834089  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.829078  8571 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.839352  8411 tablet_bootstrap.cc:492] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:43.839818  8411 ts_tablet_manager.cc:1403] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.356s	user 0.020s	sys 0.021s
I20260709 13:15:43.842880  8410 tablet_bootstrap.cc:654] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.843537  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:43.845588  8505 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.810011  8510 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.858078  8409 raft_consensus.cc:359] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.860988  8409 raft_consensus.cc:385] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.861229  8409 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.861761  8409 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:43.862994  8261 leader_election.cc:343] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.870460  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:43.847471  8595 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:43.872776  8261 leader_election.cc:343] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.871209  8183 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:43.873596  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:43.875990  8411 raft_consensus.cc:359] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.886356  8411 raft_consensus.cc:385] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.886562  8411 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.880645  8451 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.888583  8451 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.888968  8451 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.889284  8411 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.890156  8364 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.891564  8409 ts_tablet_manager.cc:1434] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.001s
I20260709 13:15:43.874496  8683 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:15:43.873029  8510 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.899041  8116 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.885156  8634 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:15:43.906739  8595 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:15:43.923046  8689 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:15:43.936873  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:15:43.938179  8258 leader_election.cc:343] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.938469  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:43.934962  8364 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.939078  8217 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.938870  8258 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.941601  8451 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.941982  8687 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.942838  8220 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:15:43.944118  8258 leader_election.cc:343] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.945205  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:43.946941  8687 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.948006  8411 ts_tablet_manager.cc:1434] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.001s
I20260709 13:15:43.949558  8411 tablet_bootstrap.cc:492] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:43.953455  8595 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.961016  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.961815  8292 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:43.961961  8261 leader_election.cc:343] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.964547  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.965144  8293 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.968582  8409 tablet_bootstrap.cc:492] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:43.954802  8451 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:43.970654  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:43.971895  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:43.972996  8293 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:43.977238  8411 tablet_bootstrap.cc:654] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.978781  8183 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:43.980726  8595 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.981232  8595 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:15:43.981871  8186 leader_election.cc:343] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.985453  8595 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:43.987507  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:43.988740  8294 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.989238  8217 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:43.995517  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:43.996291  8656 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.996773  8656 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:43.999289  8294 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:44.001621  8409 tablet_bootstrap.cc:654] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.003468  8118 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.998050  8656 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.005851  8292 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:15:43.992416  8634 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:15:44.007884  8634 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:44.008229  8634 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:44.009714  8634 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.012408  8290 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:44.017885  8596 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.026515  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:44.031113  8410 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.031646  8410 ts_tablet_manager.cc:1403] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.376s	user 0.024s	sys 0.015s
I20260709 13:15:44.014127  8634 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.034883  8596 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.037925  8596 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:44.038743  8596 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.042524  8410 raft_consensus.cc:359] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.043200  8410 raft_consensus.cc:385] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.043468  8410 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.044026  8410 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.051759  8410 ts_tablet_manager.cc:1434] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:15:44.052393  8183 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:44.058044  8451 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:44.058703  8451 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:44.059755  8451 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.069350  8410 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:44.072767  8411 tablet_bootstrap.cc:492] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:44.075615  8411 ts_tablet_manager.cc:1403] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.011s
I20260709 13:15:44.084163  8118 catalog_manager.cc:5697] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.125622  8118 catalog_manager.cc:5697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.127542  8409 tablet_bootstrap.cc:492] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:44.129920  8409 ts_tablet_manager.cc:1403] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.162s	user 0.025s	sys 0.017s
I20260709 13:15:44.132514  8410 tablet_bootstrap.cc:654] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.133483  8409 raft_consensus.cc:359] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.134160  8409 raft_consensus.cc:385] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.134440  8409 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.135147  8409 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.137217  8409 ts_tablet_manager.cc:1434] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:15:44.137564  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:44.138151  8409 tablet_bootstrap.cc:492] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:44.138051  8116 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.139516  8116 catalog_manager.cc:5697] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 2 to 3, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.140374  8410 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.140971  8410 ts_tablet_manager.cc:1403] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.002s
I20260709 13:15:44.143788  8410 raft_consensus.cc:359] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.143978  8411 raft_consensus.cc:359] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.144487  8410 raft_consensus.cc:385] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.144724  8409 tablet_bootstrap.cc:654] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.144611  8411 raft_consensus.cc:385] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.144987  8410 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.145099  8411 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.145776  8410 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.145906  8411 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.148053  8410 ts_tablet_manager.cc:1434] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:44.149001  8410 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:44.158408  8410 tablet_bootstrap.cc:654] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.162366  8411 ts_tablet_manager.cc:1434] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.000s
I20260709 13:15:44.163538  8411 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:44.169267  8410 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.169745  8410 ts_tablet_manager.cc:1403] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:15:44.172364  8410 raft_consensus.cc:359] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.173143  8410 raft_consensus.cc:385] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.173444  8410 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.174567  8411 tablet_bootstrap.cc:654] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.174196  8410 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.181222  8410 ts_tablet_manager.cc:1434] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:15:44.182507  8410 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:44.186733  8411 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:44.187209  8411 ts_tablet_manager.cc:1403] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.008s
I20260709 13:15:44.188759  8596 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.188812  8451 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.189327  8596 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.189725  8410 tablet_bootstrap.cc:654] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.189783  8411 raft_consensus.cc:359] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.190584  8411 raft_consensus.cc:385] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.190857  8411 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.191404  8596 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.191879  8411 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.192871  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:44.193938  8411 ts_tablet_manager.cc:1434] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
W20260709 13:15:44.194660  8186 leader_election.cc:343] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.195080  8411 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:44.196301  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.197153  8289 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:44.198635  8183 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:44.201413  8410 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.201576  8596 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.201948  8410 ts_tablet_manager.cc:1403] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:15:44.201979  8596 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.202464  8596 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.205076  8410 raft_consensus.cc:359] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.206091  8410 raft_consensus.cc:385] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.206404  8410 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.208520  8410 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.210703  8410 ts_tablet_manager.cc:1434] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:15:44.211637  8410 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:44.212301  8595 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.213644  8596 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.217437  8410 tablet_bootstrap.cc:654] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.218170  8596 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.218734  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:15:44.221381  8186 leader_election.cc:343] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.223897  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:44.224488  8292 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.228461  8410 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.228938  8410 ts_tablet_manager.cc:1403] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:15:44.229750  8411 tablet_bootstrap.cc:654] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.231535  8410 raft_consensus.cc:359] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.232447  8410 raft_consensus.cc:385] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.232774  8410 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.233597  8410 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.237564  8410 ts_tablet_manager.cc:1434] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:44.238827  8410 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:44.241293  8634 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.241747  8634 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.243229  8411 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:44.243649  8634 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:44.243673  8411 ts_tablet_manager.cc:1403] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.012s
I20260709 13:15:44.245064  8410 tablet_bootstrap.cc:654] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.245180  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.246503  8411 raft_consensus.cc:359] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.247201  8411 raft_consensus.cc:385] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.247493  8411 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.248411  8411 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.250746  8411 ts_tablet_manager.cc:1434] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:15:44.247702  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:44.252910  8220 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:44.253902  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:44.254964  8634 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.257315  8410 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.257786  8410 ts_tablet_manager.cc:1403] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 13:15:44.259536  8410 raft_consensus.cc:359] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.260003  8410 raft_consensus.cc:385] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.260288  8410 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.260852  8410 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.261430  8634 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.262478  8410 ts_tablet_manager.cc:1434] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:15:44.263449  8410 tablet_bootstrap.cc:492] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:44.263684  8411 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:44.239403  8292 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:44.265645  8183 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:44.266342  8451 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.266741  8451 raft_consensus.cc:697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:44.267402  8451 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.268946  8410 tablet_bootstrap.cc:654] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.269469  8411 tablet_bootstrap.cc:654] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.278693  8595 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.279182  8595 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.284550  8451 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.284986  8451 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.286243  8595 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.287719  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:44.293278  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.294718  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.295392  8292 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:44.296567  8451 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.296226  8118 catalog_manager.cc:5697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:44.294795  8183 leader_election.cc:343] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.291776  8366 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:44.297544  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:44.297995  8183 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:44.298987  8595 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.299351  8595 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:44.299420  8186 leader_election.cc:343] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.299743  8595 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.299886  8186 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:44.301211  8451 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.303745  8410 tablet_bootstrap.cc:492] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.305485  8410 ts_tablet_manager.cc:1403] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 13:15:44.305619  8411 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:44.306036  8411 ts_tablet_manager.cc:1403] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.007s
I20260709 13:15:44.308228  8410 raft_consensus.cc:359] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.308418  8411 raft_consensus.cc:359] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.309087  8410 raft_consensus.cc:385] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.309139  8411 raft_consensus.cc:385] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.309446  8410 raft_consensus.cc:740] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.310230  8410 consensus_queue.cc:260] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.312513  8410 ts_tablet_manager.cc:1434] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:44.313532  8410 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:44.309475  8411 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.316955  8411 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.318832  8411 ts_tablet_manager.cc:1434] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:15:44.319418  8411 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:44.323093  8687 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.323673  8410 tablet_bootstrap.cc:654] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.323557  8687 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.324750  8411 tablet_bootstrap.cc:654] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.327077  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:44.327247  8687 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.327724  8217 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:44.329125  8258 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:44.330251  8654 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.330518  8654 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.330842  8654 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.334151  8409 tablet_bootstrap.cc:492] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:44.334857  8409 ts_tablet_manager.cc:1403] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.197s	user 0.011s	sys 0.043s
I20260709 13:15:44.336634  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:44.337824  8261 leader_election.cc:343] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.354135  8634 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:15:44.355571  8411 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:44.359760  8411 ts_tablet_manager.cc:1403] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.008s
I20260709 13:15:44.340027  8595 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.365362  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:44.368837  8411 raft_consensus.cc:359] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.369495  8411 raft_consensus.cc:385] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.369735  8411 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.370438  8411 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.366072  8294 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.372821  8451 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.373248  8451 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.374989  8451 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.375604  8411 ts_tablet_manager.cc:1434] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:44.377310  8411 tablet_bootstrap.cc:492] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:44.381070  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:44.381819  8451 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.382404  8451 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:44.386014  8186 leader_election.cc:343] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.392606  8451 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.399291  8411 tablet_bootstrap.cc:654] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.400408  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:44.401062  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.401927  8292 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:44.401960  8635 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:44.403478  8186 leader_election.cc:343] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.406436  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.407815  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:44.409341  8451 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.409786  8451 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.410166  8451 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.436160  8294 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:44.456457  8635 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.457154  8635 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.460238  8411 tablet_bootstrap.cc:492] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:44.460752  8411 ts_tablet_manager.cc:1403] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.084s	user 0.025s	sys 0.041s
I20260709 13:15:44.462221  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:44.463497  8411 raft_consensus.cc:359] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.464435  8411 raft_consensus.cc:385] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.464802  8411 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.464596  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.465761  8290 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:44.465608  8411 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.467191  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:44.468238  8634 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.471943  8411 ts_tablet_manager.cc:1434] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.003s
I20260709 13:15:44.459793  8635 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:44.472957  8411 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:44.479171  8411 tablet_bootstrap.cc:654] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.490597  8634 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.342262  8409 raft_consensus.cc:359] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.509043  8409 raft_consensus.cc:385] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.509306  8409 raft_consensus.cc:740] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.509925  8409 consensus_queue.cc:260] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.510881  8510 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.511445  8409 ts_tablet_manager.cc:1434] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.176s	user 0.003s	sys 0.002s
I20260709 13:15:44.511297  8510 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.512329  8292 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:44.512817  8409 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:44.513280  8510 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.520658  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:44.356992  8654 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.522768  8409 tablet_bootstrap.cc:654] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.524578  8183 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:44.525794  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:44.526348  8691 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.526583  8692 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.527269  8549 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.527632  8549 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.527967  8549 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.526572  8418 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.530452  8418 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.526835  8691 raft_consensus.cc:697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:44.531800  8691 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.534578  8549 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.535050  8595 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.537045  8418 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:44.538111  8549 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.538632  8654 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.538482  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:44.539290  8217 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:44.540611  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:44.541594  8418 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.542006  8418 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.542497  8418 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.542048  8451 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.549500  8410 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.549966  8410 ts_tablet_manager.cc:1403] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.237s	user 0.079s	sys 0.109s
I20260709 13:15:44.551355  8451 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.552657  8410 raft_consensus.cc:359] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.553328  8410 raft_consensus.cc:385] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.553582  8410 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.554173  8410 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.555792  8411 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:44.552333  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.556347  8411 ts_tablet_manager.cc:1403] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.027s
I20260709 13:15:44.558323  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:44.559399  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:44.559937  8363 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.561324  8218 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.565128  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:44.566041  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:44.566219  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:44.566388  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:44.566707  8366 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.568511  8510 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.571906  8451 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:44.577337  8186 leader_election.cc:343] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:44.578078  8258 leader_election.cc:343] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.579154  8451 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.558379  8332 leader_election.cc:343] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.579592  8451 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.580816  8118 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.581691  8451 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.582504  8410 ts_tablet_manager.cc:1434] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:44.583429  8410 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
W20260709 13:15:44.589917  8186 leader_election.cc:343] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.588960  8410 tablet_bootstrap.cc:654] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.595983  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:44.596830  8368 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:44.597958  8186 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:44.599370  8451 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.599676  8451 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.599959  8451 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.600078  8218 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:44.601454  8258 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:44.602202  8654 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.602648  8654 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:44.602736  8411 raft_consensus.cc:359] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.603638  8411 raft_consensus.cc:385] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.603459  8654 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:44.614951  8261 leader_election.cc:343] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.615516  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:44.616163  8510 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.616762  8451 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.617338  8510 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:44.618798  8261 leader_election.cc:343] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.604004  8411 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.620574  8411 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.627414  8451 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.627724  8418 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.630944  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:44.631508  8367 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.633268  8418 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:44.636188  8411 ts_tablet_manager.cc:1434] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:15:44.636353  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:44.637171  8411 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
W20260709 13:15:44.637593  8332 leader_election.cc:343] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.638316  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:44.638866  8218 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.657404  8366 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:44.657673  8723 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.666253  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:44.667049  8292 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.667732  8367 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:44.668785  8186 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:44.668866  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:44.671197  8594 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.674440  8409 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:44.675226  8409 ts_tablet_manager.cc:1403] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.163s	user 0.045s	sys 0.041s
I20260709 13:15:44.658201  8723 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.672636  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.669488  8289 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.678706  8287 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:44.672971  8594 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:44.684594  8594 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.679950  8634 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.696375  8634 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.691015  8367 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:44.691282  8218 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:44.692456  8118 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.690348  8595 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.697624  8367 pending_rounds.cc:85] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 1
I20260709 13:15:44.700603  8367 pending_rounds.cc:107] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:44.700982  8367 raft_consensus.cc:2889] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:44.707777  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:15:44.703724  8692 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:15:44.709229  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:44.710417  8635 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.712766  8635 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:44.714072  8634 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:44.713706  8635 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.708722  8290 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:44.715796  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.716428  8293 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:44.716794  8288 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.717666  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:44.718442  8418 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:44.720795  8418 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.721493  8418 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.724884  8723 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:44.727779  8410 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:44.728195  8410 ts_tablet_manager.cc:1403] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.145s	user 0.022s	sys 0.004s
I20260709 13:15:44.731236  8292 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:44.739899  8418 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.744099  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:44.745036  8411 tablet_bootstrap.cc:654] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.746551  8418 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:44.751005  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:44.740931  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:44.752880  8293 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:44.752617  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:44.754142  8409 raft_consensus.cc:359] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.755751  8409 raft_consensus.cc:385] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.756033  8409 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.755055  8410 raft_consensus.cc:359] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.758397  8410 raft_consensus.cc:385] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.758656  8410 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.759047  8409 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.766495  8288 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:44.769090  8451 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:44.768546  8410 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.777352  8409 ts_tablet_manager.cc:1434] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 13:15:44.778373  8409 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:44.758044  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:44.782291  8723 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:44.780871  8186 leader_election.cc:343] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.768690  8549 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:15:44.817487  8410 ts_tablet_manager.cc:1434] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.002s
I20260709 13:15:44.809684  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.812685  8723 raft_consensus.cc:697] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:44.833492  8723 consensus_queue.cc:237] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.865851  8410 tablet_bootstrap.cc:492] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:44.935923  8687 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.979118  8418 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.979709  8418 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:44.980969  8289 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:44.991742  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:44.992594  8216 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:44.999615  8418 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:45.013160  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:44.978421  8687 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.015792  8687 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:45.014094  8288 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:15:45.053625  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 77448.6us
I20260709 13:15:45.056620  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:45.066175  8368 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 13:15:45.066684  8183 leader_election.cc:343] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.067178  8183 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:45.069170  8410 tablet_bootstrap.cc:654] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.069823  8451 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.062331  8742 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.087214  8409 tablet_bootstrap.cc:654] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.089525  8737 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:15:45.076671  8293 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:15:45.096958  8294 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:45.097735  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:45.099256  8418 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:45.093189  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:45.104662  8411 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:45.105122  8411 ts_tablet_manager.cc:1403] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.468s	user 0.032s	sys 0.040s
I20260709 13:15:45.103870  8692 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.120018  8411 raft_consensus.cc:359] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.129925  8411 raft_consensus.cc:385] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.130352  8411 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.121343  8595 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.135043  8736 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:15:45.136910  8736 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:45.131271  8411 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.135319  8595 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.113544  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:45.152781  8418 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:45.121142  8692 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:45.156162  8418 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.161688  8411 ts_tablet_manager.cc:1434] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:15:45.162647  8411 tablet_bootstrap.cc:492] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:45.140184  8736 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:15:45.168429  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44839.2us
I20260709 13:15:45.177139  8287 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:45.186887  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 47380.5us
I20260709 13:15:45.178766  8218 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:15:45.173489  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:45.167140  8549 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:15:45.165666  8692 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.283795  8742 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:45.285756  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51514.4us
I20260709 13:15:45.287716  8687 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.308977  8409 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:45.309525  8409 ts_tablet_manager.cc:1403] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.531s	user 0.011s	sys 0.016s
I20260709 13:15:45.312484  8595 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:45.332828  8723 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.337363  8409 raft_consensus.cc:359] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.338191  8409 raft_consensus.cc:385] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.338478  8409 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.339046  8411 tablet_bootstrap.cc:654] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.339139  8410 tablet_bootstrap.cc:492] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:45.339669  8410 ts_tablet_manager.cc:1403] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.474s	user 0.025s	sys 0.021s
I20260709 13:15:45.342216  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:45.342686  8410 raft_consensus.cc:359] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.343326  8410 raft_consensus.cc:385] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.343590  8410 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.339180  8409 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.345041  8749 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.372881  8292 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:45.376338  8410 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.378000  8410 ts_tablet_manager.cc:1434] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 13:15:45.380075  8410 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
W20260709 13:15:45.381136  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:45.383700  8362 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.389909  8116 catalog_manager.cc:5697] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.393225  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:45.394321  8409 ts_tablet_manager.cc:1434] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.002s
I20260709 13:15:45.394341  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:45.397598  8654 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.399475  8409 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
W20260709 13:15:45.401635  8757 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:15:45.402927  8742 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.379386  8736 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.412001  8736 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.415608  8744 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.415143  8115 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.420542  8549 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.420727  8742 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.421446  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:45.425187  8723 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.427032  8723 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.427322  8367 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:15:45.427393  8723 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:45.446313  8186 leader_election.cc:343] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.459136  8451 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:45.460246  8186 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:45.448997  8691 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:45.482930  8409 tablet_bootstrap.cc:654] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.495203  8411 tablet_bootstrap.cc:492] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:45.495702  8411 ts_tablet_manager.cc:1403] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.333s	user 0.021s	sys 0.019s
I20260709 13:15:45.505508  8410 tablet_bootstrap.cc:654] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.510308  8411 raft_consensus.cc:359] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.519309  8411 raft_consensus.cc:385] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.519691  8411 raft_consensus.cc:740] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.524562  8411 consensus_queue.cc:260] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.548966  8411 ts_tablet_manager.cc:1434] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.004s
W20260709 13:15:45.550048  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 87908.9us
W20260709 13:15:45.549396  8395 tablet.cc:2406] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:45.556838  8411 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:45.601840  8409 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:45.602272  8409 ts_tablet_manager.cc:1403] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.203s	user 0.016s	sys 0.012s
I20260709 13:15:45.602245  8723 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.604717  8723 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:45.612694  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:45.613348  8291 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:45.616580  8765 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:15:45.640766  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:15:45.660218  8766 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 13:15:45.668622  8409 raft_consensus.cc:359] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.673981  8411 tablet_bootstrap.cc:654] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.686225  8409 raft_consensus.cc:385] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.686816  8409 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.688856  8409 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:45.693936  8186 leader_election.cc:343] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.703565  8409 ts_tablet_manager.cc:1434] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.002s
I20260709 13:15:45.700634  8737 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.707232  8737 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.713415  8737 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:45.704344  8691 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:15:45.718446  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:45.722280  8186 leader_election.cc:343] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.724534  8216 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:15:45.725015  8216 pending_rounds.cc:85] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 0
I20260709 13:15:45.725299  8216 pending_rounds.cc:107] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:15:45.725648  8216 raft_consensus.cc:2889] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:45.725193  8291 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:45.734048  8409 tablet_bootstrap.cc:492] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:45.731920  8571 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:45.744738  8410 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:45.745324  8410 ts_tablet_manager.cc:1403] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.366s	user 0.025s	sys 0.023s
I20260709 13:15:45.748489  8410 raft_consensus.cc:359] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.749013  8410 raft_consensus.cc:385] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.749171  8410 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.749229  8409 tablet_bootstrap.cc:654] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.749778  8410 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.751487  8410 ts_tablet_manager.cc:1434] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:45.752406  8410 tablet_bootstrap.cc:492] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:45.752933  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:45.754222  8737 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.754772  8737 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:45.755856  8737 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.748195  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:45.766203  8411 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:45.766844  8411 ts_tablet_manager.cc:1403] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.210s	user 0.021s	sys 0.004s
I20260709 13:15:45.770654  8363 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:45.772276  8183 leader_election.cc:343] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.773164  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:45.778595  8692 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.815721  8771 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.818351  8731 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.819588  8771 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.863368  8731 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.870900  8771 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:45.877815  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:15:45.879499  8183 leader_election.cc:343] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.921124  8409 tablet_bootstrap.cc:492] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:45.921619  8409 ts_tablet_manager.cc:1403] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.190s	user 0.013s	sys 0.005s
I20260709 13:15:45.924288  8731 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:45.926066  8291 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:45.927763  8410 tablet_bootstrap.cc:654] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.930071  8411 raft_consensus.cc:359] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.930756  8411 raft_consensus.cc:385] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.931025  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:45.931006  8411 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.934912  8411 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.929394  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:45.936278  8368 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:45.939126  8261 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:45.941274  8411 ts_tablet_manager.cc:1434] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.174s	user 0.027s	sys 0.039s
I20260709 13:15:45.944628  8411 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
W20260709 13:15:45.945927  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 65607.6us
I20260709 13:15:45.947233  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:45.947835  8220 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:45.948092  8409 raft_consensus.cc:359] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.948774  8409 raft_consensus.cc:385] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.949018  8409 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.949678  8409 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:45.953837  8118 catalog_manager.cc:5697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:15:45.958763  8409 ts_tablet_manager.cc:1434] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 13:15:45.958480  8118 catalog_manager.cc:5697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:15:45.960953  8409 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:45.963876  8734 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:45.965617  8186 leader_election.cc:343] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.966099  8186 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:45.965659  8734 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.966943  8734 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.972115  8771 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.984407  8418 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.996161  8742 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:15:45.996768  8742 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.016649  8771 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:46.023739  8411 tablet_bootstrap.cc:654] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.009227  8734 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.024999  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:46.020080  8742 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:46.026388  8409 tablet_bootstrap.cc:654] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.027410  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:46.034894  8116 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.026633  8410 tablet_bootstrap.cc:492] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:46.043646  8410 ts_tablet_manager.cc:1403] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.292s	user 0.014s	sys 0.005s
I20260709 13:15:46.038367  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:46.044512  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:46.044766  8742 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.045111  8218 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.046096  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:46.039217  8116 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:15:46.046638  8362 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.051991  8734 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.056360  8410 raft_consensus.cc:359] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.058723  8410 raft_consensus.cc:385] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.059092  8410 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.084506  8218 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:46.085901  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:46.086669  8687 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.087096  8687 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:46.087383  8362 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:46.087911  8687 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.073072  8410 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.094772  8410 ts_tablet_manager.cc:1434] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:15:46.095721  8410 tablet_bootstrap.cc:492] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:46.117048  8409 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:46.117527  8409 ts_tablet_manager.cc:1403] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.157s	user 0.006s	sys 0.016s
I20260709 13:15:46.117909  8411 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.118387  8411 ts_tablet_manager.cc:1403] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.174s	user 0.020s	sys 0.018s
I20260709 13:15:46.120158  8409 raft_consensus.cc:359] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.120829  8409 raft_consensus.cc:385] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.121089  8409 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.121878  8411 raft_consensus.cc:359] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.122493  8411 raft_consensus.cc:385] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.122731  8411 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.123353  8411 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.125121  8411 ts_tablet_manager.cc:1434] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:46.121757  8409 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.126003  8410 tablet_bootstrap.cc:654] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.126582  8409 ts_tablet_manager.cc:1434] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:15:46.127533  8409 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:46.136070  8409 tablet_bootstrap.cc:654] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.138195  8116 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.142096  8411 tablet_bootstrap.cc:492] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:46.153839  8411 tablet_bootstrap.cc:654] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.155637  8409 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:46.156101  8409 ts_tablet_manager.cc:1403] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.007s
I20260709 13:15:46.156852  8410 tablet_bootstrap.cc:492] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:46.157502  8410 ts_tablet_manager.cc:1403] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.062s	user 0.030s	sys 0.009s
I20260709 13:15:46.161068  8410 raft_consensus.cc:359] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.162061  8410 raft_consensus.cc:385] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.158542  8409 raft_consensus.cc:359] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.162510  8410 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.162907  8409 raft_consensus.cc:385] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.163200  8409 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.163830  8410 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.167143  8410 ts_tablet_manager.cc:1434] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:46.163800  8409 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.180598  8737 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.181084  8737 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.182966  8737 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.186180  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:46.186800  8291 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:46.188417  8183 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:46.189252  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:46.189635  8771 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.190016  8771 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.190337  8771 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.194157  8409 ts_tablet_manager.cc:1434] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.002s
W20260709 13:15:46.194738  8186 leader_election.cc:343] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.212229  8409 tablet_bootstrap.cc:492] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:46.221980  8411 tablet_bootstrap.cc:492] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.222497  8410 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:46.222597  8411 ts_tablet_manager.cc:1403] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.081s	user 0.030s	sys 0.035s
I20260709 13:15:46.217412  8737 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:46.219400  8771 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.229661  8411 raft_consensus.cc:359] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.230540  8411 raft_consensus.cc:385] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.230903  8411 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.231731  8411 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.234458  8411 ts_tablet_manager.cc:1434] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:15:46.235774  8409 tablet_bootstrap.cc:654] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.237582  8411 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:46.244280  8411 tablet_bootstrap.cc:654] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.245239  8771 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.245934  8410 tablet_bootstrap.cc:654] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.249429  8411 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.249871  8411 ts_tablet_manager.cc:1403] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.013s	user 0.001s	sys 0.008s
I20260709 13:15:46.250095  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:46.250659  8287 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.253535  8411 raft_consensus.cc:359] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.254407  8411 raft_consensus.cc:385] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.255609  8369 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.255411  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:46.256206  8363 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.258807  8410 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:46.259297  8410 ts_tablet_manager.cc:1403] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.010s
I20260709 13:15:46.262768  8410 raft_consensus.cc:359] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.263453  8410 raft_consensus.cc:385] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.263489  8409 tablet_bootstrap.cc:492] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:46.263873  8410 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.265029  8410 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.266232  8287 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:46.266803  8363 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:46.254730  8411 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.267518  8183 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:46.268018  8411 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.268430  8737 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.269165  8409 ts_tablet_manager.cc:1403] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.004s
I20260709 13:15:46.270287  8411 ts_tablet_manager.cc:1434] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:15:46.271011  8411 tablet_bootstrap.cc:492] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:46.271656  8409 raft_consensus.cc:359] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.272599  8409 raft_consensus.cc:385] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.272891  8409 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.272658  8771 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:46.274569  8409 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.277341  8409 ts_tablet_manager.cc:1434] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:46.279477  8410 ts_tablet_manager.cc:1434] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:15:46.280472  8410 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:46.280717  8411 tablet_bootstrap.cc:654] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.286233  8410 tablet_bootstrap.cc:654] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.286669  8409 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:46.289147  8737 raft_consensus.cc:697] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:46.293206  8409 tablet_bootstrap.cc:654] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.292740  8737 consensus_queue.cc:237] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.295169  8411 tablet_bootstrap.cc:492] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.295572  8411 ts_tablet_manager.cc:1403] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.002s
I20260709 13:15:46.298038  8411 raft_consensus.cc:359] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.298631  8411 raft_consensus.cc:385] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.298887  8411 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.299710  8411 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.301631  8411 ts_tablet_manager.cc:1434] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:46.302659  8411 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:46.309178  8411 tablet_bootstrap.cc:654] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.316406  8410 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:46.322363  8410 ts_tablet_manager.cc:1403] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.005s
I20260709 13:15:46.327128  8410 raft_consensus.cc:359] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.328123  8410 raft_consensus.cc:385] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.328487  8410 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.329315  8410 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.333408  8410 ts_tablet_manager.cc:1434] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:46.334354  8410 tablet_bootstrap.cc:492] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:46.335611  8411 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.336082  8411 ts_tablet_manager.cc:1403] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.013s
I20260709 13:15:46.338650  8411 raft_consensus.cc:359] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.339294  8411 raft_consensus.cc:385] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.339552  8411 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.340271  8410 tablet_bootstrap.cc:654] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.340188  8411 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.342244  8411 ts_tablet_manager.cc:1434] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:46.343284  8411 tablet_bootstrap.cc:492] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:46.350862  8411 tablet_bootstrap.cc:654] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.363621  8411 tablet_bootstrap.cc:492] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.365147  8411 ts_tablet_manager.cc:1403] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 13:15:46.368302  8411 raft_consensus.cc:359] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.369073  8411 raft_consensus.cc:385] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.369360  8411 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.370070  8411 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.379639  8687 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.380328  8411 ts_tablet_manager.cc:1434] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:46.380179  8687 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.382254  8687 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.383515  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:46.383536  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:46.384351  8363 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:46.384359  8218 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:46.385658  8258 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:46.386390  8687 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.386726  8687 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.387043  8687 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.395535  8411 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:46.390066  8115 catalog_manager.cc:5697] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.404991  8687 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.407939  8411 tablet_bootstrap.cc:654] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.408174  8410 tablet_bootstrap.cc:492] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:46.408084  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:46.408699  8410 ts_tablet_manager.cc:1403] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.043s
I20260709 13:15:46.408800  8218 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.411471  8410 raft_consensus.cc:359] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.412563  8410 raft_consensus.cc:385] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.412907  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:46.413642  8363 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.423985  8363 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:46.425436  8261 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:46.426347  8734 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.426703  8218 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:46.428140  8687 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.429241  8409 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:46.426949  8734 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:46.432116  8409 ts_tablet_manager.cc:1403] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.146s	user 0.050s	sys 0.020s
I20260709 13:15:46.433025  8734 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.412892  8410 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.439131  8410 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.443625  8410 ts_tablet_manager.cc:1434] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:15:46.444586  8410 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:46.451921  8687 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.445472  8409 raft_consensus.cc:359] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.452637  8409 raft_consensus.cc:385] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.452438  8687 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.453023  8409 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.453998  8409 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.459441  8409 ts_tablet_manager.cc:1434] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:15:46.460419  8409 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:46.461385  8687 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.459465  8411 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.464290  8411 ts_tablet_manager.cc:1403] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.036s
I20260709 13:15:46.465878  8409 tablet_bootstrap.cc:654] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.466784  8411 raft_consensus.cc:359] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.467447  8411 raft_consensus.cc:385] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.467710  8411 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.468302  8411 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.468783  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:46.469384  8218 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:46.469678  8411 ts_tablet_manager.cc:1434] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:46.470352  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:46.472599  8654 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.470538  8411 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:46.472944  8654 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.473331  8654 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.476527  8571 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.476987  8571 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.478088  8411 tablet_bootstrap.cc:654] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.478863  8571 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:46.481920  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:46.482524  8291 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:46.481920  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:46.484009  8217 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:46.484567  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:46.489260  8744 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:46.492771  8571 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.493223  8571 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.504886  8571 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.527046  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:46.641976  8410 tablet_bootstrap.cc:654] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.655376  8409 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:46.655958  8409 ts_tablet_manager.cc:1403] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.011s
I20260709 13:15:46.656908  8411 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.657449  8411 ts_tablet_manager.cc:1403] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.187s	user 0.020s	sys 0.026s
I20260709 13:15:46.663864  8116 catalog_manager.cc:5697] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.677080  8635 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.653718  8654 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:46.682356  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:46.658548  8771 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.691452  8654 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.686154  8771 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.694274  8771 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.686988  8571 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.697256  8571 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:46.709585  8654 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.713397  8411 raft_consensus.cc:359] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.713626  8654 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.714102  8411 raft_consensus.cc:385] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.714371  8411 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.714960  8411 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.715514  8654 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.683305  8635 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.734218  8635 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:46.722863  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:46.736698  8218 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.728411  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:46.729399  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:15:46.741725  8261 leader_election.cc:343] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.773432  8411 ts_tablet_manager.cc:1434] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.000s
I20260709 13:15:46.777148  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:46.774655  8746 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.797851  8332 leader_election.cc:343] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.782130  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:46.775027  8362 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:46.803021  8411 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
W20260709 13:15:46.818998  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 101128us
I20260709 13:15:46.797142  8746 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.833732  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:46.850137  8216 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.859676  8410 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:46.860339  8410 ts_tablet_manager.cc:1403] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.416s	user 0.015s	sys 0.020s
I20260709 13:15:46.865352  8409 raft_consensus.cc:359] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.866264  8409 raft_consensus.cc:385] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.866618  8409 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
W20260709 13:15:46.869416  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 46946.6us
I20260709 13:15:46.869962  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:46.870697  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:46.873123  8218 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:46.873801  8411 tablet_bootstrap.cc:654] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.868530  8409 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:46.878486  8261 leader_election.cc:343] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.877292  8596 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.881557  8261 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:15:46.892102  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 65905us
I20260709 13:15:46.894506  8746 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:46.895875  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:46.897001  8216 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:46.896904  8596 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.897254  8409 ts_tablet_manager.cc:1434] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.241s	user 0.007s	sys 0.000s
I20260709 13:15:46.897203  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:46.904963  8596 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.897912  8217 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:46.879207  8687 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.917661  8410 raft_consensus.cc:359] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.918550  8410 raft_consensus.cc:385] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.918871  8410 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.891268  8286 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:46.917702  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:46.920650  8813 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:46.921154  8332 leader_election.cc:343] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.921646  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:46.922847  8742 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.923395  8742 raft_consensus.cc:697] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:46.923668  8687 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.924412  8742 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.924998  8293 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:46.926258  8687 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:46.919550  8410 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:46.934471  8571 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.950390  8734 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:46.950883  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:46.951506  8365 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:46.952421  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:46.953990  8410 ts_tablet_manager.cc:1434] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.000s
I20260709 13:15:46.954945  8410 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:46.954876  8261 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:46.955770  8744 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.956130  8744 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.956452  8744 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.958650  8411 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:46.959086  8411 ts_tablet_manager.cc:1403] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.009s
I20260709 13:15:46.962689  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:46.945571  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:46.965207  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:46.968106  8634 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.985734  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:46.969270  8824 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.970719  8287 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.994125  8183 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:46.985639  8634 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.995952  8634 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:46.994125  8186 leader_election.cc:343] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.002501  8411 raft_consensus.cc:359] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.003480  8411 raft_consensus.cc:385] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.003827  8411 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.005445  8731 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.010931  8410 tablet_bootstrap.cc:654] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.011046  8813 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.011442  8813 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.005429  8411 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.012779  8409 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:46.993448  8824 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:47.013893  8411 ts_tablet_manager.cc:1434] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:15:47.014235  8824 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.022167  8737 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.024549  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:47.028666  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:47.029349  8216 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
W20260709 13:15:47.033094  8183 leader_election.cc:343] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.033540  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:47.017714  8731 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.068218  8418 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.068732  8418 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.036798  8779 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.018750  8827 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.098032  8411 tablet_bootstrap.cc:492] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:47.095453  8827 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.121527  8827 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.129009  8418 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:47.136605  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:47.139489  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:15:47.141165  8332 leader_election.cc:343] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.145045  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:15:47.153841  8332 leader_election.cc:343] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.154259  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:47.155236  8418 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.154116  8409 tablet_bootstrap.cc:654] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:47.158414  8258 leader_election.cc:343] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.169957  8634 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.172770  8634 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:47.158957  8731 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.174014  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:47.175208  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:47.147840  8744 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.189989  8734 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.192480  8290 raft_consensus.cc:2393] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:47.192776  8744 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.193398  8813 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.197234  8823 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.195797  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:47.198488  8410 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:47.199514  8410 ts_tablet_manager.cc:1403] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.245s	user 0.028s	sys 0.022s
I20260709 13:15:47.204533  8813 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.204289  8749 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.208664  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:47.213406  8115 catalog_manager.cc:5697] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.215397  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:47.216362  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:47.217705  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:47.218537  8411 tablet_bootstrap.cc:654] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.194308  8216 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.239130  8363 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.272701  8364 raft_consensus.cc:2393] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:15:47.237649  8367 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 0.
I20260709 13:15:47.276211  8827 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.278247  8827 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.279814  8287 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:47.310840  8215 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:15:47.328229  8410 raft_consensus.cc:359] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.328966  8410 raft_consensus.cc:385] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.330394  8261 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:47.330845  8410 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.334448  8216 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:47.335983  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:15:47.336372  8410 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:47.341246  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 94757.5us
I20260709 13:15:47.340448  8261 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:47.343663  8824 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.344017  8824 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.344848  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:47.346692  8744 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.348349  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:47.349081  8293 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:47.346905  8634 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.350858  8634 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:47.351665  8634 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.344375  8824 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.356344  8409 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:47.358121  8409 ts_tablet_manager.cc:1403] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.346s	user 0.019s	sys 0.024s
I20260709 13:15:47.361615  8410 ts_tablet_manager.cc:1434] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.162s	user 0.003s	sys 0.016s
I20260709 13:15:47.367271  8411 tablet_bootstrap.cc:492] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:47.367776  8411 ts_tablet_manager.cc:1403] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.270s	user 0.023s	sys 0.020s
I20260709 13:15:47.375530  8183 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:47.381110  8411 raft_consensus.cc:359] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.382086  8411 raft_consensus.cc:385] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.382444  8411 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.384205  8411 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.386821  8779 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.386950  8411 ts_tablet_manager.cc:1434] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:15:47.391705  8411 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:47.395474  8409 raft_consensus.cc:359] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.397259  8409 raft_consensus.cc:385] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.397639  8409 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.399386  8410 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:47.398483  8409 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.408584  8418 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.409091  8418 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.414397  8409 ts_tablet_manager.cc:1434] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 13:15:47.419386  8418 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:47.419878  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:47.421960  8216 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:47.423292  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:47.427467  8418 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.429111  8418 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.430562  8418 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.441546  8411 tablet_bootstrap.cc:654] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.445629  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:47.450716  8409 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
W20260709 13:15:47.460508  8332 leader_election.cc:343] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.456599  8634 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:15:47.471830  8749 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.472486  8749 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.475122  8749 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.483494  8418 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.489271  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:47.489892  8410 tablet_bootstrap.cc:654] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.412736  8824 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.494916  8363 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:47.498701  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:47.500313  8261 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:15:47.501277  8183 leader_election.cc:343] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.503098  8824 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.506753  8818 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.507423  8818 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:15:47.509123  8186 leader_election.cc:343] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.509583  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:47.512158  8737 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.513901  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:47.515336  8818 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.518180  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:47.520140  8369 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.523662  8411 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:47.524192  8411 ts_tablet_manager.cc:1403] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.135s	user 0.035s	sys 0.015s
W20260709 13:15:47.524827  8258 leader_election.cc:343] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.525954  8635 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.534893  8409 tablet_bootstrap.cc:654] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.535204  8369 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:15:47.539615  8411 raft_consensus.cc:359] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.540189  8411 raft_consensus.cc:385] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.541822  8411 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.542250  8261 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:47.542690  8411 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.545063  8411 ts_tablet_manager.cc:1434] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:47.546056  8411 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: Bootstrap starting.
I20260709 13:15:47.547494  8827 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.548189  8827 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.547401  8117 catalog_manager.cc:5697] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.550670  8827 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.550769  8418 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:47.555133  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:47.555758  8213 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.559190  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:47.561015  8363 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:47.565358  8213 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:47.555732  8411 tablet_bootstrap.cc:654] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.569947  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:47.573560  8411 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: No bootstrap required, opened a new log
I20260709 13:15:47.574162  8411 ts_tablet_manager.cc:1403] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:15:47.578728  8411 raft_consensus.cc:359] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.579424  8411 raft_consensus.cc:385] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.579689  8411 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.580370  8411 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.582680  8411 ts_tablet_manager.cc:1434] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:15:47.584156  8634 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.584949  8634 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:47.585943  8634 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.598876  8410 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:47.599366  8410 ts_tablet_manager.cc:1403] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.218s	user 0.007s	sys 0.011s
I20260709 13:15:47.602411  8410 raft_consensus.cc:359] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.603279  8410 raft_consensus.cc:385] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.603609  8410 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.604388  8813 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.604365  8410 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.605052  8813 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:15:47.606386  8410 ts_tablet_manager.cc:1434] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:47.607653  8410 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Bootstrap starting.
I20260709 13:15:47.605945  8813 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:15:47.611109  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 66095.1us
I20260709 13:15:47.613927  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:15:47.615365  8332 leader_election.cc:343] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.616541  8410 tablet_bootstrap.cc:654] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:47.622058  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 79892.1us
I20260709 13:15:47.622709  8409 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:47.627792  8409 ts_tablet_manager.cc:1403] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.177s	user 0.042s	sys 0.030s
I20260709 13:15:47.634119  8409 raft_consensus.cc:359] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.634881  8409 raft_consensus.cc:385] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.634828  8363 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.637796  8410 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: No bootstrap required, opened a new log
I20260709 13:15:47.637979  8186 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:47.638247  8410 ts_tablet_manager.cc:1403] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.015s
I20260709 13:15:47.638960  8596 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.639307  8596 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.639616  8596 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.641034  8410 raft_consensus.cc:359] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.641728  8410 raft_consensus.cc:385] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.641995  8410 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.642575  8410 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.643594  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:47.647441  8410 ts_tablet_manager.cc:1434] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:15:47.647125  8596 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.653743  8409 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.654531  8409 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.654907  8596 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.655510  8290 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:47.659447  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:47.660125  8409 ts_tablet_manager.cc:1434] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:15:47.660511  8290 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.661252  8409 tablet_bootstrap.cc:492] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:47.668118  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:47.669135  8363 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.674178  8117 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.676254  8363 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:47.677338  8734 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.686935  8737 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.687448  8737 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.688079  8813 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.684410  8290 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:47.689504  8737 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.696288  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:47.678040  8409 tablet_bootstrap.cc:654] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.693068  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:47.696959  8293 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:47.697103  8360 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 0.
I20260709 13:15:47.698685  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:47.699379  8737 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.699779  8737 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:47.700688  8737 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.701205  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:47.701926  8596 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.702314  8596 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.702656  8596 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.708310  8409 tablet_bootstrap.cc:492] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:47.708747  8409 ts_tablet_manager.cc:1403] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.003s
I20260709 13:15:47.709529  8596 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.711987  8596 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.715515  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:47.714146  8409 raft_consensus.cc:359] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.716166  8293 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.716482  8409 raft_consensus.cc:385] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.716779  8409 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.717375  8409 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.718763  8409 ts_tablet_manager.cc:1434] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:15:47.719627  8409 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Bootstrap starting.
I20260709 13:15:47.726467  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:15:47.726998  8369 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.731699  8409 tablet_bootstrap.cc:654] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.732421  8293 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:47.735559  8115 catalog_manager.cc:5697] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.738806  8369 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:15:47.738497  8115 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.740213  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:47.741003  8596 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.741534  8596 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:15:47.742499  8596 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.743878  8409 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: No bootstrap required, opened a new log
I20260709 13:15:47.744375  8409 ts_tablet_manager.cc:1403] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:15:47.750244  8409 raft_consensus.cc:359] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.750870  8409 raft_consensus.cc:385] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.751101  8409 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.751685  8409 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.754741  8409 ts_tablet_manager.cc:1434] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
W20260709 13:15:47.780489  8166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:47.780994  8116 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.782676  8116 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.794883  8734 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.795146  8634 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.795447  8734 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.797765  8734 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.798638  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:47.799360  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:47.800173  8217 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 1: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:15:47.800272  8117 catalog_manager.cc:5697] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.807614  8261 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:15:47.808446  8734 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.815449  8634 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.815820  8734 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.859236  8596 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.859742  8596 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.860222  8635 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.860702  8635 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.861696  8596 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:47.862752  8635 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:47.863396  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:15:47.864082  8369 raft_consensus.cc:2393] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 1: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:15:47.864347  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:15:47.864593  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:47.864933  8215 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:47.866103  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:15:47.866704  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:15:47.867095  8635 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.867482  8635 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.867444  8293 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 0.
I20260709 13:15:47.868003  8635 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.868080  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:15:47.868845  8596 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.873034  8635 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.873493  8596 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.874675  8635 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:47.875257  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:15:47.875540  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:15:47.875771  8215 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.876154  8293 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.881068  8293 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:47.881361  8215 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:15:47.881863  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:15:47.882478  8635 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.882966  8635 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:15:47.883646  8635 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:15:47.893553  8115 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:48.004632  8734 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.030375  8734 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:48.099457  8821 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.103226  8734 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.112186  8737 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.118901  8734 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.169934  8737 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.170789  8742 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.186355  8821 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.198251  8742 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.278625  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:48.287065  8880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:48.288486  8883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:48.309607  8881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:48.310915  7076 server_base.cc:1061] running on GCE node
I20260709 13:15:48.313793  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:48.314054  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:48.314256  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783602948314241 us; error 0 us; skew 500 ppm
I20260709 13:15:48.314826  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:48.318496  7076 webserver.cc:533] Webserver started at http://127.6.233.4:35927/ using document root <none> and password file <none>
I20260709 13:15:48.319335  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:48.319717  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:48.320163  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:48.321517  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-3-root/instance:
uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
format_stamp: "Formatted at 2026-07-09 13:15:48 on dist-test-slave-sjgx"
I20260709 13:15:48.326277  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:15:48.330286  8888 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:48.331211  7076 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:48.331560  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-3-root
uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
format_stamp: "Formatted at 2026-07-09 13:15:48 on dist-test-slave-sjgx"
I20260709 13:15:48.331862  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:48.349176  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:48.350423  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:48.351636  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:48.354815  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:48.355103  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:48.355331  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:48.355476  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:48.377437  8742 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.397364  8634 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.606300  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.4:42491
I20260709 13:15:48.606568  8955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.4:42491 every 8 connection(s)
I20260709 13:15:48.611569  7076 auto_leader_rebalancer-test.cc:384] add a tserver: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:48.633119  8956 heartbeater.cc:344] Connected to a master server at 127.6.233.62:38939
I20260709 13:15:48.633553  8956 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:48.634402  8956 heartbeater.cc:507] Master 127.6.233.62:38939 requested a full tablet report, sending...
I20260709 13:15:48.636207  8116 ts_manager.cc:194] Registered new tserver with Master: d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:15:48.637492  8116 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32980
I20260709 13:15:48.866613  8213 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:48.872457  8363 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.873914  8737 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.874850  8293 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.876338  8737 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.881600  8821 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:48.884400  8363 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
W20260709 13:15:48.892383  8183 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fea6012070404ef6b810517d977625da. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:48.902921  8116 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.915968  8293 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:48.921283  8290 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:48.937853  8363 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.941907  8213 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.943399  8939 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.945149  8939 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:48.954656  8734 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:48.956202  8363 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
W20260709 13:15:48.957755  8258 consensus_peers.cc:597] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 509edc927d524436b819a0e96e615799. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:48.959444  8213 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:48.969425  8217 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:48.971750  8115 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:48.998724  8183 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3becc403d217418988bb94be41c015e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:48.998847  8363 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:48.999568  8290 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:49.000617  8737 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.002444  8737 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.011327  8827 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:49.012923  8293 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:49.016119  8369 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:49.030421  8117 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.033260  8217 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:15:49.043668  8183 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfe43428b7ca43928b7eeb8cce815e8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.043835  8369 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:49.044364  8293 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:49.045615  8596 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.046725  8827 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:49.057384  8821 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:49.058897  8293 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:49.064620  8363 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:49.075354  8115 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 2 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.390625  8982 ts_tablet_manager.cc:933] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:15:49.392298  8982 tablet_copy_client.cc:323] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:15:49.421245  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 3becc403d217418988bb94be41c015e9 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:15:49.421864  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 3becc403d217418988bb94be41c015e9 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-3becc403d217418988bb94be41c015e9
I20260709 13:15:49.429059  8230 tablet_copy_source_session.cc:215] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:49.429979  8986 ts_tablet_manager.cc:933] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:15:49.432396  8986 tablet_copy_client.cc:323] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:15:49.432945  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3becc403d217418988bb94be41c015e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:49.434516  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet cfe43428b7ca43928b7eeb8cce815e8d from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:15:49.435073  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet cfe43428b7ca43928b7eeb8cce815e8d from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-cfe43428b7ca43928b7eeb8cce815e8d
I20260709 13:15:49.441982  8230 tablet_copy_source_session.cc:215] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:49.444905  8986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe43428b7ca43928b7eeb8cce815e8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:49.451665  8982 tablet_copy_client.cc:806] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:49.452602  8982 tablet_copy_client.cc:670] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:49.456877  8982 tablet_copy_client.cc:538] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.461223  8986 tablet_copy_client.cc:806] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:49.461833  8986 tablet_copy_client.cc:670] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:49.465261  8986 tablet_copy_client.cc:538] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.466599  8982 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:49.473380  8986 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:49.504663  8982 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:49.505750  8982 tablet_bootstrap.cc:492] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:49.506446  8982 ts_tablet_manager.cc:1403] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.040s	user 0.027s	sys 0.005s
I20260709 13:15:49.510807  8982 raft_consensus.cc:359] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:49.511682  8982 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:49.512388  8982 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:49.520816  8956 heartbeater.cc:499] Master 127.6.233.62:38939 was elected leader, sending a full tablet report...
I20260709 13:15:49.522372  8982 ts_tablet_manager.cc:1434] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.008s
I20260709 13:15:49.524243  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-3becc403d217418988bb94be41c015e9 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:15:49.524705  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-3becc403d217418988bb94be41c015e9 on tablet 3becc403d217418988bb94be41c015e9 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:49.533313  8982 ts_tablet_manager.cc:933] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:15:49.543071  8988 ts_tablet_manager.cc:933] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:49.549676  8986 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:49.549752  8988 tablet_copy_client.cc:323] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:15:49.550659  8986 tablet_bootstrap.cc:492] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:49.551007  8982 tablet_copy_client.cc:323] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:15:49.551338  8986 ts_tablet_manager.cc:1403] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.078s	user 0.037s	sys 0.030s
I20260709 13:15:49.553089  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet fea6012070404ef6b810517d977625da from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:15:49.553656  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet fea6012070404ef6b810517d977625da from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-fea6012070404ef6b810517d977625da
I20260709 13:15:49.554294  8986 raft_consensus.cc:359] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:49.555220  8986 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:49.555914  8986 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:49.560608  8986 ts_tablet_manager.cc:1434] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:15:49.562638  8229 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-cfe43428b7ca43928b7eeb8cce815e8d received from {username='slave'} at 127.0.0.1:37896
I20260709 13:15:49.563078  8229 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-cfe43428b7ca43928b7eeb8cce815e8d on tablet cfe43428b7ca43928b7eeb8cce815e8d with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:49.565047  8230 tablet_copy_source_session.cc:215] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:49.568275  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 509edc927d524436b819a0e96e615799 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:15:49.568866  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 509edc927d524436b819a0e96e615799 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-509edc927d524436b819a0e96e615799
I20260709 13:15:49.569696  8982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea6012070404ef6b810517d977625da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:49.576709  8305 tablet_copy_source_session.cc:215] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:49.580215  8988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509edc927d524436b819a0e96e615799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:49.590811  8982 tablet_copy_client.cc:806] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:49.591434  8982 tablet_copy_client.cc:670] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:49.596355  8982 tablet_copy_client.cc:538] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.597039  8988 tablet_copy_client.cc:806] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:49.597599  8988 tablet_copy_client.cc:670] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:49.601370  8988 tablet_copy_client.cc:538] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:49.603803  8982 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:49.610131  8988 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:49.692483  8988 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:49.693173  8988 tablet_bootstrap.cc:492] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:49.693732  8988 ts_tablet_manager.cc:1403] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.008s
I20260709 13:15:49.694103  8982 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:49.695014  8982 tablet_bootstrap.cc:492] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:49.695644  8982 ts_tablet_manager.cc:1403] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.092s	user 0.036s	sys 0.050s
I20260709 13:15:49.696497  8988 raft_consensus.cc:359] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:49.697146  8988 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:49.697652  8988 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:49.699661  8988 ts_tablet_manager.cc:1434] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:49.698369  8982 raft_consensus.cc:359] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:49.700901  8982 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:49.701290  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-509edc927d524436b819a0e96e615799 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:15:49.701732  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-509edc927d524436b819a0e96e615799 on tablet 509edc927d524436b819a0e96e615799 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:49.702309  8982 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:49.704587  8982 ts_tablet_manager.cc:1434] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:15:49.706491  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-fea6012070404ef6b810517d977625da received from {username='slave'} at 127.0.0.1:37896
I20260709 13:15:49.706897  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-fea6012070404ef6b810517d977625da on tablet fea6012070404ef6b810517d977625da with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:49.876123  8927 raft_consensus.cc:1217] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:49.905109  8927 raft_consensus.cc:1217] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:49.960124  8927 raft_consensus.cc:1217] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:15:49.967351  8927 raft_consensus.cc:1217] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:50.338886  8734 raft_consensus.cc:1064] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:50.341398  8734 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:50.348766  8363 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.349067  8821 raft_consensus.cc:1064] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:50.350100  8927 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.351501  8821 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:50.351997  8998 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.354683  8217 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.357967  8939 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.361740  8734 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.388747  8998 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.391935  8927 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.393359  8821 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.397544  8363 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.399264  8821 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.404950  8217 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.404978  8928 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.409116  8360 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.416630  8292 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.423933  8821 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.420588  8115 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.453904  8737 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.456271  8360 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.493448  9009 raft_consensus.cc:1064] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:50.497534  9009 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:15:50.498454  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 45648.3us
I20260709 13:15:50.507658  8292 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.510833  8928 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:15:50.517668  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 49587.8us
I20260709 13:15:50.527822  8821 raft_consensus.cc:1064] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:50.530679  8821 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:50.537041  8369 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.537997  8928 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.541373  8293 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:50.539863  9009 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.548173  8737 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.549499  8827 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.569511  9009 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.571471  8360 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.583135  8928 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.591900  8369 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:50.593456  8117 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.594146  8827 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:50.595368  8293 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:50.593991  8927 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:50.598867  9012 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.597980  8295 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:50.604032  9010 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:50.607036  8926 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.606547  8293 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.608520  8734 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.614935  8998 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.616612  8363 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.622206  8939 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.623953  8926 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.630779  8363 raft_consensus.cc:2955] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.631263  8115 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.637611  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 509edc927d524436b819a0e96e615799 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:50.647840  8117 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.663043  8213 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:50.671972  8213 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:50.677673  8290 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.679193  8821 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.681325  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 509edc927d524436b819a0e96e615799 with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:15:50.684010  8369 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.687536  9012 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.690799  8926 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.698818  8827 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.698446  9012 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.704087  8928 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:50.705323  8821 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.705334  8926 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.700879  9025 tablet_replica.cc:333] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:15:50.712342  9025 raft_consensus.cc:2243] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.714618  9025 raft_consensus.cc:2272] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.712824  9009 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.715301  8295 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.718648  8737 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.722146  8292 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.723495  8115 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.727108  8928 raft_consensus.cc:2955] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.731251  8927 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.734993  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet fea6012070404ef6b810517d977625da with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:15:50.736136  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fea6012070404ef6b810517d977625da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:50.740499  8363 raft_consensus.cc:2955] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.747670  9025 ts_tablet_manager.cc:1916] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:50.767680  9026 tablet_replica.cc:333] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:15:50.768779  9026 raft_consensus.cc:2243] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.771273  9026 raft_consensus.cc:2272] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.773326  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3becc403d217418988bb94be41c015e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:50.782303  8115 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.812629  8116 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.816596  9026 ts_tablet_manager.cc:1916] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:50.822232  8369 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:15:50.835805  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 49722.2us
I20260709 13:15:50.848260  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 3becc403d217418988bb94be41c015e9 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:15:50.853551  9025 ts_tablet_manager.cc:1929] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:50.872303  9025 log.cc:1199] T 509edc927d524436b819a0e96e615799 P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/509edc927d524436b819a0e96e615799
I20260709 13:15:50.878069  9026 ts_tablet_manager.cc:1929] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:50.878010  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 509edc927d524436b819a0e96e615799 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:50.879279  9026 log.cc:1199] T fea6012070404ef6b810517d977625da P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/fea6012070404ef6b810517d977625da
I20260709 13:15:50.880919  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet fea6012070404ef6b810517d977625da (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:50.889848  9028 tablet_replica.cc:333] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:15:50.890931  9028 raft_consensus.cc:2243] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.892117  9028 raft_consensus.cc:2272] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.895676  9028 ts_tablet_manager.cc:1916] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:50.897149  8215 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:50.903841  8926 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:50.905145  8821 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.908339  8363 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:50.909511  8821 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:50.914444  8827 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.915997  8926 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.920639  9028 ts_tablet_manager.cc:1929] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:50.921135  9028 log.cc:1199] T 3becc403d217418988bb94be41c015e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/3becc403d217418988bb94be41c015e9
I20260709 13:15:50.921489  8363 raft_consensus.cc:2955] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.922991  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 3becc403d217418988bb94be41c015e9 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:50.924448  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfe43428b7ca43928b7eeb8cce815e8d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:50.932353  8116 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 2 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:50.945984  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet cfe43428b7ca43928b7eeb8cce815e8d with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:15:50.946936  9026 tablet_replica.cc:333] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:15:50.947996  9026 raft_consensus.cc:2243] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:50.948712  9026 raft_consensus.cc:2272] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:50.952653  9026 ts_tablet_manager.cc:1916] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:50.962479  9026 ts_tablet_manager.cc:1929] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:15:50.962747  9026 log.cc:1199] T cfe43428b7ca43928b7eeb8cce815e8d P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/cfe43428b7ca43928b7eeb8cce815e8d
I20260709 13:15:50.963876  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet cfe43428b7ca43928b7eeb8cce815e8d (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:52.008447  8292 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.013784  8360 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:52.014155  8258 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b7f77585d3144b70a0f742dcd66411d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.014348  8215 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:52.015321  9031 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.016186  8998 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.025128  9027 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.029451  8215 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.033656  8360 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.044739  8292 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.046031  8116 catalog_manager.cc:5697] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.055109  8360 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:52.055655  8258 consensus_peers.cc:597] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a81beec7fc64c498918eb3ea356d2c7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.055117  8215 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:52.056697  9031 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.058235  9031 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.068369  9027 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.069758  8360 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.077319  8215 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.093752  8114 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.105580  8360 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.123303  8292 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:52.123564  8213 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:52.124702  8634 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.125684  9044 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:52.140027  8332 consensus_peers.cc:597] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47a3ff85da594e17a687e7c116983565. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.142549  9008 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.149230  8215 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.152673  8292 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.160611  8295 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.167953  8115 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.174813  8360 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:52.176852  8258 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: caf02b6ca7a34be9bbac5771e91f767a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.177340  8215 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:52.178577  9047 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.181067  9047 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.219717  8998 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.221235  8360 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.221688  8215 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.237216  8115 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:52.526891  9053 ts_tablet_manager.cc:933] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:52.528908  9053 tablet_copy_client.cc:323] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:15:52.530350  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 7a81beec7fc64c498918eb3ea356d2c7 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:15:52.530872  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 7a81beec7fc64c498918eb3ea356d2c7 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-7a81beec7fc64c498918eb3ea356d2c7
I20260709 13:15:52.538090  8305 tablet_copy_source_session.cc:215] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:52.540882  9053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81beec7fc64c498918eb3ea356d2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.554548  9053 tablet_copy_client.cc:806] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:52.555112  9053 tablet_copy_client.cc:670] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:52.558568  9053 tablet_copy_client.cc:538] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:52.564661  9055 ts_tablet_manager.cc:933] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:52.567046  9053 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:52.576843  9055 tablet_copy_client.cc:323] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:15:52.579078  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet b7f77585d3144b70a0f742dcd66411d0 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:15:52.579583  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet b7f77585d3144b70a0f742dcd66411d0 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-b7f77585d3144b70a0f742dcd66411d0
I20260709 13:15:52.588275  8305 tablet_copy_source_session.cc:215] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:52.592573  9055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f77585d3144b70a0f742dcd66411d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.599656  9053 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:52.600647  9053 tablet_bootstrap.cc:492] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:52.601306  9053 ts_tablet_manager.cc:1403] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.019s
I20260709 13:15:52.604867  9053 raft_consensus.cc:359] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.605770  9053 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:52.606487  9053 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.610594  9055 tablet_copy_client.cc:806] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:52.611395  9055 tablet_copy_client.cc:670] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:52.615547  9055 tablet_copy_client.cc:538] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:52.616089  9053 ts_tablet_manager.cc:1434] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 13:15:52.624199  9055 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:52.628587  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-7a81beec7fc64c498918eb3ea356d2c7 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:15:52.630283  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-7a81beec7fc64c498918eb3ea356d2c7 on tablet 7a81beec7fc64c498918eb3ea356d2c7 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:52.646764  9055 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:52.647800  9055 tablet_bootstrap.cc:492] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:52.648604  9055 ts_tablet_manager.cc:1403] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.001s
I20260709 13:15:52.649354  9053 ts_tablet_manager.cc:933] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:52.653656  9055 raft_consensus.cc:359] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.654927  9055 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:52.657079  9055 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.667840  9055 ts_tablet_manager.cc:1434] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:15:52.669044  9053 tablet_copy_client.cc:323] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:15:52.671097  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet caf02b6ca7a34be9bbac5771e91f767a from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:15:52.671599  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet caf02b6ca7a34be9bbac5771e91f767a from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-caf02b6ca7a34be9bbac5771e91f767a
I20260709 13:15:52.676753  8304 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-b7f77585d3144b70a0f742dcd66411d0 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:15:52.677145  8304 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-b7f77585d3144b70a0f742dcd66411d0 on tablet b7f77585d3144b70a0f742dcd66411d0 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:52.681588  8305 tablet_copy_source_session.cc:215] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:52.684419  9053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf02b6ca7a34be9bbac5771e91f767a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.697806  9053 tablet_copy_client.cc:806] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:52.698422  9053 tablet_copy_client.cc:670] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:52.702775  9053 tablet_copy_client.cc:538] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:52.709515  9053 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:52.711383  9055 ts_tablet_manager.cc:933] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:52.722222  9055 tablet_copy_client.cc:323] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:15:52.772797  8379 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 47a3ff85da594e17a687e7c116983565 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:15:52.773383  8379 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 47a3ff85da594e17a687e7c116983565 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-47a3ff85da594e17a687e7c116983565
I20260709 13:15:52.780997  8379 tablet_copy_source_session.cc:215] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:52.781965  9053 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:52.782974  9053 tablet_bootstrap.cc:492] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:52.783703  9053 ts_tablet_manager.cc:1403] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.002s
I20260709 13:15:52.784631  9055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a3ff85da594e17a687e7c116983565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:52.787330  9053 raft_consensus.cc:359] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.788383  9053 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:52.789239  9053 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.791726  9053 ts_tablet_manager.cc:1434] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:52.838918  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-caf02b6ca7a34be9bbac5771e91f767a received from {username='slave'} at 127.0.0.1:33926
I20260709 13:15:52.840138  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-caf02b6ca7a34be9bbac5771e91f767a on tablet caf02b6ca7a34be9bbac5771e91f767a with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:52.882778  9055 tablet_copy_client.cc:806] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:52.883567  9055 tablet_copy_client.cc:670] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:52.908090  9055 tablet_copy_client.cc:538] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:52.920616  9055 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:52.965401  9055 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:52.966375  9055 tablet_bootstrap.cc:492] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:52.967213  9055 ts_tablet_manager.cc:1403] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.047s	user 0.037s	sys 0.005s
I20260709 13:15:52.972842  9055 raft_consensus.cc:359] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.974432  9055 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:52.975423  9055 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:52.982828  8926 raft_consensus.cc:1217] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:52.988878  9055 ts_tablet_manager.cc:1434] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.008s
I20260709 13:15:52.990918  8379 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-47a3ff85da594e17a687e7c116983565 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:15:52.991457  8379 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-47a3ff85da594e17a687e7c116983565 on tablet 47a3ff85da594e17a687e7c116983565 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:53.126384  8926 raft_consensus.cc:1217] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:53.256559  8926 raft_consensus.cc:1217] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:53.340083  8926 raft_consensus.cc:1217] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:53.526655  9070 raft_consensus.cc:1064] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:53.529428  9070 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:53.536834  8926 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.537225  8360 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.538892  9069 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.539986  9047 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.545300  8213 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.547923  9070 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.562649  9075 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.563941  8360 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.579757  9069 raft_consensus.cc:1064] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:53.580350  8926 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.582921  8213 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.597364  8115 catalog_manager.cc:5697] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.601130  9069 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:53.635751  9075 raft_consensus.cc:1064] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:53.643297  9075 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:53.679507  8217 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.678771  8926 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.685266  9070 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:53.688400  9074 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.696911  8292 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:53.711985  8928 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:53.717722  8213 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:53.717811  9069 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:53.719841  9069 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:53.727337  9085 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.730856  8215 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.729156  8928 raft_consensus.cc:2955] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.733798  8360 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.751845  8116 catalog_manager.cc:5697] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.760408  9069 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:15:53.770594  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b7f77585d3144b70a0f742dcd66411d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:53.772503  8360 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.785188  9069 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.797365  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet b7f77585d3144b70a0f742dcd66411d0 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
W20260709 13:15:53.801568  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46771.7us
I20260709 13:15:53.806703  8215 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.810870  8928 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:53.811517  9075 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.829275  9069 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.830088  8928 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.839109  8213 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.842664  9091 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.861099  9095 tablet_replica.cc:333] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:15:53.865088  9095 raft_consensus.cc:2243] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:53.870221  9095 raft_consensus.cc:2272] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:53.865883  8369 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.873427  9091 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.871922  8115 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.876271  8363 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.904034  8928 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.911207  9095 ts_tablet_manager.cc:1916] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:53.923010  8295 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:53.902514  8215 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.937476  8360 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:53.937976  8926 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:53.938905  9091 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:53.939713  9075 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:53.947070  9044 raft_consensus.cc:1064] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:53.946630  9075 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.950191  8115 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.961984  8926 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.981076  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7a81beec7fc64c498918eb3ea356d2c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:53.966003  9044 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:53.981653  8369 raft_consensus.cc:2955] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:53.993685  8292 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:54.003113  8928 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:54.004546  9085 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:54.015851  8115 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.017824  8213 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:53.997469  9095 ts_tablet_manager.cc:1929] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:54.022832  9085 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:54.021543  9074 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.021530  9095 log.cc:1199] T b7f77585d3144b70a0f742dcd66411d0 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/b7f77585d3144b70a0f742dcd66411d0
I20260709 13:15:54.026922  8928 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.035286  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81beec7fc64c498918eb3ea356d2c7 with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:15:54.037097  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet caf02b6ca7a34be9bbac5771e91f767a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:54.037534  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet b7f77585d3144b70a0f742dcd66411d0 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:54.046550  8115 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:54.029422  8213 raft_consensus.cc:2955] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.064531  9098 tablet_replica.cc:333] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:15:54.065655  9098 raft_consensus.cc:2243] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.066449  9098 raft_consensus.cc:2272] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.075620  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet caf02b6ca7a34be9bbac5771e91f767a with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:15:54.076808  9095 tablet_replica.cc:333] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:15:54.078037  9095 raft_consensus.cc:2243] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.078845  9095 raft_consensus.cc:2272] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.087356  9095 ts_tablet_manager.cc:1916] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:54.088538  9098 ts_tablet_manager.cc:1916] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:54.104319  8926 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:54.104882  8295 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:54.106033  8213 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:54.106216  9008 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:54.110436  9044 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:54.114887  9095 ts_tablet_manager.cc:1929] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:54.115432  9095 log.cc:1199] T caf02b6ca7a34be9bbac5771e91f767a P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/caf02b6ca7a34be9bbac5771e91f767a
I20260709 13:15:54.117388  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet caf02b6ca7a34be9bbac5771e91f767a (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:54.118423  9100 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:15:54.131153  9098 ts_tablet_manager.cc:1929] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:54.131868  9098 log.cc:1199] T 7a81beec7fc64c498918eb3ea356d2c7 P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/7a81beec7fc64c498918eb3ea356d2c7
I20260709 13:15:54.135601  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 7a81beec7fc64c498918eb3ea356d2c7 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:54.142720  9008 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.148309  8926 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.151150  8217 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.169826  8115 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.173254  8295 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.191330  8369 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:54.196745  8926 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:54.196828  8295 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:54.198763  9101 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:54.199601  9008 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:54.206897  9008 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.208654  8926 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.210469  8295 raft_consensus.cc:2955] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.215806  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47a3ff85da594e17a687e7c116983565 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:54.224825  8115 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:54.274956  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 47a3ff85da594e17a687e7c116983565 with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:15:54.276089  9098 tablet_replica.cc:333] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:15:54.287331  9098 raft_consensus.cc:2243] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:54.288069  9098 raft_consensus.cc:2272] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:54.291205  9098 ts_tablet_manager.cc:1916] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:54.304399  9098 ts_tablet_manager.cc:1929] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:54.304735  9098 log.cc:1199] T 47a3ff85da594e17a687e7c116983565 P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/47a3ff85da594e17a687e7c116983565
I20260709 13:15:54.305979  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 47a3ff85da594e17a687e7c116983565 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:55.354538  8213 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:55.361064  8363 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:55.361970  8290 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:55.362076  8183 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b9006ab90a84d6fae17b6b86c0530b8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.362565  8737 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:55.363514  9106 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.371960  9068 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.374207  8363 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.376683  8290 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.387513  8369 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:55.394397  8115 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
W20260709 13:15:55.400476  8332 consensus_peers.cc:597] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46e06d1a840c4315837a871dc31b4497. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.401497  8213 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:55.402637  8290 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:55.403610  9101 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:55.410229  9110 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:15:55.414597  9101 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.417438  8217 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.438290  8293 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.444094  8217 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:15:55.461187  8183 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e9e53d1d8204518834e32e1ef952157. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.461750  8116 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.464953  8369 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:55.467726  8293 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:55.471683  8737 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.476691  9106 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.488356  9106 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.490687  8292 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.504415  8369 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:55.510864  8118 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.522534  8360 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
W20260709 13:15:55.525825  8332 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bded28881ef4440a713698e8088bd77. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.530607  8290 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:55.531145  8217 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:55.532269  9008 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.533860  9110 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.547966  9110 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.552186  8292 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.551978  8217 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.576188  8115 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:55.875414  9125 ts_tablet_manager.cc:933] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:55.899003  9127 ts_tablet_manager.cc:933] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:15:55.901640  9125 tablet_copy_client.cc:323] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:15:55.903615  8379 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 46e06d1a840c4315837a871dc31b4497 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:15:55.904181  8379 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 46e06d1a840c4315837a871dc31b4497 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-46e06d1a840c4315837a871dc31b4497
I20260709 13:15:55.906454  9127 tablet_copy_client.cc:323] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:15:55.908658  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 0e9e53d1d8204518834e32e1ef952157 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:15:55.909158  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 0e9e53d1d8204518834e32e1ef952157 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-0e9e53d1d8204518834e32e1ef952157
I20260709 13:15:55.912853  8379 tablet_copy_source_session.cc:215] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:55.914961  8230 tablet_copy_source_session.cc:215] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:55.919494  9125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e06d1a840c4315837a871dc31b4497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:55.921105  9127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e9e53d1d8204518834e32e1ef952157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:55.943688  9127 tablet_copy_client.cc:806] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:55.944357  9127 tablet_copy_client.cc:670] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:55.947930  9127 tablet_copy_client.cc:538] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:55.949301  9129 ts_tablet_manager.cc:933] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:55.952483  9129 tablet_copy_client.cc:323] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:15:55.956576  9125 tablet_copy_client.cc:806] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:55.956794  8379 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 5bded28881ef4440a713698e8088bd77 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:15:55.957041  9125 tablet_copy_client.cc:670] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:55.957350  8379 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 5bded28881ef4440a713698e8088bd77 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-5bded28881ef4440a713698e8088bd77
I20260709 13:15:55.958043  9127 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:55.967590  8379 tablet_copy_source_session.cc:215] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:55.968152  9125 tablet_copy_client.cc:538] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:55.971407  9129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bded28881ef4440a713698e8088bd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:55.976089  9125 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:55.988344  9129 tablet_copy_client.cc:806] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:55.989030  9129 tablet_copy_client.cc:670] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:55.989331  9131 ts_tablet_manager.cc:933] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:15:55.992571  9131 tablet_copy_client.cc:323] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:15:55.994848  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 8b9006ab90a84d6fae17b6b86c0530b8 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:15:55.995371  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 8b9006ab90a84d6fae17b6b86c0530b8 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-8b9006ab90a84d6fae17b6b86c0530b8
I20260709 13:15:56.002858  8230 tablet_copy_source_session.cc:215] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:56.007507  9131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9006ab90a84d6fae17b6b86c0530b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:56.034147  9131 tablet_copy_client.cc:806] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:56.034719  9131 tablet_copy_client.cc:670] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:56.038367  9131 tablet_copy_client.cc:538] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:56.039943  9129 tablet_copy_client.cc:538] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:56.046953  9131 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:56.052196  9129 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:56.058202  9125 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.064939  9125 tablet_bootstrap.cc:492] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:56.065752  9125 ts_tablet_manager.cc:1403] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.026s
I20260709 13:15:56.070354  9125 raft_consensus.cc:359] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:56.047391  9127 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.072302  9127 tablet_bootstrap.cc:492] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:56.072952  9127 ts_tablet_manager.cc:1403] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.023s
I20260709 13:15:56.075769  9127 raft_consensus.cc:359] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:56.078397  9127 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:56.079066  9127 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:56.081331  9125 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:56.082059  9125 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:56.091526  9131 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.094462  9131 tablet_bootstrap.cc:492] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:56.094934  9129 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.098811  9129 tablet_bootstrap.cc:492] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:56.099814  9129 ts_tablet_manager.cc:1403] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.048s	user 0.027s	sys 0.004s
I20260709 13:15:56.100135  9125 ts_tablet_manager.cc:1434] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.008s
I20260709 13:15:56.095434  9131 ts_tablet_manager.cc:1403] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.022s
I20260709 13:15:56.111893  9129 raft_consensus.cc:359] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:56.112718  9129 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:56.113314  9129 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:56.115337  9127 ts_tablet_manager.cc:1434] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.006s
I20260709 13:15:56.116387  9131 raft_consensus.cc:359] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:56.117172  9131 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:56.117499  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-0e9e53d1d8204518834e32e1ef952157 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:15:56.117966  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-0e9e53d1d8204518834e32e1ef952157 on tablet 0e9e53d1d8204518834e32e1ef952157 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:56.117776  9131 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:56.120651  9131 ts_tablet_manager.cc:1434] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:15:56.123006  9129 ts_tablet_manager.cc:1434] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:15:56.122947  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-8b9006ab90a84d6fae17b6b86c0530b8 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:15:56.124284  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-8b9006ab90a84d6fae17b6b86c0530b8 on tablet 8b9006ab90a84d6fae17b6b86c0530b8 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:56.131563  8379 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-46e06d1a840c4315837a871dc31b4497 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:15:56.132015  8379 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-46e06d1a840c4315837a871dc31b4497 on tablet 46e06d1a840c4315837a871dc31b4497 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:56.133145  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-5bded28881ef4440a713698e8088bd77 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:15:56.133518  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-5bded28881ef4440a713698e8088bd77 on tablet 5bded28881ef4440a713698e8088bd77 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:56.403716  8928 raft_consensus.cc:1217] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:56.443550  8928 raft_consensus.cc:1217] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:56.536966  8928 raft_consensus.cc:1217] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:56.579613  8928 raft_consensus.cc:1217] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:57.002971  9110 raft_consensus.cc:1064] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:57.005573  9110 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:57.012285  8928 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.012851  8292 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.014245  9110 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.014647  9118 raft_consensus.cc:1064] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:57.015133  9101 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.017233  8217 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.017186  9118 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:57.020889  9008 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.042588  8360 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.043182  8926 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.044698  8737 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:15:57.051895  9122 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:57.060667  9101 raft_consensus.cc:1064] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:57.063979  9101 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:57.087589  8926 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.092453  9148 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.094802  8213 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.087589  9122 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.103974  8292 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.111380  8116 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.123675  8927 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.125047  8293 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.129146  9008 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.126859  8363 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.131754  8293 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.131642  8927 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.132963  9110 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:15:57.138549  9149 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:57.151352  8213 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.152917  9101 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:57.154681  8293 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.180081  9122 raft_consensus.cc:1064] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:57.181051  8114 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.185356  9148 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.186044  9122 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:57.188678  8928 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.194005  8217 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.202345  8290 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.263967  8928 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.265686  8363 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.266739  9118 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:57.272203  8737 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.286968  8116 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.299823  8293 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:57.301203  9149 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:57.306808  9122 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.318589  8360 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:57.309268  8363 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.318758  8369 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:57.328256  8928 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:57.328825  8927 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:57.330696  8217 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:57.332805  9008 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:57.333319  9110 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:57.334698  9155 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:57.332571  8292 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:57.338385  8295 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.342909  8927 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.346510  9146 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:57.359913  8118 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.363639  9146 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.369022  9110 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.371902  8928 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.380870  8213 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.385084  8927 raft_consensus.cc:2955] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.390009  8295 raft_consensus.cc:2955] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.399991  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5bded28881ef4440a713698e8088bd77 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:57.404611  8118 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.409525  8115 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.405253  8217 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:57.406703  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46e06d1a840c4315837a871dc31b4497 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:57.418310  8360 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:57.418921  8928 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:57.424479  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bded28881ef4440a713698e8088bd77 with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:15:57.421633  9122 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:15:57.432279  9118 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.437364  8928 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.438304  9171 tablet_replica.cc:333] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:15:57.446288  9171 raft_consensus.cc:2243] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:57.447213  9171 raft_consensus.cc:2272] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:57.448272  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b9006ab90a84d6fae17b6b86c0530b8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:57.451835  9171 ts_tablet_manager.cc:1916] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:57.456353  9149 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:57.456727  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 46e06d1a840c4315837a871dc31b4497 with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:15:57.457918  8114 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.467082  8360 raft_consensus.cc:2955] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.472546  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b9006ab90a84d6fae17b6b86c0530b8 with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:15:57.481491  9171 ts_tablet_manager.cc:1929] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:57.481935  9171 log.cc:1199] T 5bded28881ef4440a713698e8088bd77 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/5bded28881ef4440a713698e8088bd77
I20260709 13:15:57.483611  9171 tablet_replica.cc:333] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:15:57.483867  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 5bded28881ef4440a713698e8088bd77 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:57.485107  9172 tablet_replica.cc:333] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:15:57.486053  9171 raft_consensus.cc:2243] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:57.486835  9171 raft_consensus.cc:2272] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:57.490170  9171 ts_tablet_manager.cc:1916] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:57.515769  9171 ts_tablet_manager.cc:1929] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:57.516271  9171 log.cc:1199] T 8b9006ab90a84d6fae17b6b86c0530b8 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/8b9006ab90a84d6fae17b6b86c0530b8
I20260709 13:15:57.517611  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 8b9006ab90a84d6fae17b6b86c0530b8 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:57.525813  9172 raft_consensus.cc:2243] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:57.526552  9172 raft_consensus.cc:2272] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:57.537322  9172 ts_tablet_manager.cc:1916] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:57.557539  9172 ts_tablet_manager.cc:1929] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:57.558024  9172 log.cc:1199] T 46e06d1a840c4315837a871dc31b4497 P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/46e06d1a840c4315837a871dc31b4497
I20260709 13:15:57.560421  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 46e06d1a840c4315837a871dc31b4497 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:57.571082  8217 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:57.579018  8292 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:57.579257  8928 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:57.580972  9118 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:57.582100  9152 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:57.589213  9118 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.591403  8928 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.591777  8292 raft_consensus.cc:2955] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.607631  8117 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:15:57.614856  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e9e53d1d8204518834e32e1ef952157 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:57.619720  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e9e53d1d8204518834e32e1ef952157 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:15:57.621476  9173 tablet_replica.cc:333] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:15:57.622804  9173 raft_consensus.cc:2243] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:57.623471  9173 raft_consensus.cc:2272] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:57.627481  9173 ts_tablet_manager.cc:1916] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:57.642197  9173 ts_tablet_manager.cc:1929] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:57.642525  9173 log.cc:1199] T 0e9e53d1d8204518834e32e1ef952157 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/0e9e53d1d8204518834e32e1ef952157
I20260709 13:15:57.643944  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 0e9e53d1d8204518834e32e1ef952157 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:15:58.684751  8295 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:58.690442  8213 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:58.691190  8258 consensus_peers.cc:597] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afeb2f98236845469440c44ada463b5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.691339  8360 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:58.692111  9175 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.693018  9074 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.700139  9175 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.701383  8217 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.702088  8360 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.713994  8363 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:58.720075  8117 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:58.729115  8332 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64f8ae67f51c4ec482dada7787dc153e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.731155  8295 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:58.732890  9146 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.733340  8217 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:58.735800  9146 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.749552  9110 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.758087  8295 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.774717  8217 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.780272  8213 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:58.787025  8360 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:58.789311  8183 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f62f6597a8604eb9b9228657a7c3a7eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.790678  9122 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.790921  8295 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:58.792136  9118 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.793020  8117 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.801473  9174 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.806053  8363 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.807888  8295 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.823756  8295 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:58.824604  8114 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.831080  8363 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:58.832338  8258 consensus_peers.cc:597] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62e8a922b99844e085b2b1e126cfb02e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.832424  9175 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.835412  8217 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:58.837605  9167 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:58.842506  9175 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.845618  8360 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.874600  8116 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:58.893769  8213 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:15:59.165586  9194 ts_tablet_manager.cc:933] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:15:59.167479  9194 tablet_copy_client.cc:323] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:15:59.168882  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 64f8ae67f51c4ec482dada7787dc153e from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:15:59.169320  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 64f8ae67f51c4ec482dada7787dc153e from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-64f8ae67f51c4ec482dada7787dc153e
I20260709 13:15:59.175017  8378 tablet_copy_source_session.cc:215] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:59.178815  9194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f8ae67f51c4ec482dada7787dc153e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.194206  9194 tablet_copy_client.cc:806] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:59.194744  9194 tablet_copy_client.cc:670] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:59.198097  9194 tablet_copy_client.cc:538] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:59.204397  9194 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:59.221735  9197 ts_tablet_manager.cc:933] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:59.227357  9197 tablet_copy_client.cc:323] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:15:59.227878  9194 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.228848  9194 tablet_bootstrap.cc:492] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:59.229360  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet afeb2f98236845469440c44ada463b5c from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:15:59.229566  9194 ts_tablet_manager.cc:1403] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.009s
I20260709 13:15:59.229916  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet afeb2f98236845469440c44ada463b5c from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-afeb2f98236845469440c44ada463b5c
I20260709 13:15:59.232645  9194 raft_consensus.cc:359] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:59.233570  9194 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:59.234272  9194 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:59.237354  8305 tablet_copy_source_session.cc:215] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:59.237587  9194 ts_tablet_manager.cc:1434] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:59.239491  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-64f8ae67f51c4ec482dada7787dc153e received from {username='slave'} at 127.0.0.1:59420
I20260709 13:15:59.239897  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-64f8ae67f51c4ec482dada7787dc153e on tablet 64f8ae67f51c4ec482dada7787dc153e with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:59.241048  9197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afeb2f98236845469440c44ada463b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.262238  9197 tablet_copy_client.cc:806] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:59.262830  9197 tablet_copy_client.cc:670] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:59.266386  9197 tablet_copy_client.cc:538] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:59.286350  9197 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:59.303714  9197 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.304483  9197 tablet_bootstrap.cc:492] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:59.305009  9197 ts_tablet_manager.cc:1403] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.007s
I20260709 13:15:59.307008  9197 raft_consensus.cc:359] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:59.307868  9197 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:59.308588  9197 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:59.311846  9197 ts_tablet_manager.cc:1434] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:15:59.313377  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-afeb2f98236845469440c44ada463b5c received from {username='slave'} at 127.0.0.1:33926
I20260709 13:15:59.313759  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-afeb2f98236845469440c44ada463b5c on tablet afeb2f98236845469440c44ada463b5c with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:59.337870  9197 ts_tablet_manager.cc:933] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:15:59.339768  9197 tablet_copy_client.cc:323] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:15:59.341156  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet f62f6597a8604eb9b9228657a7c3a7eb from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:15:59.341646  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet f62f6597a8604eb9b9228657a7c3a7eb from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-f62f6597a8604eb9b9228657a7c3a7eb
I20260709 13:15:59.348831  8230 tablet_copy_source_session.cc:215] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:59.351835  9197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62f6597a8604eb9b9228657a7c3a7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.367288  9197 tablet_copy_client.cc:806] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:59.367920  9197 tablet_copy_client.cc:670] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:59.372227  9197 tablet_copy_client.cc:538] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:59.380761  9197 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:59.405215  9197 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.406196  9197 tablet_bootstrap.cc:492] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:59.406910  9197 ts_tablet_manager.cc:1403] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.006s
I20260709 13:15:59.411141  9197 raft_consensus.cc:359] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:59.412011  9197 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:59.412707  9197 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:59.417344  9197 ts_tablet_manager.cc:1434] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:15:59.420696  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-f62f6597a8604eb9b9228657a7c3a7eb received from {username='slave'} at 127.0.0.1:37896
I20260709 13:15:59.421126  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-f62f6597a8604eb9b9228657a7c3a7eb on tablet f62f6597a8604eb9b9228657a7c3a7eb with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:59.446856  9197 ts_tablet_manager.cc:933] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:15:59.448474  9197 tablet_copy_client.cc:323] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:15:59.449870  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 62e8a922b99844e085b2b1e126cfb02e from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:15:59.450325  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 62e8a922b99844e085b2b1e126cfb02e from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-62e8a922b99844e085b2b1e126cfb02e
I20260709 13:15:59.458250  8305 tablet_copy_source_session.cc:215] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:59.461205  9197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e8a922b99844e085b2b1e126cfb02e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:59.473637  9197 tablet_copy_client.cc:806] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:59.474174  9197 tablet_copy_client.cc:670] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:59.477363  9197 tablet_copy_client.cc:538] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:59.482230  9197 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:15:59.498409  9197 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.499045  9197 tablet_bootstrap.cc:492] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:15:59.499512  9197 ts_tablet_manager.cc:1403] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.002s
I20260709 13:15:59.501689  9197 raft_consensus.cc:359] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:59.502426  9197 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:15:59.502997  9197 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:15:59.504747  9197 ts_tablet_manager.cc:1434] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:15:59.509896  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-62e8a922b99844e085b2b1e126cfb02e received from {username='slave'} at 127.0.0.1:33926
I20260709 13:15:59.510377  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-62e8a922b99844e085b2b1e126cfb02e on tablet 62e8a922b99844e085b2b1e126cfb02e with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:15:59.586349  8927 raft_consensus.cc:1217] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:59.727696  8927 raft_consensus.cc:1217] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:59.817167  8927 raft_consensus.cc:1217] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:59.899950  8927 raft_consensus.cc:1217] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:59.984539  9146 raft_consensus.cc:1064] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:15:59.986541  9146 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:15:59.993423  8927 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:59.996696  8213 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:59.997702  9207 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.001329  9187 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.007979  8293 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.009640  9187 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.013873  9146 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.025555  8927 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.033680  8117 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:00.038892  8213 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.037387  8293 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.074663  8360 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:00.079941  8927 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:00.080513  8213 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:00.081813  9211 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.083320  9187 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.093008  9211 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.095623  8213 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.096572  8927 raft_consensus.cc:2955] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.106753  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ae67f51c4ec482dada7787dc153e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:00.109759  8114 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.118719  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 64f8ae67f51c4ec482dada7787dc153e with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:00.123098  9216 tablet_replica.cc:333] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:16:00.124145  9216 raft_consensus.cc:2243] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.124866  9216 raft_consensus.cc:2272] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.127981  9216 ts_tablet_manager.cc:1916] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:00.143186  9216 ts_tablet_manager.cc:1929] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:00.143646  9216 log.cc:1199] T 64f8ae67f51c4ec482dada7787dc153e P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/64f8ae67f51c4ec482dada7787dc153e
I20260709 13:16:00.145494  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 64f8ae67f51c4ec482dada7787dc153e (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:00.248270  9175 raft_consensus.cc:1064] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:00.250178  9175 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:00.257925  8360 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.259812  8216 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.260617  9200 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.261565  9167 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:00.262341  8927 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.265307  9218 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:00.286594  9200 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.289206  8360 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.292872  9122 raft_consensus.cc:1064] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:00.292603  8216 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.294996  9122 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:00.307734  8927 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.314699  8116 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.333410  8363 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.338673  8293 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.341720  9118 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.343832  9118 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.344642  8927 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.346320  8295 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:00.349166  9174 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.353232  8928 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:00.355572  9175 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.355860  8369 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:00.358006  9200 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.363740  9122 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.365214  9200 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.366659  8369 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.381613  8928 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.382540  8363 raft_consensus.cc:2955] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.398862  8292 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.407605  8115 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:00.413095  8114 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.427338  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet afeb2f98236845469440c44ada463b5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:00.432426  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet afeb2f98236845469440c44ada463b5c with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:16:00.432176  8927 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.444443  9167 raft_consensus.cc:1064] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:00.447070  9167 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:00.456270  9228 tablet_replica.cc:333] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:16:00.457753  9228 raft_consensus.cc:2243] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.458599  9228 raft_consensus.cc:2272] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.458822  8360 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.462221  9218 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.471992  9228 ts_tablet_manager.cc:1916] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:00.472131  8216 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:00.475759  8927 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.477924  9218 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:00.507340  8213 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:00.508873  9200 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:00.522512  8927 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:00.524196  9225 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.526345  9218 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.527643  9228 ts_tablet_manager.cc:1929] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:00.528910  8213 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.535650  8292 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:00.536386  9118 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.538005  8928 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.539415  9228 log.cc:1199] T afeb2f98236845469440c44ada463b5c P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/afeb2f98236845469440c44ada463b5c
I20260709 13:16:00.541684  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet afeb2f98236845469440c44ada463b5c (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:00.550925  9174 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.553881  8116 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.559934  8293 raft_consensus.cc:2955] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.568370  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f62f6597a8604eb9b9228657a7c3a7eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:00.567830  8117 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.583753  8363 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.588294  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet f62f6597a8604eb9b9228657a7c3a7eb with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:16:00.608192  9234 tablet_replica.cc:333] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:16:00.611191  8927 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.615477  9234 raft_consensus.cc:2243] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.616261  9234 raft_consensus.cc:2272] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.619335  9234 ts_tablet_manager.cc:1916] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:00.629750  8293 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:00.634809  8927 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:00.636395  9167 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.637646  9234 ts_tablet_manager.cc:1929] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:00.638055  9234 log.cc:1199] T f62f6597a8604eb9b9228657a7c3a7eb P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/f62f6597a8604eb9b9228657a7c3a7eb
I20260709 13:16:00.639654  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet f62f6597a8604eb9b9228657a7c3a7eb (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:00.641556  8363 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:00.642897  9218 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:00.642789  9175 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.646145  8927 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.655601  8363 raft_consensus.cc:2955] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.658859  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62e8a922b99844e085b2b1e126cfb02e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:00.660702  8114 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:00.677817  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 62e8a922b99844e085b2b1e126cfb02e with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:16:00.678740  9228 tablet_replica.cc:333] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:16:00.679704  9228 raft_consensus.cc:2243] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:00.680444  9228 raft_consensus.cc:2272] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:00.683362  9228 ts_tablet_manager.cc:1916] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:00.694953  9228 ts_tablet_manager.cc:1929] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:00.695240  9228 log.cc:1199] T 62e8a922b99844e085b2b1e126cfb02e P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/62e8a922b99844e085b2b1e126cfb02e
I20260709 13:16:00.696559  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 62e8a922b99844e085b2b1e126cfb02e (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:01.742677  8213 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:01.750375  8369 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:01.750409  8183 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5da27e18b189452598381f95fe6f22cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.751921  8292 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.751865  9226 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.753486  9118 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.763069  9233 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.764659  8363 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.768566  8292 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.778980  8116 catalog_manager.cc:5697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:01.781693  8293 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:01.790242  8363 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:01.791209  8258 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff5614e6d15c446ba2addddda765efdd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.792999  9218 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.797034  8213 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.800885  9167 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:01.813499  9218 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.816293  8363 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.828344  8213 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.837327  8217 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:01.858945  8114 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.861339  8363 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:01.861759  8183 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c999e73d071475d9e848e7e83e79be3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.862751  9248 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.863179  8293 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.864785  9248 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.890093  9233 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.902562  8369 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.903240  8293 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.915735  8217 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:01.919597  8114 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:01.924762  8183 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c835fd22b7643a981b446089ad74066. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:01.925602  8369 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.927150  9233 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.927532  8293 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:01.928951  9248 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:01.941327  9233 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.944590  8369 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.944340  8293 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:01.962278  8116 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:02.163358  9258 ts_tablet_manager.cc:933] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:02.168788  9258 tablet_copy_client.cc:323] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:16:02.170337  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 5da27e18b189452598381f95fe6f22cf from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:16:02.170773  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 5da27e18b189452598381f95fe6f22cf from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-5da27e18b189452598381f95fe6f22cf
I20260709 13:16:02.177157  8230 tablet_copy_source_session.cc:215] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.180007  9258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da27e18b189452598381f95fe6f22cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.194002  9258 tablet_copy_client.cc:806] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:02.194598  9258 tablet_copy_client.cc:670] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:02.198899  9258 tablet_copy_client.cc:538] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:02.208606  9258 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:02.228664  9258 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:02.229641  9258 tablet_bootstrap.cc:492] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:02.230283  9258 ts_tablet_manager.cc:1403] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:16:02.233196  9258 raft_consensus.cc:359] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:02.233995  9258 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:02.234685  9258 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:02.237844  9258 ts_tablet_manager.cc:1434] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:16:02.239794  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-5da27e18b189452598381f95fe6f22cf received from {username='slave'} at 127.0.0.1:37896
I20260709 13:16:02.241550  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-5da27e18b189452598381f95fe6f22cf on tablet 5da27e18b189452598381f95fe6f22cf with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:02.360505  9258 ts_tablet_manager.cc:933] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:02.362164  9258 tablet_copy_client.cc:323] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:16:02.363648  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 4c835fd22b7643a981b446089ad74066 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:16:02.364179  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 4c835fd22b7643a981b446089ad74066 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-4c835fd22b7643a981b446089ad74066
I20260709 13:16:02.378173  8230 tablet_copy_source_session.cc:215] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.383406  9258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c835fd22b7643a981b446089ad74066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.397127  9263 ts_tablet_manager.cc:933] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:02.398729  9263 tablet_copy_client.cc:323] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:16:02.400012  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet ff5614e6d15c446ba2addddda765efdd from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:16:02.400532  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet ff5614e6d15c446ba2addddda765efdd from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-ff5614e6d15c446ba2addddda765efdd
I20260709 13:16:02.401079  9258 tablet_copy_client.cc:806] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:02.401906  9258 tablet_copy_client.cc:670] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:02.406329  8305 tablet_copy_source_session.cc:215] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.406329  9258 tablet_copy_client.cc:538] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:02.410161  9263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5614e6d15c446ba2addddda765efdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.414844  9258 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:02.428403  9265 ts_tablet_manager.cc:933] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:02.428471  9263 tablet_copy_client.cc:806] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:02.429108  9263 tablet_copy_client.cc:670] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:02.430991  9265 tablet_copy_client.cc:323] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:16:02.432797  9263 tablet_copy_client.cc:538] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:02.433094  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 3c999e73d071475d9e848e7e83e79be3 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:16:02.434098  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 3c999e73d071475d9e848e7e83e79be3 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-3c999e73d071475d9e848e7e83e79be3
I20260709 13:16:02.455444  8230 tablet_copy_source_session.cc:215] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:02.457656  9263 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:02.458652  9265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c999e73d071475d9e848e7e83e79be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:02.467114  9258 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:02.468185  9258 tablet_bootstrap.cc:492] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:02.468868  9258 ts_tablet_manager.cc:1403] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.006s
I20260709 13:16:02.473510  9258 raft_consensus.cc:359] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:02.474313  9258 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:02.475095  9258 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:02.482831  9265 tablet_copy_client.cc:806] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:02.483433  9265 tablet_copy_client.cc:670] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:02.487082  9265 tablet_copy_client.cc:538] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:02.488318  9258 ts_tablet_manager.cc:1434] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:16:02.497363  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-4c835fd22b7643a981b446089ad74066 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:16:02.497781  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-4c835fd22b7643a981b446089ad74066 on tablet 4c835fd22b7643a981b446089ad74066 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:02.501148  9265 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:02.504618  9263 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:02.507434  9263 tablet_bootstrap.cc:492] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:02.508093  9263 ts_tablet_manager.cc:1403] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.007s
I20260709 13:16:02.511895  9263 raft_consensus.cc:359] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:02.512689  9263 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:02.513320  9263 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:02.516213  9263 ts_tablet_manager.cc:1434] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:02.519670  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-ff5614e6d15c446ba2addddda765efdd received from {username='slave'} at 127.0.0.1:33926
I20260709 13:16:02.520097  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-ff5614e6d15c446ba2addddda765efdd on tablet ff5614e6d15c446ba2addddda765efdd with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:02.526365  9265 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:02.527333  9265 tablet_bootstrap.cc:492] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:02.528108  9265 ts_tablet_manager.cc:1403] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.002s
I20260709 13:16:02.531245  9265 raft_consensus.cc:359] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:02.532552  9265 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:02.533524  9265 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:02.536244  9265 ts_tablet_manager.cc:1434] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:02.537997  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-3c999e73d071475d9e848e7e83e79be3 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:16:02.538393  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-3c999e73d071475d9e848e7e83e79be3 on tablet 3c999e73d071475d9e848e7e83e79be3 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:02.559921  8928 raft_consensus.cc:1217] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:02.742949  8927 raft_consensus.cc:1217] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:02.775962  8927 raft_consensus.cc:1217] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:02.803257  8927 raft_consensus.cc:1217] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:16:03.048717  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 54361.5us
I20260709 13:16:03.070184  9118 raft_consensus.cc:1064] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:03.076190  9118 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:03.101984  8927 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.104418  8369 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.104334  9226 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.105295  8293 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.107275  9233 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.111625  9226 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.124212  9118 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.125954  8293 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.127928  8369 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.142570  8927 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.147372  8114 catalog_manager.cc:5697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.191114  8217 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:03.205593  8928 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.207167  9226 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.208359  8369 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.217187  9273 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:03.219550  9273 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.223414  8360 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.224993  8927 raft_consensus.cc:2955] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.236903  9250 raft_consensus.cc:1064] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:03.239492  9250 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:03.242250  8116 catalog_manager.cc:5697] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.252193  8369 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.254015  9276 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.259466  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5da27e18b189452598381f95fe6f22cf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.261708  8927 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.263213  9276 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.279114  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 5da27e18b189452598381f95fe6f22cf with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:03.282168  9288 tablet_replica.cc:333] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:16:03.283339  8217 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.287493  9288 raft_consensus.cc:2243] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.288358  9288 raft_consensus.cc:2272] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.292415  9288 ts_tablet_manager.cc:1916] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.293921  9276 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.327950  9288 ts_tablet_manager.cc:1929] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:03.328884  9288 log.cc:1199] T 5da27e18b189452598381f95fe6f22cf P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/5da27e18b189452598381f95fe6f22cf
I20260709 13:16:03.334074  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 5da27e18b189452598381f95fe6f22cf (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:03.335165  9226 raft_consensus.cc:1064] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:03.338332  9226 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:03.349762  9250 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.358542  9118 raft_consensus.cc:1064] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:03.361545  8927 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.361462  9118 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:03.367491  8217 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.374047  8360 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.390033  8116 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.407588  8927 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.411850  8360 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.413628  9233 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.415302  8293 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.415162  9273 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.417915  9272 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.419165  8927 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.423267  9272 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.429049  8293 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:03.430680  8295 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.444689  9226 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.454082  8926 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.457711  8360 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:03.459498  9250 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:03.472265  9293 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:03.475786  9276 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.531631  8926 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:16:03.544656  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 54183.7us
I20260709 13:16:03.566813  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff5614e6d15c446ba2addddda765efdd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.579552  8217 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.580828  9272 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.583599  9250 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.588436  8115 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.589608  8217 raft_consensus.cc:2955] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.591274  9293 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.602802  8114 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.607510  8292 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.617802  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet ff5614e6d15c446ba2addddda765efdd with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:16:03.624686  8363 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.625715  8295 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.629560  8928 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.635515  8360 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.658522  8926 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.685282  9301 tablet_replica.cc:333] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:16:03.685676  8114 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.714232  9301 raft_consensus.cc:2243] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.715090  9301 raft_consensus.cc:2272] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.715919  8217 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:03.718559  8213 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:03.719465  9301 ts_tablet_manager.cc:1916] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.730453  8928 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.731868  8363 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.735148  9273 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.739552  9301 ts_tablet_manager.cc:1929] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:03.740031  9301 log.cc:1199] T ff5614e6d15c446ba2addddda765efdd P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/ff5614e6d15c446ba2addddda765efdd
I20260709 13:16:03.742252  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet ff5614e6d15c446ba2addddda765efdd (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:03.742594  8295 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.733873  8926 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:03.747910  9273 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.751461  9233 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:03.750196  9300 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:03.758181  9226 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.759934  8363 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.766686  9118 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.767951  8928 raft_consensus.cc:2955] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.773767  8295 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.775689  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c999e73d071475d9e848e7e83e79be3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.785198  8115 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.799839  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c835fd22b7643a981b446089ad74066 with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:03.800799  9288 tablet_replica.cc:333] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:16:03.801851  9288 raft_consensus.cc:2243] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.802460  9288 raft_consensus.cc:2272] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.805478  9288 ts_tablet_manager.cc:1916] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.805720  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c835fd22b7643a981b446089ad74066 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:03.819948  8926 raft_consensus.cc:2955] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.845546  8116 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:03.850381  9288 ts_tablet_manager.cc:1929] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:03.850937  9288 log.cc:1199] T 4c835fd22b7643a981b446089ad74066 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/4c835fd22b7643a981b446089ad74066
I20260709 13:16:03.852454  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 4c835fd22b7643a981b446089ad74066 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:03.855777  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c999e73d071475d9e848e7e83e79be3 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:16:03.856894  9301 tablet_replica.cc:333] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:16:03.858033  9301 raft_consensus.cc:2243] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:03.858824  9301 raft_consensus.cc:2272] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:03.862977  9301 ts_tablet_manager.cc:1916] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:03.874481  9301 ts_tablet_manager.cc:1929] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:03.874856  9301 log.cc:1199] T 3c999e73d071475d9e848e7e83e79be3 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/3c999e73d071475d9e848e7e83e79be3
I20260709 13:16:03.876273  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 3c999e73d071475d9e848e7e83e79be3 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:04.927130  8360 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:04.934671  8293 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:04.934791  8332 consensus_peers.cc:597] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7feffaf779354992809fb6a460399626. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:04.935261  8217 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:04.936069  9303 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.936908  9236 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.944404  9236 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:04.946030  8293 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:04.945962  8217 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:04.959717  8114 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:04.983721  8293 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:05.004334  8258 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ac72d56568b4857a1bd70aadbb026c1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.004736  8217 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.004683  8360 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.006321  9306 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.007284  9250 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.020604  9275 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.025095  8363 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.045275  8217 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.048954  8116 catalog_manager.cc:5697] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.051033  8363 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.058882  8293 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:05.059060  8332 consensus_peers.cc:597] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 282a740dc06c41f0b77f4880423e4395. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.060377  9237 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.061456  8217 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.067379  9236 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.072497  9303 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.075594  8293 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.092250  8213 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.092720  8217 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.093727  8116 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:05.106211  8183 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57b9174dc54540e597799ccc6b10b419. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:05.109377  8293 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.109758  8363 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:05.110792  9300 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.111708  9233 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.123128  9273 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.125342  8293 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.125455  8363 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.144953  8117 catalog_manager.cc:5697] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:05.324244  9320 ts_tablet_manager.cc:933] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:05.326304  9320 tablet_copy_client.cc:323] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:16:05.328279  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 7feffaf779354992809fb6a460399626 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:16:05.328819  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 7feffaf779354992809fb6a460399626 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-7feffaf779354992809fb6a460399626
I20260709 13:16:05.336985  8378 tablet_copy_source_session.cc:215] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:05.339988  9320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7feffaf779354992809fb6a460399626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:05.352828  9320 tablet_copy_client.cc:806] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:05.353375  9320 tablet_copy_client.cc:670] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:05.356586  9320 tablet_copy_client.cc:538] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:05.362558  9320 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:05.382213  9320 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:05.382910  9320 tablet_bootstrap.cc:492] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:05.383607  9320 ts_tablet_manager.cc:1403] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:16:05.386682  9320 raft_consensus.cc:359] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.387490  9320 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:05.388221  9320 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.396500  9320 ts_tablet_manager.cc:1434] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:16:05.397957  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-7feffaf779354992809fb6a460399626 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:16:05.398367  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-7feffaf779354992809fb6a460399626 on tablet 7feffaf779354992809fb6a460399626 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:05.404949  9320 ts_tablet_manager.cc:933] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:05.411738  9320 tablet_copy_client.cc:323] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:16:05.413388  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 7ac72d56568b4857a1bd70aadbb026c1 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:16:05.413807  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 7ac72d56568b4857a1bd70aadbb026c1 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-7ac72d56568b4857a1bd70aadbb026c1
I20260709 13:16:05.432886  8305 tablet_copy_source_session.cc:215] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:05.436878  9320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac72d56568b4857a1bd70aadbb026c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:05.449295  9320 tablet_copy_client.cc:806] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:05.449924  9320 tablet_copy_client.cc:670] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:05.453532  9320 tablet_copy_client.cc:538] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:05.460032  9320 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:05.477665  9320 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:05.478359  9320 tablet_bootstrap.cc:492] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:05.478924  9320 ts_tablet_manager.cc:1403] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.007s
I20260709 13:16:05.481379  9320 raft_consensus.cc:359] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.482028  9320 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:05.482663  9320 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.484251  9320 ts_tablet_manager.cc:1434] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:16:05.489085  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-7ac72d56568b4857a1bd70aadbb026c1 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:16:05.489519  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-7ac72d56568b4857a1bd70aadbb026c1 on tablet 7ac72d56568b4857a1bd70aadbb026c1 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:05.490363  9326 ts_tablet_manager.cc:933] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:05.493330  9326 tablet_copy_client.cc:323] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:16:05.494817  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 282a740dc06c41f0b77f4880423e4395 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:16:05.495329  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 282a740dc06c41f0b77f4880423e4395 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-282a740dc06c41f0b77f4880423e4395
I20260709 13:16:05.501370  8378 tablet_copy_source_session.cc:215] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:05.504017  9326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282a740dc06c41f0b77f4880423e4395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:05.519088  9326 tablet_copy_client.cc:806] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:05.519708  9326 tablet_copy_client.cc:670] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:05.522984  9326 tablet_copy_client.cc:538] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:05.531338  9326 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:05.552841  9326 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:05.553869  9326 tablet_bootstrap.cc:492] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:05.554642  9326 ts_tablet_manager.cc:1403] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.008s
I20260709 13:16:05.559944  9326 raft_consensus.cc:359] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.560889  9326 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:05.561635  9326 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.564508  9326 ts_tablet_manager.cc:1434] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:05.567790  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-282a740dc06c41f0b77f4880423e4395 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:16:05.568221  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-282a740dc06c41f0b77f4880423e4395 on tablet 282a740dc06c41f0b77f4880423e4395 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:05.715577  9326 ts_tablet_manager.cc:933] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:05.717327  9326 tablet_copy_client.cc:323] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:16:05.718924  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 57b9174dc54540e597799ccc6b10b419 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:16:05.719350  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 57b9174dc54540e597799ccc6b10b419 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-57b9174dc54540e597799ccc6b10b419
I20260709 13:16:05.725713  8230 tablet_copy_source_session.cc:215] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:05.730628  9326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57b9174dc54540e597799ccc6b10b419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:05.748615  9326 tablet_copy_client.cc:806] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:05.749233  9326 tablet_copy_client.cc:670] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:05.752738  9326 tablet_copy_client.cc:538] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:05.761646  9326 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:05.780826  9326 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:05.781706  9326 tablet_bootstrap.cc:492] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:05.782330  9326 ts_tablet_manager.cc:1403] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 13:16:05.785199  9326 raft_consensus.cc:359] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.786010  9326 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:05.786621  9326 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:05.789482  9326 ts_tablet_manager.cc:1434] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:05.791577  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-57b9174dc54540e597799ccc6b10b419 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:16:05.791988  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-57b9174dc54540e597799ccc6b10b419 on tablet 57b9174dc54540e597799ccc6b10b419 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:05.805401  8928 raft_consensus.cc:1217] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:05.926155  8928 raft_consensus.cc:1217] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:05.971580  8928 raft_consensus.cc:1217] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:06.180382  8928 raft_consensus.cc:1217] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:06.194025  9275 raft_consensus.cc:1064] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:06.196533  9275 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:06.205319  8928 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.206856  8213 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.207653  8360 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.208657  9333 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.209633  9275 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.216300  9331 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.243850  9331 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.245510  8360 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.252882  8928 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.261809  8114 catalog_manager.cc:5697] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.274243  8213 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.297664  8292 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:06.302392  8928 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.303828  8213 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.305320  9331 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.312182  9275 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.318226  8926 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.325085  8213 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.316354  9275 raft_consensus.cc:2955] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.337018  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7ac72d56568b4857a1bd70aadbb026c1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:06.341558  8117 catalog_manager.cc:5697] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.362524  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ac72d56568b4857a1bd70aadbb026c1 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:16:06.379972  9341 tablet_replica.cc:333] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:16:06.380910  9341 raft_consensus.cc:2243] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.381529  9341 raft_consensus.cc:2272] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.384191  9341 ts_tablet_manager.cc:1916] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:06.395884  9341 ts_tablet_manager.cc:1929] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:06.396320  9341 log.cc:1199] T 7ac72d56568b4857a1bd70aadbb026c1 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/7ac72d56568b4857a1bd70aadbb026c1
I20260709 13:16:06.397815  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 7ac72d56568b4857a1bd70aadbb026c1 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:06.416129  9236 raft_consensus.cc:1064] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:06.418164  9236 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:06.425385  8928 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.426999  8293 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.427174  8217 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.427429  9236 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.428493  9237 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.429431  9343 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.452376  9303 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.453439  8928 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.457202  8217 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.468478  8293 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.472764  8117 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.491129  8360 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:06.500607  8928 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.502498  8293 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.502070  9237 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:06.507743  9237 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.513893  9343 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.515703  8292 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.523146  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7feffaf779354992809fb6a460399626 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:06.531862  8116 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.541841  8928 raft_consensus.cc:2955] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.562522  9237 raft_consensus.cc:1064] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:06.564687  9237 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:06.583563  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 7feffaf779354992809fb6a460399626 with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:16:06.586810  9348 tablet_replica.cc:333] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:16:06.587839  9348 raft_consensus.cc:2243] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.588670  9348 raft_consensus.cc:2272] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.590884  8928 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.591816  8217 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.592684  9348 ts_tablet_manager.cc:1916] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:06.593832  8292 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.595486  9237 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.596251  9303 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.604755  9237 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.634761  9236 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.640255  9348 ts_tablet_manager.cc:1929] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:06.640774  9348 log.cc:1199] T 7feffaf779354992809fb6a460399626 P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/7feffaf779354992809fb6a460399626
I20260709 13:16:06.642560  8216 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.652107  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 7feffaf779354992809fb6a460399626 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:06.655108  8292 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.661135  8117 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:06.669919  8928 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.695293  8369 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:06.698904  9273 raft_consensus.cc:1064] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:06.701247  9273 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:06.706179  8926 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.709633  8292 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.710826  9237 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.717938  8360 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.720341  8928 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.720569  8295 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:06.722970  9233 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:06.725075  9303 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.737748  9233 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:06.740269  9237 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.753077  9352 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:06.754571  8295 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.776942  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 282a740dc06c41f0b77f4880423e4395 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:06.784082  8117 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.792732  8928 raft_consensus.cc:2955] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.803084  8926 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.811868  9273 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.817098  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 282a740dc06c41f0b77f4880423e4395 with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:16:06.819016  9348 tablet_replica.cc:333] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:16:06.820029  9348 raft_consensus.cc:2243] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.820775  9348 raft_consensus.cc:2272] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.826118  9348 ts_tablet_manager.cc:1916] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:06.826152  8117 catalog_manager.cc:5697] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.827390  8360 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.828805  8295 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.852612  8217 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:06.866374  8360 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.866456  8926 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:06.868134  9358 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:06.868975  9352 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:06.857179  9348 ts_tablet_manager.cc:1929] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:06.874387  9348 log.cc:1199] T 282a740dc06c41f0b77f4880423e4395 P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/282a740dc06c41f0b77f4880423e4395
I20260709 13:16:06.878590  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 282a740dc06c41f0b77f4880423e4395 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:06.884658  9300 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.885967  8926 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.891008  8369 raft_consensus.cc:2955] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.896273  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57b9174dc54540e597799ccc6b10b419 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:06.903731  8115 catalog_manager.cc:5697] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:06.914067  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 57b9174dc54540e597799ccc6b10b419 with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:06.915633  9360 tablet_replica.cc:333] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:16:06.916711  9360 raft_consensus.cc:2243] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:06.917470  9360 raft_consensus.cc:2272] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:06.926918  9360 ts_tablet_manager.cc:1916] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:06.940485  9360 ts_tablet_manager.cc:1929] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:06.940761  9360 log.cc:1199] T 57b9174dc54540e597799ccc6b10b419 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/57b9174dc54540e597799ccc6b10b419
I20260709 13:16:06.942122  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 57b9174dc54540e597799ccc6b10b419 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:07.986059  8360 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:07.993108  8293 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:07.993288  8217 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:07.993347  8332 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 133eb5f61ebc499ab283df4c068d5be7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:07.994835  9236 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.996722  9237 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.008316  9237 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.010843  8293 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.011772  8216 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.023682  8117 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.029162  8217 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:08.040515  8183 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c802b19bdf2e4f69b169d31056091820. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.042529  8360 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.045022  9352 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.048753  8293 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.051225  9352 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.066114  9300 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.068390  8360 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.074160  8293 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.085875  8115 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:08.083424  8295 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.106767  8360 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:08.107050  8258 consensus_peers.cc:597] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be0d0091520f4d6ea7668120e21a6aa0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.108152  9331 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.112625  8217 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.114364  9331 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.119005  8369 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.120496  9331 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.134379  8116 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.135705  8217 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.139479  8369 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:08.150647  8332 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d693bc5288d40ae98bb93862716c589. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:08.151176  8295 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.152428  8217 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:08.152539  9362 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.153625  9237 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.162015  9362 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.163898  8295 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.166584  8217 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.181680  8116 catalog_manager.cc:5697] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:08.445935  9379 ts_tablet_manager.cc:933] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:08.447788  9379 tablet_copy_client.cc:323] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:16:08.449385  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 133eb5f61ebc499ab283df4c068d5be7 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:16:08.449889  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 133eb5f61ebc499ab283df4c068d5be7 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-133eb5f61ebc499ab283df4c068d5be7
I20260709 13:16:08.459295  8378 tablet_copy_source_session.cc:215] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:08.465467  9379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 133eb5f61ebc499ab283df4c068d5be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:08.481642  9379 tablet_copy_client.cc:806] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:08.482430  9379 tablet_copy_client.cc:670] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:08.487715  9379 tablet_copy_client.cc:538] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:08.496404  9379 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:08.516280  9379 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.517171  9379 tablet_bootstrap.cc:492] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:08.517799  9379 ts_tablet_manager.cc:1403] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 13:16:08.520538  9379 raft_consensus.cc:359] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.521322  9379 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:08.521921  9379 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.524972  9379 ts_tablet_manager.cc:1434] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:08.526613  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-133eb5f61ebc499ab283df4c068d5be7 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:16:08.526999  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-133eb5f61ebc499ab283df4c068d5be7 on tablet 133eb5f61ebc499ab283df4c068d5be7 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.613214  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:08.625182  9379 ts_tablet_manager.cc:933] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:08.626848  9379 tablet_copy_client.cc:323] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:16:08.628240  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet c802b19bdf2e4f69b169d31056091820 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:16:08.628687  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet c802b19bdf2e4f69b169d31056091820 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-c802b19bdf2e4f69b169d31056091820
I20260709 13:16:08.635977  8230 tablet_copy_source_session.cc:215] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:08.639567  9379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c802b19bdf2e4f69b169d31056091820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:08.666090  9379 tablet_copy_client.cc:806] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:08.666939  9379 tablet_copy_client.cc:670] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:08.675880  9379 tablet_copy_client.cc:538] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:08.683974  9384 ts_tablet_manager.cc:933] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:08.690474  9379 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:08.729799  9384 tablet_copy_client.cc:323] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:16:08.733896  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3becc403d217418988bb94be41c015e9"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:08.734578  8217 raft_consensus.cc:606] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.737305  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet be0d0091520f4d6ea7668120e21a6aa0 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:16:08.737808  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet be0d0091520f4d6ea7668120e21a6aa0 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-be0d0091520f4d6ea7668120e21a6aa0
I20260709 13:16:08.745196  8305 tablet_copy_source_session.cc:215] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:08.748822  9384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0d0091520f4d6ea7668120e21a6aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:08.763760  9389 ts_tablet_manager.cc:933] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:08.772764  9384 tablet_copy_client.cc:806] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:08.773000  9389 tablet_copy_client.cc:323] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:16:08.773391  9384 tablet_copy_client.cc:670] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:08.774842  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 1d693bc5288d40ae98bb93862716c589 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:16:08.775341  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 1d693bc5288d40ae98bb93862716c589 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-1d693bc5288d40ae98bb93862716c589
I20260709 13:16:08.777060  9384 tablet_copy_client.cc:538] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:08.784673  8378 tablet_copy_source_session.cc:215] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:08.788357  9384 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:08.789523  9389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d693bc5288d40ae98bb93862716c589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:08.809600  9389 tablet_copy_client.cc:806] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:08.810412  9389 tablet_copy_client.cc:670] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:08.815752  9389 tablet_copy_client.cc:538] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:08.817543  9300 raft_consensus.cc:993] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:08.818197  9300 raft_consensus.cc:1081] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:08.820408  8926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3becc403d217418988bb94be41c015e9"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:16:08.820957  8926 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:08.821257  8926 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.842881  8295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "509edc927d524436b819a0e96e615799"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:08.843495  8295 raft_consensus.cc:606] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.840138  8926 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:08.847259  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:08.847805  8217 raft_consensus.cc:606] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.851164  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:08.851668  8293 raft_consensus.cc:606] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.852411  9384 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.853336  9384 tablet_bootstrap.cc:492] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:08.854094  9384 ts_tablet_manager.cc:1403] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.030s
I20260709 13:16:08.854553  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:08.855146  8293 raft_consensus.cc:606] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.856309  9389 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:08.856866  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:08.857419  9384 raft_consensus.cc:359] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.858428  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:08.858287  9384 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:08.859220  9384 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.861332  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:08.861915  8217 raft_consensus.cc:3055] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:08.862185  8217 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:08.862820  8217 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:08.863750  8217 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.872550  9384 ts_tablet_manager.cc:1434] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:16:08.879895  8217 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:08.881210  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:08.882699  9382 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:08.885910  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:08.886478  8293 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.884974  8926 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:08.888862  9382 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:08.887768  9331 raft_consensus.cc:993] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:08.892629  9333 raft_consensus.cc:1081] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:08.893474  8293 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:08.893501  9379 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.894397  8928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54804
I20260709 13:16:08.894908  8928 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:08.895262  8928 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.890535  9382 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:08.898623  9379 tablet_bootstrap.cc:492] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:08.899423  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-be0d0091520f4d6ea7668120e21a6aa0 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:16:08.900072  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-be0d0091520f4d6ea7668120e21a6aa0 on tablet be0d0091520f4d6ea7668120e21a6aa0 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.899420  9379 ts_tablet_manager.cc:1403] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.209s	user 0.018s	sys 0.018s
I20260709 13:16:08.917945  9379 raft_consensus.cc:359] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.918810  9379 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:08.919669  9379 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.910933  8928 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:08.926774  8928 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:08.929683  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:08.931926  8293 raft_consensus.cc:3055] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:08.932564  8293 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:08.931044  9379 ts_tablet_manager.cc:1434] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:16:08.933395  8293 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:08.934643  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-c802b19bdf2e4f69b169d31056091820 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:16:08.935591  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-c802b19bdf2e4f69b169d31056091820 on tablet c802b19bdf2e4f69b169d31056091820 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.933940  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:08.936861  8217 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.941797  8117 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:08.944633  8293 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.951912  8217 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:08.954008  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:08.954782  9382 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:08.955236  9382 raft_consensus.cc:697] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:08.955691  8293 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:08.956097  9382 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:08.962306  9389 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:08.963172  9389 tablet_bootstrap.cc:492] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:08.963793  9389 ts_tablet_manager.cc:1403] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.108s	user 0.019s	sys 0.006s
I20260709 13:16:08.966531  9389 raft_consensus.cc:359] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.967319  9389 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:08.967945  9389 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:08.970645  9389 ts_tablet_manager.cc:1434] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:08.972167  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-1d693bc5288d40ae98bb93862716c589 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:16:08.972558  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-1d693bc5288d40ae98bb93862716c589 on tablet 1d693bc5288d40ae98bb93862716c589 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:08.992292  8117 catalog_manager.cc:5697] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.023821  8928 raft_consensus.cc:1217] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:09.057562  8928 raft_consensus.cc:1217] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:09.070775  9352 raft_consensus.cc:993] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:09.071264  9352 raft_consensus.cc:1081] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:09.072731  8928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:16:09.073215  8928 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.073545  8928 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.083381  8928 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.086009  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:09.086536  8216 raft_consensus.cc:3055] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.086808  8216 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:09.086793  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:09.087477  8360 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.087656  8216 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.088745  8216 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.093443  8928 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:09.093477  8360 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:09.094610  8216 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:09.095561  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:09.096364  9382 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.096872  9382 raft_consensus.cc:697] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:09.097681  9382 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.116179  8117 catalog_manager.cc:5697] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.117915  9333 raft_consensus.cc:993] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:09.118394  9333 raft_consensus.cc:1081] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:09.125797  8926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "509edc927d524436b819a0e96e615799"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54804
I20260709 13:16:09.126335  8926 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.126686  8926 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.133960  8926 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.136193  8926 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:09.136503  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:09.137027  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:09.137483  8295 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.137537  8360 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.137877  8295 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:09.138564  8295 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.139693  8295 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.143711  8926 raft_consensus.cc:1217] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:09.145064  8360 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:09.146072  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:09.146903  9382 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.146526  8295 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:09.147608  9382 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:09.148561  9382 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.165110  8115 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.174664  9373 raft_consensus.cc:993] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:09.175115  9373 raft_consensus.cc:1081] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:09.176611  8926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54804
I20260709 13:16:09.177013  8926 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.177294  8926 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.182883  8926 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.184556  8926 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:09.185492  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:09.186040  8360 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.188861  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:09.189411  8295 raft_consensus.cc:3055] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.189685  8295 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:09.190339  8295 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.191205  8360 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:09.191422  8295 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.192257  8892 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:09.193145  9382 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.193585  9382 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:09.194420  9382 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.197489  8295 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:09.206223  8117 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.262084  8926 raft_consensus.cc:1217] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:09.363051  8295 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.364674  9382 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.380810  8217 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.382545  9393 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:09.411630  8217 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.413010  8295 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.416303  9407 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.417501  9407 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.474165  9400 raft_consensus.cc:1064] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:09.476598  9400 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.488600  8926 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.488688  8287 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.489513  8216 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.490532  9400 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.491348  9236 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.492151  9362 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.501639  8216 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.503367  9393 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.512619  9362 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.514326  8360 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.514264  8287 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.518530  9382 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.525465  8216 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.540292  8287 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.543247  9382 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.541778  8116 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.565047  8928 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.605158  9419 raft_consensus.cc:1064] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:09.607806  9419 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.622047  8369 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.625643  9407 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.643450  8928 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.645380  9358 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.647282  8360 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.651952  9352 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.657581  8293 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.662358  9423 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.679908  9352 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.681033  8926 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.667316  8360 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.691093  8216 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:09.691885  8928 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:09.692401  9362 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:09.693292  9400 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:09.699543  8360 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.704200  8116 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.713927  9362 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.715144  8216 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.715337  8926 raft_consensus.cc:2955] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.718628  8293 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.731724  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 133eb5f61ebc499ab283df4c068d5be7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:09.740569  8295 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.742050  9407 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.744544  8117 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.762068  8363 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:09.763823  9393 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:09.766183  8216 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.766886  9331 raft_consensus.cc:1064] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:09.769237  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 133eb5f61ebc499ab283df4c068d5be7 with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:09.771193  9429 tablet_replica.cc:333] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:16:09.772382  8926 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:09.772681  8293 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:09.774016  9429 raft_consensus.cc:2243] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:09.774427  9352 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:09.774796  9429 raft_consensus.cc:2272] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:09.776118  9352 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:09.776526  9331 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.787412  9419 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.829973  9429 ts_tablet_manager.cc:1916] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:09.794312  8926 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.843447  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c802b19bdf2e4f69b169d31056091820 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:09.860281  9429 ts_tablet_manager.cc:1929] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:09.861085  9362 raft_consensus.cc:1064] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:09.863014  9362 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:09.864547  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:09.860832  9429 log.cc:1199] T 133eb5f61ebc499ab283df4c068d5be7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/133eb5f61ebc499ab283df4c068d5be7
I20260709 13:16:09.869163  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 133eb5f61ebc499ab283df4c068d5be7 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:09.872140  8287 raft_consensus.cc:2955] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:09.875468  8363 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.877532  8927 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.877738  9373 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.879084  8216 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.881220  9373 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.881983  9333 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.877717  8115 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.894730  8928 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.910239  9236 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.912685  8295 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.924835  8217 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:09.936805  9362 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.951328  9362 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.003189  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet c802b19bdf2e4f69b169d31056091820 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:16:10.009419  9236 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.016170  9333 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.018417  8216 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.028697  8360 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.034337  8927 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.035283  8114 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.039172  8217 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.040832  8287 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.039891  8116 catalog_manager.cc:5697] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.048844  8928 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.051816  9439 tablet_replica.cc:333] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:16:10.082708  9439 raft_consensus.cc:2243] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.090230  9439 raft_consensus.cc:2272] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.093586  9439 ts_tablet_manager.cc:1916] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:10.112027  8363 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:10.124841  8287 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:10.133863  8928 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.135870  8217 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.148878  9236 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.155194  9236 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.163674  8927 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.166499  9373 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.169697  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:10.175127  9400 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.164839  8363 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:10.181756  9331 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.184649  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d693bc5288d40ae98bb93862716c589 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:10.189702  8927 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.188510  9439 ts_tablet_manager.cc:1929] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:10.192260  9439 log.cc:1199] T c802b19bdf2e4f69b169d31056091820 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/c802b19bdf2e4f69b169d31056091820
I20260709 13:16:10.192354  8114 catalog_manager.cc:5697] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.194605  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet c802b19bdf2e4f69b169d31056091820 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:10.194046  8217 raft_consensus.cc:2955] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.203156  9331 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.218410  8369 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.233228  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d693bc5288d40ae98bb93862716c589 with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:10.236598  9429 tablet_replica.cc:333] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:16:10.237668  9429 raft_consensus.cc:2243] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.238451  9429 raft_consensus.cc:2272] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.244271  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be0d0091520f4d6ea7668120e21a6aa0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:10.248960  8926 raft_consensus.cc:2955] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:10.256372  9429 ts_tablet_manager.cc:1916] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:10.275260  8117 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:10.277637  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 46599.9us
I20260709 13:16:10.289809  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet be0d0091520f4d6ea7668120e21a6aa0 with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:16:10.297350  9429 ts_tablet_manager.cc:1929] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:10.297857  9429 log.cc:1199] T 1d693bc5288d40ae98bb93862716c589 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/1d693bc5288d40ae98bb93862716c589
I20260709 13:16:10.300493  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 1d693bc5288d40ae98bb93862716c589 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:10.307643  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:10.308247  8217 raft_consensus.cc:606] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:10.311780  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:10.312318  8217 raft_consensus.cc:606] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:10.313719  9442 tablet_replica.cc:333] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:16:10.314618  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:10.314738  9442 raft_consensus.cc:2243] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:10.315124  8217 raft_consensus.cc:606] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:10.315546  9442 raft_consensus.cc:2272] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:10.317364  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:10.317791  8217 raft_consensus.cc:606] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:10.318488  9442 ts_tablet_manager.cc:1916] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:10.320178  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:10.320660  8217 raft_consensus.cc:606] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:10.321774  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:10.323082  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:10.332134  9442 ts_tablet_manager.cc:1929] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:10.332538  9442 log.cc:1199] T be0d0091520f4d6ea7668120e21a6aa0 P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/be0d0091520f4d6ea7668120e21a6aa0
I20260709 13:16:10.334069  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet be0d0091520f4d6ea7668120e21a6aa0 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:10.433180  9358 raft_consensus.cc:993] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:10.433754  9423 raft_consensus.cc:1081] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:10.434561  9419 raft_consensus.cc:993] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:10.435040  9358 raft_consensus.cc:1081] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:10.435387  8926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:16:10.435935  8926 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.436301  8926 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.436390  8295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46272
I20260709 13:16:10.436892  8295 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.437165  8295 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.441228  8926 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:10.442957  8295 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.443259  8926 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:10.444669  8295 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:10.445492  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:10.446060  8360 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.445533  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:10.446635  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:10.446918  8287 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.447276  8217 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.447643  8217 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:10.448288  8217 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:10.449131  8217 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.452605  8360 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:10.453204  8287 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:10.453845  8261 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:10.454330  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:10.454391  8217 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:10.455204  9407 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.455683  9407 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:10.454578  9333 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.456621  9333 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:10.456581  9407 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:10.457895  9333 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.455220  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:10.460425  8216 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.460649  8216 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:10.461323  8216 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.462431  8216 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.468080  8216 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:10.475337  8115 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.475999  8116 catalog_manager.cc:5697] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.507690  9419 raft_consensus.cc:993] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:10.508229  9419 raft_consensus.cc:1081] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:10.509543  8360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:16:10.509963  8360 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.510229  8360 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.515561  8360 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.517204  8360 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:10.518352  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:10.518352  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:10.519045  8287 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.519344  8216 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.519698  8216 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:10.520391  8216 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.521349  8216 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.525477  8287 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:10.525527  8216 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:10.526757  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:10.527508  9400 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.528017  9400 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:10.528838  9400 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.543612  8116 catalog_manager.cc:5697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.711977  9358 raft_consensus.cc:993] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:10.712437  9419 raft_consensus.cc:1081] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:10.713609  8369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:16:10.714074  8369 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.714344  8369 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.719085  8369 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.720600  8369 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:10.721202  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:10.721375  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:10.721745  8216 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.721833  8287 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.722211  8216 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:10.722893  8216 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.723891  8216 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.726229  8287 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:10.727101  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:10.727842  9400 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.728336  9400 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:10.728664  8216 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:10.729194  9400 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:10.739449  8116 catalog_manager.cc:5697] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.793802  9419 raft_consensus.cc:993] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:10.794327  9419 raft_consensus.cc:1081] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:10.796011  8926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:16:10.796564  8926 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.796857  8926 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.801841  8926 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:10.803315  8926 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:10.803874  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:10.804322  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:10.804466  8216 raft_consensus.cc:3055] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.804889  8216 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:10.804916  8369 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.805521  8216 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:10.806357  8216 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.809394  8369 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:10.810333  8892 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:10.810453  8216 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:10.811069  9407 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.811609  9407 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:10.812381  9407 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:10.820010  8116 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.861229  8216 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.862464  9440 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.873765  8369 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.875316  9333 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.041469  8287 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.042641  9362 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.056951  8216 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.059782  9400 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.072129  8287 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:11.072503  8217 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:11.073635  9407 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:11.074297  9382 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:11.175392  8287 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.176442  9362 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.198980  8217 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.200387  9454 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.202154  8360 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:11.203706  9382 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:11.216152  8217 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:11.217585  9407 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:11.323959  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:11.361011  8295 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:11.370508  8369 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:11.371544  8258 consensus_peers.cc:597] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4b32c39d3034dc0b1e48b0daa2308c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:11.371631  9463 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:11.372202  8217 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:11.373076  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:11.373970  9463 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.380559  9440 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.385452  8217 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.388638  8369 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.395665  8216 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:11.398515  8117 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.423374  8295 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:11.422662  8369 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:11.426599  9358 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.427443  9470 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.428251  8216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:11.428908  8216 raft_consensus.cc:606] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:11.429016  8183 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5da6736db6d7413682f6b3e035ca2084. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:11.455581  9419 raft_consensus.cc:993] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:11.456091  9419 raft_consensus.cc:1081] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:11.457535  8360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:16:11.458024  8360 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.458361  8360 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.462567  8363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:11.463152  8363 raft_consensus.cc:606] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:11.462625  9358 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.465540  8360 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:11.466085  8363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7feffaf779354992809fb6a460399626"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:11.466737  8363 raft_consensus.cc:606] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:11.467607  8360 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:11.468326  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:11.468886  8217 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.469162  8217 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:11.469408  8287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:11.469908  8287 raft_consensus.cc:606] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:11.469871  8217 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:11.470990  8217 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.473173  8216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:11.473682  8216 raft_consensus.cc:606] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:11.475040  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:11.475657  8287 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.475095  8295 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.480512  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:11.481995  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:11.487653  8287 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:11.488850  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:11.489547  9454 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.490022  9454 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:11.490504  8292 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:11.490813  9454 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:11.491935  8116 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.479928  8217 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:11.499780  8369 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.502475  8363 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:11.504269  9440 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:11.508869  8258 consensus_peers.cc:597] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29a17bfa374c4aa6a25b919a48f0583c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:11.509601  8115 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.514948  8213 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:11.516964  9333 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.528168  9463 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.540148  8364 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.556564  8369 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:11.556823  8117 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.568478  8213 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.599575  9419 raft_consensus.cc:993] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:11.600019  9419 raft_consensus.cc:1081] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:11.602358  8928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:16:11.602869  8928 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.603233  8928 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.609465  8928 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.612917  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:11.613473  8217 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.613778  8217 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:11.614239  8295 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:11.614440  8217 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.615464  8217 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.615514  8213 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:11.615664  9454 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.618474  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:11.619021  8295 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.620653  8928 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:11.622843  9400 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:11.623684  8332 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48e600fe8a934349bb2d4d18d10815a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:11.627890  8217 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:11.629138  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:11.630831  9407 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.630836  8295 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:11.631425  9407 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:11.632345  9400 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.632385  9407 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.640177  8213 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.654850  8287 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:11.654561  8116 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.651968  8117 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 1 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.766150  9480 raft_consensus.cc:993] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:11.766638  9480 raft_consensus.cc:1081] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:11.768200  8928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54804
I20260709 13:16:11.768748  8928 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.769068  8928 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.773877  8928 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.776669  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:11.776929  8928 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:11.777190  8369 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.779208  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:11.779803  8287 raft_consensus.cc:3055] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.780419  8287 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:11.781253  8287 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.782413  8287 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.784375  8369 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:11.785267  8892 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:11.785849  9382 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.786262  9382 raft_consensus.cc:697] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:11.787077  9382 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.788565  8287 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:11.796612  8116 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.809716  9400 raft_consensus.cc:993] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:11.810304  9400 raft_consensus.cc:1081] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:11.811966  8928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7feffaf779354992809fb6a460399626"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:56040
I20260709 13:16:11.812529  8928 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.814776  8928 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.821164  8928 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.823207  8928 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:11.823638  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:11.824255  8369 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.824275  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:11.824658  8369 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:11.824872  8287 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.825448  8369 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.826601  8369 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.828965  8287 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:11.829988  8889 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:11.830600  9382 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.831027  9382 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:11.831784  9382 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:11.833954  8369 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:11.856949  8116 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.867633  9489 ts_tablet_manager.cc:933] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:11.870702  9489 tablet_copy_client.cc:323] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:16:11.872242  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet c4b32c39d3034dc0b1e48b0daa2308c0 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:16:11.872790  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet c4b32c39d3034dc0b1e48b0daa2308c0 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-c4b32c39d3034dc0b1e48b0daa2308c0
I20260709 13:16:11.880736  8305 tablet_copy_source_session.cc:215] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:11.883358  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b32c39d3034dc0b1e48b0daa2308c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:11.897660  9489 tablet_copy_client.cc:806] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:11.898058  9491 ts_tablet_manager.cc:933] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:11.898264  9489 tablet_copy_client.cc:670] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:11.899864  9491 tablet_copy_client.cc:323] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:16:11.901479  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 5da6736db6d7413682f6b3e035ca2084 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:16:11.901984  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 5da6736db6d7413682f6b3e035ca2084 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-5da6736db6d7413682f6b3e035ca2084
I20260709 13:16:11.902042  9489 tablet_copy_client.cc:538] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:11.907497  8230 tablet_copy_source_session.cc:215] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:11.911227  9489 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:11.911747  9491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da6736db6d7413682f6b3e035ca2084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:11.917011  8213 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.918331  9362 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.935025  9491 tablet_copy_client.cc:806] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:11.939182  9491 tablet_copy_client.cc:670] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:11.947598  9491 tablet_copy_client.cc:538] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:11.955318  9489 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.956506  9489 tablet_bootstrap.cc:492] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:11.957492  8287 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.961084  9454 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.963843  9491 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:11.964617  9489 ts_tablet_manager.cc:1403] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.008s
I20260709 13:16:11.968389  9489 raft_consensus.cc:359] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:11.969249  9489 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:11.969905  9489 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:11.974856  9489 ts_tablet_manager.cc:1434] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:16:11.985800  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-c4b32c39d3034dc0b1e48b0daa2308c0 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:16:11.986243  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-c4b32c39d3034dc0b1e48b0daa2308c0 on tablet c4b32c39d3034dc0b1e48b0daa2308c0 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:11.987818  9491 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:11.988804  9491 tablet_bootstrap.cc:492] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:11.989486  9491 ts_tablet_manager.cc:1403] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:16:11.992889  9491 raft_consensus.cc:359] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:11.993768  9491 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:11.994431  9491 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:11.997165  9491 ts_tablet_manager.cc:1434] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:12.000288  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-5da6736db6d7413682f6b3e035ca2084 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:16:12.000694  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-5da6736db6d7413682f6b3e035ca2084 on tablet 5da6736db6d7413682f6b3e035ca2084 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:12.003078  9489 ts_tablet_manager.cc:933] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:12.008337  9400 raft_consensus.cc:993] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:12.008785  9400 raft_consensus.cc:1081] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:12.010355  8295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:16:12.010866  8295 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.011195  8295 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.012261  9498 ts_tablet_manager.cc:933] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:12.033068  9489 tablet_copy_client.cc:323] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:16:12.034870  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 29a17bfa374c4aa6a25b919a48f0583c from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:16:12.035439  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 29a17bfa374c4aa6a25b919a48f0583c from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-29a17bfa374c4aa6a25b919a48f0583c
I20260709 13:16:12.034723  8295 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.047796  9498 tablet_copy_client.cc:323] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:16:12.050856  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 48e600fe8a934349bb2d4d18d10815a6 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:16:12.051393  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 48e600fe8a934349bb2d4d18d10815a6 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-48e600fe8a934349bb2d4d18d10815a6
I20260709 13:16:12.056576  8305 tablet_copy_source_session.cc:215] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:12.060606  8378 tablet_copy_source_session.cc:215] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:12.062698  8293 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.061273  9489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a17bfa374c4aa6a25b919a48f0583c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:12.064456  8295 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:12.065987  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:12.066534  8928 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.065812  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:12.067083  8364 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.067402  8364 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:12.068153  8364 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.069336  8364 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.072885  9382 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.076386  8364 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:12.077497  8261 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:12.075922  8928 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:12.078338  9463 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.078816  9463 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:12.079730  9463 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.095880  9498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e600fe8a934349bb2d4d18d10815a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:12.105036  9489 tablet_copy_client.cc:806] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:12.106599  9489 tablet_copy_client.cc:670] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:12.110349  9489 tablet_copy_client.cc:538] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:12.124778  9489 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:12.135174  8213 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.141384  9498 tablet_copy_client.cc:806] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:12.141973  9498 tablet_copy_client.cc:670] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:12.144213  9382 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.147116  9498 tablet_copy_client.cc:538] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:12.173310  9498 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:12.170207  8117 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:12.206204  9489 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.207065  9489 tablet_bootstrap.cc:492] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:12.207695  9489 ts_tablet_manager.cc:1403] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.083s	user 0.046s	sys 0.024s
I20260709 13:16:12.210708  9489 raft_consensus.cc:359] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:12.211243  9489 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:12.211655  9489 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:12.214497  9489 ts_tablet_manager.cc:1434] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:12.216603  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-29a17bfa374c4aa6a25b919a48f0583c received from {username='slave'} at 127.0.0.1:33926
I20260709 13:16:12.216992  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-29a17bfa374c4aa6a25b919a48f0583c on tablet 29a17bfa374c4aa6a25b919a48f0583c with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:12.232475  8364 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.234774  9407 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.252470  9498 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:12.253393  9498 tablet_bootstrap.cc:492] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:12.254025  9498 ts_tablet_manager.cc:1403] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.004s
I20260709 13:16:12.257527  9498 raft_consensus.cc:359] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:12.258354  9498 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:12.258978  9498 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:12.263236  9498 ts_tablet_manager.cc:1434] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:16:12.275789  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-48e600fe8a934349bb2d4d18d10815a6 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:16:12.276252  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-48e600fe8a934349bb2d4d18d10815a6 on tablet 48e600fe8a934349bb2d4d18d10815a6 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:12.279453  8287 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.281809  9382 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.304939  8295 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.306254  9382 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.317942  8364 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.319466  9407 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.408223  8926 raft_consensus.cc:1217] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:12.444519  8926 raft_consensus.cc:1217] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:12.481663  8926 raft_consensus.cc:1217] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:12.482883  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:12.496148  8926 raft_consensus.cc:1217] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:12.564764  8928 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.566131  9480 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.573526  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:12.597378  8364 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:12.598948  9463 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:12.642503  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:12.643173  8364 raft_consensus.cc:606] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:12.646278  8216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c835fd22b7643a981b446089ad74066"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:12.646828  8216 raft_consensus.cc:606] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:12.649837  8287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:12.650350  8287 raft_consensus.cc:606] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:12.652783  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:12.653290  8213 raft_consensus.cc:606] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:12.654420  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:12.657027  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:12.702188  9481 raft_consensus.cc:993] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:12.702728  9463 raft_consensus.cc:1081] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:12.704231  8364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55878
I20260709 13:16:12.704761  8364 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.705152  8364 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.713570  8364 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:12.716178  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:12.716550  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:12.716710  8213 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.717119  8287 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.717432  8287 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:12.718129  8287 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:12.719085  8287 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.725052  8287 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:12.725940  8213 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:12.726017  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:12.726861  9400 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.726874  8364 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:12.727320  9400 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:12.728190  9400 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:12.741664  8117 catalog_manager.cc:5697] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.783736  9419 raft_consensus.cc:993] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:12.784387  9470 raft_consensus.cc:1081] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:12.786123  8287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46272
I20260709 13:16:12.786757  8287 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.787186  8287 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.802948  8287 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.805486  8287 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:12.807201  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:12.807442  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:12.807796  8928 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.808117  8213 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.808476  8213 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:12.809149  8213 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.810751  8213 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.816905  8213 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:12.818169  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:12.819621  9463 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.824000  9463 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:12.826296  9463 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.827847  8928 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:12.835978  9480 raft_consensus.cc:1064] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:12.838521  9480 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.849128  9400 raft_consensus.cc:993] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:12.849650  9400 raft_consensus.cc:1081] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:12.855683  8287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:16:12.856258  8287 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.856611  8287 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.859130  8928 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.860955  8364 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.861217  9480 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:12.865325  8287 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:12.870416  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:12.870599  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:12.871012  8369 raft_consensus.cc:3055] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.871132  8217 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.871383  8369 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:12.872218  8369 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:12.876546  9480 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:12.877187  8213 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.876401  8287 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:12.879206  9481 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:12.895247  8117 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:12.913358  8217 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:12.914569  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:12.916074  9481 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.916759  9481 raft_consensus.cc:697] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:12.917959  9481 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:12.925657  8369 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.925848  9470 raft_consensus.cc:1064] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:12.929134  9470 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.936619  8369 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:12.938678  9480 raft_consensus.cc:1064] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:12.941577  9480 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:12.941965  9523 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:12.943415  8926 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:12.996516  8213 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.004333  8926 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.007190  8928 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.008093  8287 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:12.998493  8117 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.012575  8369 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.012212  9358 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:12.994108  8116 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.032006  8369 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.036412  9481 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.040160  8364 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:13.043555  9523 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.049536  8215 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.063700  9504 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:13.064879  9419 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.071415  9463 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.141328  8293 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:13.156816  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 67200.9us
I20260709 13:16:13.167389  9358 raft_consensus.cc:993] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:13.168138  9358 raft_consensus.cc:1081] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:13.174535  8363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c835fd22b7643a981b446089ad74066"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:16:13.175936  8363 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:13.176353  8363 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.185505  8295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:13.186203  8295 raft_consensus.cc:606] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:16:13.219539  8292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:13.220192  8292 raft_consensus.cc:606] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:16:13.220697  8290 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:13.221920  8102 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 48e600fe8a934349bb2d4d18d10815a6 already in progress [suppressed 2 similar messages]
I20260709 13:16:13.227247  9362 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:13.222468  8363 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:13.235950  8360 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.235021  9538 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.256224  8369 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:13.259919  8928 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:13.263800  9536 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:13.296329  9480 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:13.298040  8363 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:13.299994  8287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46270
I20260709 13:16:13.300572  8287 raft_consensus.cc:606] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:16:13.306715  8116 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.311317  8218 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.351765  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:13.352502  8215 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:13.352823  8215 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:13.353461  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:13.354167  8925 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.353724  8215 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:13.381234  8215 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:13.385100  9400 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:13.396384  8928 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.398840  8215 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
W20260709 13:16:13.401242  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 45448.3us
I20260709 13:16:13.402639  9536 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.403852  8928 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.406158  8926 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 LEARNER]: Advancing to term 2
I20260709 13:16:13.410948  9524 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:16:13.430964  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44549.6us
I20260709 13:16:13.419144  9536 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:16:13.453078  9544 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:16:13.456475  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 43792.3us
I20260709 13:16:13.466898  8926 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:13.470970  9481 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:13.476364  9543 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:16:13.478089  8219 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.487397  8925 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:13.492015  9463 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:13.503661  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 29a17bfa374c4aa6a25b919a48f0583c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:13.475432  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:13.511191  9533 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:13.511736  9533 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:13.512967  9533 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:13.570971  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 68287.1us
I20260709 13:16:13.574514  8369 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.577576  8295 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.613276  8364 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.619442  8368 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:13.625159  9524 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.634845  9463 raft_consensus.cc:993] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:16:13.635450  9463 raft_consensus.cc:1081] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
W20260709 13:16:13.640179  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 148892us
W20260709 13:16:13.641973  8166 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:16:13.642371  8166 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 48e600fe8a934349bb2d4d18d10815a6 already in progress
W20260709 13:16:13.642649  8166 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 48e600fe8a934349bb2d4d18d10815a6 already in progress
I20260709 13:16:13.643339  8368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55878
I20260709 13:16:13.643893  8368 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:13.644281  8368 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.645233  8219 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:16:13.658375  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:13.656133  8927 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.661710  8368 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:13.663041  8369 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:13.666297  9463 consensus_queue.cc:1059] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.667194  9463 raft_consensus.cc:3055] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:13.667524  9463 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:13.666193  8213 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:13.668393  9463 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:13.669544  9463 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.675501  8114 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.691147  8368 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:13.695032  8215 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.699774  8924 raft_consensus.cc:2955] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.721927  8927 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:13.722582  8287 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:13.690778  8117 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.725293  9358 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:13.727558  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 88258.7us
I20260709 13:16:13.738341  9504 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:13.744072  9470 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.761183  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:13.763266  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:13.765738  8927 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.778244  8293 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:13.780148  8217 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.790514  8287 raft_consensus.cc:2955] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.793169  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5da6736db6d7413682f6b3e035ca2084 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:13.794354  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a17bfa374c4aa6a25b919a48f0583c with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:16:13.798316  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:13.792671  8114 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 2 to 3, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.810642  9534 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:13.811429  9534 raft_consensus.cc:697] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:13.812661  9534 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:13.846629  8217 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:13.880931  9562 tablet_replica.cc:333] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:16:13.882258  9562 raft_consensus.cc:2243] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.883038  9562 raft_consensus.cc:2272] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.889163  9562 ts_tablet_manager.cc:1916] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:13.899129  8116 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 3 to 4, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 1 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.909759  9562 ts_tablet_manager.cc:1929] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:13.910349  9562 log.cc:1199] T 29a17bfa374c4aa6a25b919a48f0583c P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/29a17bfa374c4aa6a25b919a48f0583c
I20260709 13:16:13.914422  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 29a17bfa374c4aa6a25b919a48f0583c (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:13.922104  8117 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 3 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.925437  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 5da6736db6d7413682f6b3e035ca2084 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55864
I20260709 13:16:13.931414  9563 tablet_replica.cc:333] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:16:13.932751  9563 raft_consensus.cc:2243] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.934063  8287 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:13.938509  9563 raft_consensus.cc:2272] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.940624  8368 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:13.942399  9551 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:13.947372  8926 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:13.949116  9463 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.952550  9563 ts_tablet_manager.cc:1916] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:13.964854  8368 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.967096  9563 ts_tablet_manager.cc:1929] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:13.967595  9563 log.cc:1199] T 5da6736db6d7413682f6b3e035ca2084 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/5da6736db6d7413682f6b3e035ca2084
I20260709 13:16:13.967496  8926 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.969767  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 5da6736db6d7413682f6b3e035ca2084 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:13.959476  9480 raft_consensus.cc:2955] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:13.988858  8219 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:13.990140  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:13.991096  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4b32c39d3034dc0b1e48b0daa2308c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:13.991178  9534 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:14.011053  8116 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 3 to 4, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 1 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:14.022934  8926 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:14.025110  9454 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:14.039073  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet c4b32c39d3034dc0b1e48b0daa2308c0 with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58414
I20260709 13:16:14.043473  9562 tablet_replica.cc:333] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:16:14.044556  9562 raft_consensus.cc:2243] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.045280  9562 raft_consensus.cc:2272] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.069375  9562 ts_tablet_manager.cc:1916] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:14.092661  9562 ts_tablet_manager.cc:1929] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:14.093171  9562 log.cc:1199] T c4b32c39d3034dc0b1e48b0daa2308c0 P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/c4b32c39d3034dc0b1e48b0daa2308c0
I20260709 13:16:14.095530  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet c4b32c39d3034dc0b1e48b0daa2308c0 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:16:14.101290  8368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47a3ff85da594e17a687e7c116983565"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:14.101740  8368 raft_consensus.cc:606] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:14.104415  8368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:14.104818  8368 raft_consensus.cc:606] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:14.106985  8287 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:14.107473  8287 raft_consensus.cc:606] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:14.109720  8368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:14.110064  8368 raft_consensus.cc:606] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:14.110916  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:14.111902  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:14.120770  9533 raft_consensus.cc:993] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:14.121313  9454 raft_consensus.cc:1081] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:14.122850  8293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:16:14.123349  8293 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:14.123674  8293 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.123775  9400 raft_consensus.cc:993] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:14.124231  9400 raft_consensus.cc:1081] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:14.126348  8287 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47a3ff85da594e17a687e7c116983565"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:16:14.126814  8287 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:14.127142  8287 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.129916  8293 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:14.133006  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:14.133530  8368 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:14.133714  8293 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:14.133862  8368 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:14.134835  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:14.134956  8368 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:14.135393  8219 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.136776  8287 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:14.137326  8368 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.139307  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:14.139632  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:14.139782  8364 raft_consensus.cc:3055] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:14.140143  8364 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:14.140156  8926 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.140964  8364 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:14.141637  8219 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:14.142045  8364 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.142740  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:14.143520  9480 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.143996  8368 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:14.144788  9480 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:14.145732  8287 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:14.145705  9480 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:14.146461  8926 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:14.147663  8258 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:14.148449  9523 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:14.148972  9523 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:14.150002  8364 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:14.149861  9523 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:14.199736  9533 raft_consensus.cc:993] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:14.200346  9533 raft_consensus.cc:1081] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:16:14.206637  8926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:56040
I20260709 13:16:14.207430  8926 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:14.207964  8926 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:14.388689  8926 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:15.253978  8115 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.275418  8115 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:15.868079  8334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.000s	sys 0.003s
W20260709 13:16:15.869257  8334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.003s
I20260709 13:16:15.948670  9576 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:15.949383  9576 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:15.951396  9575 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:15.952081  9575 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:15.954056  8892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.006s	sys 0.005s
W20260709 13:16:15.960556  8892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.006s	sys 0.006s
I20260709 13:16:15.962193  9571 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:15.957937  9576 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:15.962997  9580 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:15.963132  9576 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:15.972915  8891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.000s	sys 0.012s
W20260709 13:16:15.973343  8891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.000s	sys 0.013s
I20260709 13:16:15.973311  9576 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:15.973889  9583 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:15.974403  9583 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:15.975622  9576 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:15.976280  9576 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:15.976876  9576 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:15.979651  9576 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:15.980392  9576 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:15.980973  9576 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:15.983009  9576 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:15.983605  9583 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:15.965513  9575 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:15.971921  9577 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:15.962832  9571 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:15.988373  9579 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:15.988021  9580 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:15.986238  9569 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:15.989434  9583 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.000831  9580 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:15.998931  9579 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.032075  9582 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:16.030611  9583 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.001212  9577 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.038264  9576 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.038460  9589 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.038865  9576 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.039314  9589 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.040014  9577 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:16.032589  9578 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.041357  9576 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.041503  9578 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.042091  9589 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:16.043347  9589 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.033368  9575 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.044015  9589 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.044509  9575 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.046636  9575 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.032586  9586 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.047585  9586 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.049993  9586 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.050505  9586 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.051074  9586 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.030432  9590 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.054466  9580 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.055035  9571 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:16.036808  9582 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.061475  9582 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.055075  9580 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.062000  9582 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.062552  9582 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.053742  9575 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.064327  9577 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:16.065814  9575 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.066125  9577 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.063967  9580 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.068342  9590 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.069375  9577 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.043807  9578 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.073657  9579 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.047379  9589 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:16.030246  9569 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.085107  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:16.101011  8364 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:16.101377  8364 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:16.103233  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:16.103508  9583 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.103884  8369 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:16.104250  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:16.105391  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:16.106002  8366 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:16.106020  9569 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:16.107436  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:16.102142  8364 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.108733  9578 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.074582  9590 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.109401  9578 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.109916  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:16.110584  8361 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:16.110625  9582 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.089408  9586 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.111177  9583 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.111662  9578 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.111816  9583 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.112607  9590 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:16.113163  9590 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.076710  9575 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.113853  9583 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.053960  9576 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.117690  9590 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.114537  9582 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.108776  8364 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.116289  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:16.115118  9578 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.121752  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:16.118789  9582 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.116186  9576 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.130543  8364 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:16.127990  9571 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.120124  9583 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.131639  9571 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.132441  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.133098  8288 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:16.133944  9571 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:16.122809  9590 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.134361  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.123132  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:16.134114  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.138489  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.139168  9588 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.128386  9580 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:16.139652  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.140020  9580 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.140532  9580 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.138620  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.142153  8289 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:16.122730  9594 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:16.143023  9592 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.143388  9594 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.144562  9594 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.139709  9588 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.131729  9583 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.141062  9590 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.146093  9596 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.128621  9579 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.145892  9571 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:16.148326  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:16.148813  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:16.155001  9571 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.149621  9596 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.327178  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:16.156244  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.155938  9579 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.320678  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:16.322955  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:16.333640  8361 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:16.333851  9579 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.181994  9571 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.156466  9588 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:16.135456  9582 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.339857  9576 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.344550  9597 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.346055  9598 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.180917  8924 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:16.124019  9578 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.320580  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.350628  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.335106  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:16.320763  9596 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.155217  9593 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.400236  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.402957  9599 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:16.406795  9603 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.144323  9592 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:16.416029  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 91770.2us
I20260709 13:16:16.416214  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:16.422650  8927 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEARNER]: Advancing to term 3
I20260709 13:16:16.408366  8289 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:16.414480  9598 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.429860  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:16.432255  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:16.431602  9569 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:16.442569  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:16.409740  9597 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.430744  9593 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.444680  9586 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.546289  9586 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.577957  9600 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.533061  9590 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.438035  9588 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:16.516992  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 74471.7us
I20260709 13:16:16.604116  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:16.447230  8927 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:16.591647  9607 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.578787  9600 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.437704  9603 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.481316  9592 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.478595  9584 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:16.640960  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:16.503751  9577 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:16.583603  9583 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.663303  9589 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:16.666580  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:16.594449  9588 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.444665  9569 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.469030  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:16.639293  9602 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.666385  8363 raft_consensus.cc:2376] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2. Re-sending same reply.
I20260709 13:16:16.669602  8364 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:16.516113  9604 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.610845  9590 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:16.614218  9578 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.593569  9580 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.671535  9584 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.676899  8928 raft_consensus.cc:2393] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:16.676952  9584 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.678035  9580 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.667331  9577 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.668471  9589 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.671219  9569 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.673175  9596 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.670629  9588 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.436379  9599 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.674551  8924 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:16.718478  9609 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:16.685878  9577 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.668354  9576 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:16.714947  9589 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:16.732386  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:16.717823  9586 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:16.664793  9607 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.733161  8290 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:16.724538  9590 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:16.684587  9602 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.719959  9604 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:16.737993  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 62208.2us
I20260709 13:16:17.125953  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:17.127277  8892 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:17.127399  9582 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:17.127933  9582 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.128556  9612 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:17.128945  9612 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.129328  9612 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.129499  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:17.129972  9582 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.131790  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:17.132375  8364 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.975008  9593 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.133944  9599 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.987185  8286 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:17.134881  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1000) took 1001 ms. Trace:
I20260709 13:16:16.984306  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:17.137205  8364 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:17.131189  9619 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:17.143560  9619 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.114187  9600 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.145323  9629 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:17.145852  9629 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.148200  9629 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:17.149071  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.144064  9619 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.150520  9573 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.151051  9573 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:14.393832  8926 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.152529  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56040 (request call id 258) took 2948 ms. Trace:
I20260709 13:16:17.152845  8926 rpcz_store.cc:276] 0709 13:16:14.204033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.206438 (+  2405us) service_pool.cc:224] Handling call
0709 13:16:17.152415 (+2945977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:17.153373  9573 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:16.849197  9598 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.157990  9617 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.158489  9617 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.160724  9617 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.160370  9619 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.161198  9629 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.161703  9629 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:17.162801  8334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.005s	sys 0.004s
W20260709 13:16:17.177224  8334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.007s	sys 0.005s
I20260709 13:16:17.180634  9578 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.181171  9578 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.182471  9582 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:17.065389  9594 consensus_meta.cc:287] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.920s	user 0.010s	sys 0.000s
W20260709 13:16:17.047209  9571 consensus_meta.cc:287] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 13:16:16.748911  9609 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:16.730821  9596 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.274668  8115 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46484 (request call id 255) took 3093 ms. Trace:
I20260709 13:16:17.135262  8286 rpcz_store.cc:276] 0709 13:16:16.133177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.986212 (+853035us) service_pool.cc:224] Handling call
0709 13:16:16.986638 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.134650 (+148012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.134829 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:17.347638  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:17.353013  8364 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:17.124847  9597 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:16.804636  9603 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.042474  9605 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:17.038945  9574 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.039774  9583 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:16.795102  9606 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:16.898343  9608 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:17.009976  8952 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc640 after lost signal to thread 7079
I20260709 13:16:17.056306  9570 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.167197  9610 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.167328  9592 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.366451  9603 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.366535  9624 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.163724  9629 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.380896  8213 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:17.374503  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:17.164408  9590 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.176317  9617 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.169209  9575 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.182984  9578 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:17.377017  8259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.000s	sys 0.051s
I20260709 13:16:17.169704  9622 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.274452  9600 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.162636  9619 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.165798  9573 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.176401  9599 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.172073  9627 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:17.171705  9630 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.375349  9602 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.385550  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.182979  9582 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.382862  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:17.170043  9621 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.389312  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.170399  9626 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:17.375260  8952 debug-util.cc:398] Leaking SignalData structure 0x7b080026b080 after lost signal to thread 8152
I20260709 13:16:17.394567  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.388202  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:17.395354  8259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.000s	sys 0.052s
I20260709 13:16:17.173867  9577 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.159539  9588 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.355826  9571 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.375425  9611 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.056565  9587 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.379657  9596 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.355160  9594 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.404356  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.406401  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:17.407748  8219 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:17.411015  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:17.411263  9628 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:17.398887  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.377264  9583 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.375728  9592 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.375651  9616 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.386484  9603 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.375525  9620 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.405578  9602 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:17.393607  9575 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.393097  9617 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.397213  9573 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.399973  9599 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.375383  9570 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.422271  9596 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.425896  9580 raft_consensus.cc:2764] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:16:17.428102  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:17.442305  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.375572  9610 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.442718  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.443351  9623 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:17.443423  9603 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.374637  9606 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:17.435137  8952 debug-util.cc:398] Leaking SignalData structure 0x7b0800353800 after lost signal to thread 8244
I20260709 13:16:17.415632  9600 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.426090  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.428611  8289 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:17.375011  9574 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.448494  8220 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
W20260709 13:16:17.453516  8889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.009s	sys 0.009s
W20260709 13:16:17.462349  8889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.010s	sys 0.009s
I20260709 13:16:17.435475  9598 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.438021  9628 raft_consensus.cc:697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:17.464759  8215 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:17.393148  9624 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.375176  9605 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.429797  9587 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.415287  9572 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:16:17.443796  9620 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.374696  9608 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.348336  8115 rpcz_store.cc:276] 0709 13:16:14.164952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.165612 (+   660us) service_pool.cc:224] Handling call
0709 13:16:17.258010 (+3092398us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:15.968705 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:15.969325 (+   620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:15.969360 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:16:15.969379 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:15.969783 (+   404us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:15.969858 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:15.969883 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:15.970176 (+   293us) tablet.cc:701] Row locks acquired
0709 13:16:15.970193 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:16:15.970310 (+   117us) write_op.cc:270] Start()
0709 13:16:15.970416 (+   106us) write_op.cc:276] Timestamp: P: 1783602975970275 usec, L: 0
0709 13:16:15.970435 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:16:15.971037 (+   602us) log.cc:844] Serialized 912 byte log entry
0709 13:16:16.085256 (+114219us) op_driver.cc:464] REPLICATION: finished
0709 13:16:16.088621 (+  3365us) write_op.cc:301] APPLY: starting
0709 13:16:16.088728 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:16.088873 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:16.089014 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:16.089389 (+   375us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:16.101156 (+ 11767us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:16.106847 (+  5691us) write_op.cc:312] APPLY: finished
0709 13:16:16.107085 (+   238us) log.cc:844] Serialized 29 byte log entry
0709 13:16:16.111959 (+  4874us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:16.112073 (+   114us) write_op.cc:454] Released schema lock
0709 13:16:16.112119 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:16.112469 (+   350us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:16.112510 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":181908,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":3091,"apply.run_cpu_time_us":2000,"apply.run_wall_time_us":23841,"mutex_wait_us":4659,"num_ops":2,"prepare.queue_time_us":11842,"prepare.run_cpu_time_us":3387,"prepare.run_wall_time_us":20748,"raft.queue_time_us":102028,"raft.run_cpu_time_us":2968,"raft.run_wall_time_us":3495,"replication_time_us":114598,"thread_start_us":113360,"threads_started":4,"wal-append.queue_time_us":10102,"wal-append.run_cpu_time_us":24845,"wal-append.run_wall_time_us":1132573}]]}
I20260709 13:16:17.468870  8923 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:17.408102  9627 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.457532  9623 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:17.473577  8333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.029s	sys 0.050s
W20260709 13:16:17.478744  8952 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad9a0 after lost signal to thread 8319
I20260709 13:16:17.484120  8927 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:17.421993  9621 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.479249  9571 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.447940  9596 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:17.470489  9593 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.421258  9626 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.482026  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.466723  9607 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.471962  9604 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.467597  9599 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.452104  9602 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.405053  9622 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.437403  9616 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.415777  9630 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:17.488714  8333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.030s	sys 0.050s
I20260709 13:16:17.482961  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.502755  9608 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.504338  9620 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.472630  9598 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:17.485188  8952 debug-util.cc:398] Leaking SignalData structure 0x7b08002d7cc0 after lost signal to thread 8320
I20260709 13:16:17.434597  9611 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.452343  9612 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.459251  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:17.484122  9623 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:17.514020  9569 consensus_meta.cc:287] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.008s
I20260709 13:16:17.505097  9593 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.516119  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.516237  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.481782  8925 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:17.521040  9574 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.522169  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.480537  9586 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.529516  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.532280  9617 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.515888  9602 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.534811  8220 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:17.534013  9592 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:17.536464  8952 debug-util.cc:398] Leaking SignalData structure 0x7b080033fc20 after lost signal to thread 8393
I20260709 13:16:17.536950  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.519359  9609 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:17.562526  8952 debug-util.cc:398] Leaking SignalData structure 0x7b08002e1a20 after lost signal to thread 8955
I20260709 13:16:17.491190  9587 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.548221  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.491678  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.534520  9582 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.539490  9637 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.566136  9610 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.540149  9588 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.521430  9638 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:17.546466  8922 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.541949  9569 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.524109  9636 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.555200  9594 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.554174  9608 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.582278  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.582871  8216 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:17.567003  9573 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.551605  9626 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.567243  9617 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.585263  9610 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.593518  9632 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.570911  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.598291  8219 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:17.593772  9610 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.601655  9568 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.579452  9592 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:17.559264  9586 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.610172  9627 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.597474  9600 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.593998  9602 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:17.626490  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.627081  8290 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:17.569460  9628 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.633978  9621 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.636531  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:17.590935  9608 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.637161  8364 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:17.637392  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:17.637925  8363 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.638435  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:17.566238  9637 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.639001  8364 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:17.599256  9632 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.648283  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.606896  9624 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.644632  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:17.650663  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:17.648828  8294 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:17.629292  9610 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.645906  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.586097  9638 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.612643  9568 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.621634  9616 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.667338  8363 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:17.668581  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:17.660308  9583 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.660486  9569 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.620544  9592 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.666179  8361 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:17.635715  9606 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.659307  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:17.608268  9636 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:17.656121  9589 consensus_meta.cc:287] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.907s	user 0.013s	sys 0.003s
I20260709 13:16:17.614297  9617 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.676870  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.677326  9575 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.679803  8892 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:17.649406  9602 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.676455  8364 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.668388  9598 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.660989  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.672140  8921 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:17.686138  9616 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:17.678608  9612 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.677853  9593 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.693290  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.682355  9583 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:17.723402  9583 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.723843  9583 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.676008  9605 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.682341  9589 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.691666  9592 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.695755  9616 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:17.731211  9617 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.687911  9611 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.746773  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.758446  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:17.742571  9616 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:17.776643  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.779138  9589 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.780895  9608 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.761680  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.783247  8219 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:17.784415  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.785064  8219 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:17.793175  9602 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.764575  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.794793  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.756165  9586 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:17.794499  9584 consensus_meta.cc:287] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 1.117s	user 0.017s	sys 0.004s
I20260709 13:16:17.855042  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.794281  9568 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:17.861341  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.862653  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.797789  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:17.866712  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.868393  9637 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.869654  8364 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:17.872157  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.798406  8214 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:17.874830  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.868847  8361 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:17.870767  9612 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.877017  9596 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.877354  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.877935  8215 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:17.877374  9612 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:17.878211  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:17.878756  8295 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:17.878712  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.880411  8215 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:17.800618  9622 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.881508  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.881239  9612 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:17.883237  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.883810  8216 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:17.884342  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.886312  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:17.845813  9584 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.888180  9596 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:17.891520  8364 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:17.892952  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.888839  9596 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:17.890977  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:17.895900  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:17.901266  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 397165us
I20260709 13:16:17.975841  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:17.978121  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 72589.9us
I20260709 13:16:17.895313  9622 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.029994  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 371245us
I20260709 13:16:18.039916  8364 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.041086  8928 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.056926  8926 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:18.057977  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.059358  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.060000  8926 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:18.060356  9596 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.061308  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.062749  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:18.063915  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 401850us
I20260709 13:16:17.987150  9572 raft_consensus.cc:1064] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:18.068559  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.070134  8368 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.026165  9577 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:17.988555  9632 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.071203  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:18.074362  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.054661  9616 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.075434  8368 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:18.076890  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.077353  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.078928  9583 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.081161  9583 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.082513  8926 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.082334  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.083047  8363 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:16:18.084408  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:18.026676  8923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 264) took 1706 ms (client timeout 1712 ms). Trace:
I20260709 13:16:18.085325  9577 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.071290  9584 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.085731  9577 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:18.088851  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:18.088888  8922 consensus_meta.cc:287] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.500s	user 0.001s	sys 0.009s
I20260709 13:16:18.090669  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.090790  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:18.092933  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:18.093055  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:18.095935  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.096329  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:18.096609  8216 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.102672  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.104063  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.105480  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.105952  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.100637  9639 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.108315  9639 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:18.108703  9639 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.096122  9589 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.069222  9622 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:18.111104  8889 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:18.103590  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:18.089447  9577 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.119400  8928 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.111933  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:18.121146  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.121821  8369 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:18.122097  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:18.085093  8923 rpcz_store.cc:269] 0709 13:16:16.320783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.334854 (+ 14071us) service_pool.cc:224] Handling call
0709 13:16:18.026451 (+1691597us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002c1fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:18.026594 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2380349696}
I20260709 13:16:18.123677  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:18.074728  9642 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:18.097335  9584 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.091359  8922 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:18.102450  9573 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.104151  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.103576  9611 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.104188  8921 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.130786  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.132388  8927 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.131815  8217 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:18.125787  9589 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.126983  9615 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.129611  9586 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.144326  9586 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:18.131469  9573 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:18.144814  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.138535  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:18.128684  9584 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:18.134137  9580 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.150920  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.134315  9611 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:18.138252  9596 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.157298  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.154172  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:18.146867  9615 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:18.166646  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:18.170305  9615 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.142396  9589 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:18.149751  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.152498  9573 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.168733  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.169751  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.170957  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:18.163812  9608 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.174892  9570 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.175103  9622 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.158169  9584 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.151635  9586 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.180188  9632 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.163473  9611 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.164358  9596 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:18.171157  9617 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.183775  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:18.173209  9589 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.184862  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:18.185562  9572 raft_consensus.cc:1068] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Unable to promote non-voter d03eaa3ce81042f9b114cd00a7f41b17: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:16:18.186015  9623 consensus_meta.cc:287] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.002s
I20260709 13:16:18.185958  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.176792  9576 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.187461  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.187891  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.171651  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.188093  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.188211  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.194861  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.182694  9608 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:18.195363  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.182150  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.190569  9632 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.202732  9632 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.198098  9623 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.202847  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.203478  8367 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.204391  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.196794  9570 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:18.200008  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 77975.3us
I20260709 13:16:18.205917  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.194703  9617 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:18.205152  8363 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:18.193603  9596 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.205386  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.196933  9576 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:18.213131  9611 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.204439  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.202873  9572 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.216684  9576 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.216465  9619 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.202422  9608 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.218592  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.218863  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.206219  9570 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:18.219642  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.243391  9573 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.220197  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.254434  9632 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.257799  9622 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:18.258769  9622 raft_consensus.cc:3055] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:18.243563  8367 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.259083  9622 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:18.259914  9622 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.260350  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.260387  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.261103  9622 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.223246  9619 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:18.247452  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.248172  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.214227  9617 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.220721  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.219341  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.252314  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.246764  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.255332  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.218390  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.252961  9570 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.250861  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.243039  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.221012  9572 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:18.264532  9623 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.271829  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.266558  9619 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.261732  8361 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.272794  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.273984  9632 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.274145  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.274406  9611 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:18.274003  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.293063  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.293315  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.276376  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.294677  8291 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:18.295022  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.278179  8216 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:18.272800  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.271346  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.280318  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.299335  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.299464  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.300629  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.301018  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.302673  8361 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.302888  9615 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.290321  8365 raft_consensus.cc:2393] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:18.271826  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 58682.8us
I20260709 13:16:18.274237  9587 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.289041  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.305099  8217 raft_consensus.cc:2376] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2. Re-sending same reply.
I20260709 13:16:18.288285  9573 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:18.291378  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.278119  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.304270  8361 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.306331  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.285507  9572 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.308431  9587 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.313472  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.314908  8889 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.321846  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.323632  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.324553  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.325100  8218 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.325529  9636 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:18.323734  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.331887  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.332494  8218 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:18.333211  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.333483  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.334205  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:18.332518  8368 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:18.341178  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.343592  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:18.326474  9577 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.322049  9593 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.349097  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.330307  9586 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.322093  9583 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.317360  9587 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.339453  8218 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:18.357728  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.359985  9586 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.360399  9630 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.316195  9589 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.390699  8925 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.390882  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.390769  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.389885  9572 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.392709  8364 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:18.393712  8921 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.394658  9572 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.390851  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.347405  9639 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.394919  8366 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:18.406719  8332 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.712s (SENT) [suppressed 5 similar messages]
I20260709 13:16:18.407853  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:18.408459  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.409204  8367 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.409664  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.410789  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.411320  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.373912  8365 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:18.397640  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.398111  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.398376  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.401635  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.402503  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.396895  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.412905  8186 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:18.417589  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:18.419384  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 77195us
I20260709 13:16:18.421368  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:18.424659  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:18.365518  9596 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.411911  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.430708  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.415096  9630 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:18.431483  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:18.432672  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.434718  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.435700  9583 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:18.436210  9643 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.485636  9584 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.514986  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.436897  9577 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.516153  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.516371  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.516542  9584 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.517009  8288 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:16:18.517267  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.438537  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.442015  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.524551  8365 raft_consensus.cc:2368] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:18.525334  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.526032  8365 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:18.526805  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.432184  9615 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:18.443311  9619 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.444785  9596 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:18.445000  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.445978  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.515036  9643 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.528923  9643 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.529412  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.430934  9586 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:18.447163  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:18.484843  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.477356  8369 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.484324  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:18.415479  9638 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:18.534500  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.535425  9619 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.535773  8290 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.457912  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.453917  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.456472  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.421042  9632 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.539135  9632 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:18.539669  9632 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.420818  9636 consensus_queue.cc:1059] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:18.493395  8919 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.485954  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.542124  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.544286  9596 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:18.545280  9596 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:18.545596  9596 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:18.546413  9596 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:18.513437  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 82122.5us
I20260709 13:16:18.450017  9589 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.514602  9583 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:18.549561  8362 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.552129  9576 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.552382  9583 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.554330  9576 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.518523  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.543825  9586 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:18.556813  9586 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:18.558599  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 145765us
I20260709 13:16:18.520375  9593 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:18.559518  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.559602  9593 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:18.499704  8213 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:18.517930  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.521389  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.528559  8368 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:18.494012  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.442008  9639 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.533499  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.532934  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:18.560724  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:18.599398  8261 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:18.603374  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 185832us
I20260709 13:16:18.601231  9647 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.576637  9596 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.608171  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:18.610174  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 193637us
I20260709 13:16:18.613505  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:18.615945  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 53811.5us
I20260709 13:16:18.610596  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:18.632541  8215 raft_consensus.cc:3055] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:18.609002  8361 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:18.635085  8215 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:18.603778  8366 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.600773  9622 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.608400  9647 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:18.607215  9639 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.624768  9642 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:18.655068  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.634591  9594 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.602684  9608 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.649677  8215 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.660071  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:18.646153  9647 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.665071  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.666487  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:18.668862  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 69557.3us
I20260709 13:16:18.644973  9622 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:18.672124  8261 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.654379  9644 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:18.651031  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.676230  8360 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.645109  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:18.654469  9642 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:18.677867  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 44951.1us
I20260709 13:16:18.680680  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:18.679325  8261 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.686252  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:18.688709  9660 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.690224  8261 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.676115  9622 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.689491  8288 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:18.693459  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:18.679678  9611 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.693881  8288 raft_consensus.cc:606] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:18.682044  9642 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.694541  9616 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.672006  9657 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.693704  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.654119  9593 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.700131  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.667498  9632 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.702452  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:18.702482  9611 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:18.717444  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.717641  9611 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:18.701949  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:18.718201  9656 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.689755  9644 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:18.732753  8369 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:18.718034  9611 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:18.701893  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.713397  8892 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.714581  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.715312  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.695024  9639 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.719861  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:18.720012  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.722481  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.723747  8362 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:18.725586  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.756145  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.757688  9596 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:18.758116  9632 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:18.761675  9639 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.762046  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:18.762223  9639 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:18.762595  9657 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.762809  9639 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.763396  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:18.707608  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:18.726238  9642 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.728940  9570 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.782976  9596 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.803329  9596 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:18.804322  9570 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:18.718775  9660 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:18.805076  8368 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.755120  9616 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.763741  9644 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:18.781400  8367 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.690840  9630 consensus_queue.cc:1059] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:18.718075  9568 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:18.787271  9625 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:18.721480  8183 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:18.789951  9608 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.751534  9617 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:18.818177  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 96767.6us
I20260709 13:16:18.819262  9617 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:18.797427  9622 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.819986  9637 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.821131  9622 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.781544  9650 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:18.800017  8214 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:18.804111  9647 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:18.822546  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1113) took 1149 ms. Trace:
I20260709 13:16:18.823513  9647 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.808269  9596 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:18.709527  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:18.822953  8214 rpcz_store.cc:276] 0709 13:16:17.672683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.444927 (+772244us) service_pool.cc:224] Handling call
0709 13:16:18.799262 (+354335us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:18.799570 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.822201 (+ 22631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.822473 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8154368}
I20260709 13:16:18.837359  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:21.157021  8287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1045) took 2448 ms (client timeout 1547 ms). Trace:
I20260709 13:16:18.824141  9596 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.214907  9596 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:18.879360  9639 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:19.335942  9643 consensus_meta.cc:287] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.806s	user 0.004s	sys 0.007s
I20260709 13:16:20.057512  9671 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.362056  9639 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:20.064369  9672 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:18.816617  9568 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.381995  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1604) took 2975 ms. Trace:
I20260709 13:16:21.382323  9568 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:21.382458  8369 rpcz_store.cc:276] 0709 13:16:18.406492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.553948 (+147456us) service_pool.cc:224] Handling call
0709 13:16:18.732532 (+178584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.749514 (+ 16982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.381768 (+2632254us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54000f4450. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:21.381927 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409985920}
I20260709 13:16:21.383201  9568 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:21.158375  8287 rpcz_store.cc:269] 0709 13:16:18.708564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.709308 (+   744us) service_pool.cc:224] Handling call
0709 13:16:21.156936 (+2447628us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:21.159443  9637 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.170627  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1038) took 2613 ms. Trace:
W20260709 13:16:21.207893  9593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.394s	user 0.016s	sys 0.013s
I20260709 13:16:21.384544  9637 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.216522  9596 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.384600  8286 rpcz_store.cc:276] 0709 13:16:18.556987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.571358 (+ 14371us) service_pool.cc:224] Handling call
0709 13:16:18.642511 (+ 71153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.671929 (+ 29418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.674021 (+  2092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.678031 (+  4010us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:18.678740 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.170276 (+2491536us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b54002e68d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:21.170338 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.170522 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33669376}
I20260709 13:16:21.386945  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:21.387742  8928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 415) took 2760 ms (client timeout 1943 ms). Trace:
I20260709 13:16:19.779920  9642 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.225210  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 416) took 2597 ms. Trace:
W20260709 13:16:21.233173  9644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.126s	user 0.011s	sys 0.011s
I20260709 13:16:21.388602  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1166) took 3142 ms. Trace:
W20260709 13:16:21.389097  9644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.308s	user 0.012s	sys 0.011s
I20260709 13:16:21.389020  8360 rpcz_store.cc:276] 0709 13:16:18.245674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.306482 (+ 60808us) service_pool.cc:224] Handling call
0709 13:16:18.312074 (+  5592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.679017 (+366943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.388378 (+2709361us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b5400367ed4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:21.388535 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836862336}
I20260709 13:16:21.388329  8927 rpcz_store.cc:276] 0709 13:16:18.627853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.627960 (+   107us) service_pool.cc:224] Handling call
0709 13:16:21.224844 (+2596884us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:21.225119 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16809344}
W20260709 13:16:21.234906  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.391252  8928 rpcz_store.cc:269] 0709 13:16:18.627542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.627656 (+   114us) service_pool.cc:224] Handling call
0709 13:16:21.386801 (+2759145us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:21.387650 (+   849us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17991424}
I20260709 13:16:21.237711  9673 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.241088  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1044) took 2542 ms. Trace:
I20260709 13:16:21.246186  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 114) took 2584 ms. Trace:
I20260709 13:16:21.392427  9615 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:21.392679  9674 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:21.385071  9593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.571s	user 0.016s	sys 0.013s
I20260709 13:16:21.392813  8368 rpcz_store.cc:276] 0709 13:16:18.662011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.723692 (+ 61681us) service_pool.cc:224] Handling call
0709 13:16:18.723944 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.805416 (+ 81472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.245874 (+2440458us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b54003255d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:21.246064 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186250496}
W20260709 13:16:21.253638  8362 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59420 (request call id 119) took 2590 ms (client timeout 2227 ms). Trace:
I20260709 13:16:21.393095  9615 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.393226  9674 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:21.393953  8362 rpcz_store.cc:269] 0709 13:16:18.663478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.693177 (+ 29699us) service_pool.cc:224] Handling call
0709 13:16:21.253353 (+2560176us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54000f3f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:21.253529 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64144640}
I20260709 13:16:21.254979  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:21.263386  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.610s	user 0.007s	sys 0.035s
W20260709 13:16:21.395376  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.742s	user 0.009s	sys 0.036s
I20260709 13:16:21.395570  9615 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:21.269582  8889 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.215s	user 0.010s	sys 0.019s
I20260709 13:16:21.275671  9676 raft_consensus.cc:1064] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:21.392325  9649 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:21.396361  8889 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.342s	user 0.011s	sys 0.019s
I20260709 13:16:21.396675  9649 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.398139  9676 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.398854  9649 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.399423  9649 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:21.275971  8261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.494s	user 0.026s	sys 0.012s
W20260709 13:16:21.400113  8261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.618s	user 0.026s	sys 0.012s
I20260709 13:16:21.400192  9652 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.295027  9586 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.400599  9615 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.400964  9586 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.400739  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 2.69293e+06us
I20260709 13:16:21.399868  9649 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.318866  8361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1595) took 3011 ms (client timeout 1869 ms). Trace:
I20260709 13:16:21.302946  9628 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:21.392318  9673 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.403293  8361 rpcz_store.cc:269] 0709 13:16:18.307396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.323499 (+ 16103us) service_pool.cc:224] Handling call
0709 13:16:21.318643 (+2995144us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003651d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:21.318796 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529191808}
I20260709 13:16:21.403479  9628 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.405020  9673 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.320681  8363 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.405576  9628 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:21.320127  8149 debug-util.cc:398] Leaking SignalData structure 0x7b0800035200 after lost signal to thread 7079
I20260709 13:16:21.406575  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1168) took 3142 ms. Trace:
I20260709 13:16:21.322381  9641 raft_consensus.cc:3055] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.326165  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.406952  9649 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.400715  9652 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:21.332901  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.551s	user 0.027s	sys 0.021s
I20260709 13:16:21.332827  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.408336  8218 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.409273  8215 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.406925  8363 rpcz_store.cc:276] 0709 13:16:18.265901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.538317 (+272416us) service_pool.cc:224] Handling call
0709 13:16:18.682067 (+143750us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:21.320514 (+2638447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.405625 (+ 85111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.406400 (+   775us) spinlock_profiling.cc:243] Waited 2.64 s on lock 0x7b54003651d0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:21.406523 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6093263872}
W20260709 13:16:21.412137  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.631s	user 0.027s	sys 0.021s
W20260709 13:16:21.412514  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 2.63091e+06us
I20260709 13:16:21.413765  9664 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:21.392259  8293 rpcz_store.cc:276] 0709 13:16:18.698579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.700697 (+  2118us) service_pool.cc:224] Handling call
0709 13:16:18.701011 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.759135 (+ 58124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.759178 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.759214 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:18.759242 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.240842 (+2481600us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b540005c8d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:21.240892 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.241030 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133269248}
W20260709 13:16:21.396672  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 2.34248e+06us
W20260709 13:16:21.333860  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.418315  9649 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:21.421029  9649 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.421655  9596 raft_consensus.cc:3055] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.422111  9596 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.422490  8115 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.423086  9596 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:21.406793  8149 debug-util.cc:398] Leaking SignalData structure 0x7b08000358e0 after lost signal to thread 8152
W20260709 13:16:21.424412  8149 debug-util.cc:398] Leaking SignalData structure 0x7b08000359a0 after lost signal to thread 8166
I20260709 13:16:21.424651  9596 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:21.425606  8149 debug-util.cc:398] Leaking SignalData structure 0x7b080031b220 after lost signal to thread 8244
W20260709 13:16:21.425981  8149 debug-util.cc:398] Leaking SignalData structure 0x7b08002f20e0 after lost signal to thread 8245
I20260709 13:16:21.425637  8218 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:21.337659  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.402944  8261 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.428169  9641 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:21.338617  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:21.428730  8889 connection.cc:256] RPC call timeout handler was delayed by -1.96771582700012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:16:21.429082  8214 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.429323  9628 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.429435  9673 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:21.353103  8213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 113) took 3110 ms (client timeout 1575 ms). Trace:
I20260709 13:16:21.429808  9628 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.430017  9673 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.354271  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.361707  9643 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.431003  8219 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.321857  9685 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.361788  9671 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.431833  9685 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.433322  8364 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:21.429018  9641 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.434950  8364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59420 (request call id 117) took 2772 ms (client timeout 1922 ms). Trace:
I20260709 13:16:21.435014  9641 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:21.435375  8364 rpcz_store.cc:269] 0709 13:16:18.662881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.666219 (+  3338us) service_pool.cc:224] Handling call
0709 13:16:21.434745 (+2768526us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b5400156b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:21.434885 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6360938368}
I20260709 13:16:21.368085  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.368949  9620 raft_consensus.cc:3055] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.369565  8116 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 3, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 3 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.440201  9620 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:21.441087  9620 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.442282  9620 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.372308  9611 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.409299  9652 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:18.795087  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.443298  9652 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:21.221355  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.443753  9644 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.385063  9637 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.444761  9643 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:21.395676  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 2.7425e+06us
I20260709 13:16:21.445794  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.447817  9630 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.449791  9611 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.450502  9652 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.458449  9639 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:21.458993  9639 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.461494  9593 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.462033  9593 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.464488  8889 connection.cc:256] RPC call timeout handler was delayed by -1.7904158270000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:16:21.465699  8889 connection.cc:256] RPC call timeout handler was delayed by -1.7706158270000287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
W20260709 13:16:21.466960  8889 connection.cc:256] RPC call timeout handler was delayed by -1.6059158269999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:16:21.468055  8889 connection.cc:256] RPC call timeout handler was delayed by -1.5645158270001502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 13:16:21.315371  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:21.469427  8889 connection.cc:256] RPC call timeout handler was delayed by -1.5096158270000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
I20260709 13:16:21.402923  9586 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.407331  8216 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.327833  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.471551  8212 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.336807  9675 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:21.472285  9675 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.482460  8889 connection.cc:256] RPC call timeout handler was delayed by -1.4612029559998518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:16:21.482815  8889 connection.cc:256] RPC call timeout handler was delayed by -1.4601158269999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 13:16:21.337467  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.426733  9649 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:21.430154  8213 rpcz_store.cc:269] 0709 13:16:18.242828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.272553 (+ 29725us) service_pool.cc:224] Handling call
0709 13:16:21.352876 (+3080323us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400199e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:21.353009 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484406016}
I20260709 13:16:21.362699  9672 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.484246  8217 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:16:21.156939  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 2.31941e+06us
I20260709 13:16:21.485265  9644 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:21.485471  9664 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.485960  9664 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.485913  9644 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.486793  8183 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:21.354578  8892 connection.cc:256] RPC call timeout handler was delayed by -1.8913809240000319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 13:16:21.384231  9568 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.487722  9642 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:21.487905  8892 connection.cc:256] RPC call timeout handler was delayed by -1.4680898950000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:16:21.488324  9642 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.489009  9616 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.490623  9630 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:21.427088  8149 debug-util.cc:398] Leaking SignalData structure 0x7b0800341280 after lost signal to thread 8319
W20260709 13:16:21.469651  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 376) took 2867 ms (client timeout 1624 ms). Trace:
W20260709 13:16:21.494095  8149 debug-util.cc:398] Leaking SignalData structure 0x7b080020a780 after lost signal to thread 8320
W20260709 13:16:21.494138  8924 rpcz_store.cc:269] 0709 13:16:18.602020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.607009 (+  4989us) service_pool.cc:224] Handling call
0709 13:16:21.315246 (+2708237us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:21.469590 (+154344us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17813760}
I20260709 13:16:21.395844  9674 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:21.482540  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 69215.2us
I20260709 13:16:21.482112  9586 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.495472  9674 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.495605  9586 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.401185  9615 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.502007  9643 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:21.502738  9643 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.512178  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 66469.7us
I20260709 13:16:21.513412  8186 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.514135  9630 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.514860  8219 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:21.515794  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.515888  9672 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.510906  9642 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.518280  9649 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.519562  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:21.528406  8293 raft_consensus.cc:606] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.528460  8215 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:16:21.520207  8889 connection.cc:256] RPC call timeout handler was delayed by -1.4232158270001491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 13:16:21.520247  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 2.72515e+06us
W20260709 13:16:21.529671  8889 connection.cc:256] RPC call timeout handler was delayed by -1.2920732389998193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 13:16:21.530241  8889 connection.cc:256] RPC call timeout handler was delayed by -1.2858524800001305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:16:21.525626  8216 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:21.526585  9686 consensus_queue.cc:1059] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:21.530093  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.534338  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.534752  9642 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.535549  9642 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.522074  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.531257  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.535750  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.537585  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 126) took 2897 ms. Trace:
I20260709 13:16:21.537904  8215 rpcz_store.cc:276] 0709 13:16:18.632022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.632187 (+   165us) service_pool.cc:224] Handling call
0709 13:16:18.632431 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:21.409118 (+2776687us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b58002c03d0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd36d0aa 00007f31fd3ef447 00007f31fd407fe7 00007f31fd4097de 00007f31fd413b49 00007f31fd414416 00007f31fd410d8f 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4
0709 13:16:21.529054 (+119936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.529272 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6284566912}
I20260709 13:16:21.539156  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.461512  9639 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.544876  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.489473  9616 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.545317  9675 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:21.539193  9684 consensus_queue.cc:1059] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:21.545779  9671 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.544963  9678 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:21.551129  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.538072  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.532605  9630 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.553617  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.542158  9672 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.569139  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:21.551299  8149 debug-util.cc:398] Leaking SignalData structure 0x7b080035e560 after lost signal to thread 8393
I20260709 13:16:21.573453  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.575289  8295 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:21.574273  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.536814  9682 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:21.571712  9642 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.607856  8294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:21.551484  9671 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:21.611689  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:21.609253  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 78060us
I20260709 13:16:21.575242  9576 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:21.612730  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 65824.3us
I20260709 13:16:21.614045  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.601539  9589 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.573398  9687 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.578116  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.619738  9684 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.609572  9630 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.622118  9628 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.576522  9639 consensus_queue.cc:1059] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:21.613124  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.622659  9682 raft_consensus.cc:3055] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.627913  9691 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.631155  9673 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:21.631258  8149 debug-util.cc:398] Leaking SignalData structure 0x7b0800337a20 after lost signal to thread 8955
W20260709 13:16:21.636696  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 233787us
I20260709 13:16:21.570209  9678 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.580163  9686 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:16:21.653836  9691 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:21.620781  9652 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:21.666848  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 52895.5us
I20260709 13:16:21.685218  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.649175  9685 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:21.620837  9616 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.672783  9684 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:21.688781  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 149719us
I20260709 13:16:21.692373  8186 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.692968  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.693485  8186 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.694236  9630 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.697144  8186 leader_election.cc:400] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:21.697436  8186 leader_election.cc:403] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.698710  9641 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:21.699980  8293 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:21.702371  9697 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.702212  9691 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.703011  9637 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.703339  9697 consensus_queue.cc:1059] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:21.703485  9691 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.703658  9674 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.704012  8220 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.703523  9620 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:21.704783  9620 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:21.705072  9637 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.705588  9620 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.706673  9620 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.710245  8212 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:21.710783  9630 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.702891  9678 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.711486  9637 raft_consensus.cc:3055] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.711905  9637 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:21.711997  8294 raft_consensus.cc:606] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.713676  8286 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.632882  9644 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.717171  9649 raft_consensus.cc:3055] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.717345  8287 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.717594  9649 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.648778  9664 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.718433  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:21.718420  9649 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.718868  8214 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:21.719162  8364 raft_consensus.cc:606] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:21.718356  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.720427  9596 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.720798  9596 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.652829  9682 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:21.721041  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.652510  9615 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:21.660912  8149 debug-util.cc:398] Leaking SignalData structure 0x7b08003474c0 after lost signal to thread 8956
I20260709 13:16:21.722074  8292 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.721719  9596 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.722299  8149 debug-util.cc:398] Leaking SignalData structure 0x7b08002912a0 after lost signal to thread 9570
W20260709 13:16:21.722635  8149 debug-util.cc:398] Leaking SignalData structure 0x7b08003196e0 after lost signal to thread 9577
I20260709 13:16:21.722929  9596 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.722986  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.721783  9682 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.724437  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:21.724866  9682 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.726058  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:21.727113  9639 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:21.727475  9639 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.713575  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.727866  8290 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:21.728375  8288 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
W20260709 13:16:21.723244  8149 debug-util.cc:398] Leaking SignalData structure 0x7b08002111e0 after lost signal to thread 9659
I20260709 13:16:21.729408  9643 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:21.724165  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.712596  9693 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:16:21.727916  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.731621  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.685768  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.719638  9649 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.720749  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.732963  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:21.743052  8287 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:21.743454  8927 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:21.616717  9671 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.744693  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.746999  9628 consensus_queue.cc:1059] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:21.747994  9616 raft_consensus.cc:3055] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:21.748492  9616 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:21.749646  9616 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.751170  9616 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.746824  9671 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:21.735148  8258 connection.cc:256] RPC call timeout handler was delayed by -1.6864736429999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 13:16:21.752848  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 136497us
I20260709 13:16:21.741956  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:21.695814  8291 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:21.679827  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.775229  9615 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:21.754236  8258 connection.cc:256] RPC call timeout handler was delayed by -1.6819736429999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:16:21.756220  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:21.755976  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 70309.5us
I20260709 13:16:21.756357  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.777721  8365 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:21.714591  9637 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.776638  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.759303  9684 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.759681  9639 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.758955  9691 raft_consensus.cc:3055] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:16:21.760170  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.760727  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:21.758064  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:21.776198  8258 connection.cc:256] RPC call timeout handler was delayed by -1.4740736430001107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18600000000000003s for a response
W20260709 13:16:21.791110  8258 connection.cc:256] RPC call timeout handler was delayed by -1.3588736430001518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 13:16:21.776429  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 96676.1us
I20260709 13:16:21.792618  8261 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.794147  9586 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:21.794590  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.794727  9586 consensus_queue.cc:1059] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:21.795710  9628 raft_consensus.cc:3055] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:21.796058  9628 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:21.797174  9639 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.796898  9628 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.796072  9593 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.798022  9628 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.799285  8889 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.800434  9615 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.801781  9586 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:21.780205  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.778427  8289 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 2: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:21.776638  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.787930  9691 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:21.803258  9691 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.804333  9593 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:21.804580  9691 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.805296  9593 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:21.805635  9593 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:21.806442  9593 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:21.807305  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.807542  9593 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.807811  9673 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.808246  9673 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.808614  9673 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.810117  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.810819  9684 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.810973  9696 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.812398  8183 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.813189  9696 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.814749  8183 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.815618  9691 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.815850  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.816466  8289 raft_consensus.cc:2376] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2. Re-sending same reply.
I20260709 13:16:21.816641  8183 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.818307  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:21.818720  8183 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ebc3be5b6ff4d2b90d60c9a508dafc7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:21.819042  8289 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 2: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:16:21.819370  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.819525  8183 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.822412  8292 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:21.784392  9620 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.826210  9696 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.827056  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.827109  9696 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.829176  9619 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:21.829890  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 53237.1us
W20260709 13:16:21.832090  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.833590  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.834717  8289 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:21.835676  8295 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
W20260709 13:16:21.837486  8365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1178) took 3314 ms (client timeout 1988 ms). Trace:
I20260709 13:16:21.839064  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.833176  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:21.837937  8365 rpcz_store.cc:269] 0709 13:16:18.523290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.534398 (+ 11108us) service_pool.cc:224] Handling call
0709 13:16:21.254777 (+2720379us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:21.837315 (+582538us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400370854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:21.837423 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560599680}
I20260709 13:16:21.842759  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.843407  8286 raft_consensus.cc:2376] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2. Re-sending same reply.
I20260709 13:16:21.842525  9586 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:21.843983  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.844556  9673 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.846113  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.849151  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.849589  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.849751  8290 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:21.850432  8183 connection.cc:256] RPC call timeout handler was delayed by -2.4927358809998168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:16:21.852011  8183 connection.cc:256] RPC call timeout handler was delayed by -2.4396358809999583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 13:16:21.850471  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 151517us
W20260709 13:16:21.852408  8183 connection.cc:256] RPC call timeout handler was delayed by -2.4072358809999059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:16:21.852800  8295 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:21.853893  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:21.852804  8183 connection.cc:256] RPC call timeout handler was delayed by -2.2533358809998845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:16:21.853858  8261 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:21.855098  8183 connection.cc:256] RPC call timeout handler was delayed by -2.1219358809998994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 13:16:21.855443  8183 connection.cc:256] RPC call timeout handler was delayed by -2.0931358809998528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 13:16:21.855733  8183 connection.cc:256] RPC call timeout handler was delayed by -1.9869358809999085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 13:16:21.855973  8183 connection.cc:256] RPC call timeout handler was delayed by -1.9869358809999085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21650000000000003s for a response
W20260709 13:16:21.856257  8183 connection.cc:256] RPC call timeout handler was delayed by -1.9257358809998095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 13:16:21.856518  8183 connection.cc:256] RPC call timeout handler was delayed by -1.6667812299999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:16:21.857095  8364 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:21.857877  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.858366  8215 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:21.858443  8363 raft_consensus.cc:2376] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2. Re-sending same reply.
I20260709 13:16:21.857833  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.859369  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:21.859875  8368 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:21.860095  8364 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:21.860708  8360 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:21.862054  8363 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.861987  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.862771  8367 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:21.863524  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.863845  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.864399  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.864866  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.864718  8367 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:21.865695  8215 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:21.866369  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:21.867038  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.853309  9696 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.868695  9586 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.854748  9649 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.865258  9664 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:21.865585  9686 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.849624  9673 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:21.854039  9639 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:21.869160  8215 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:21.869499  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.877034  9674 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.877527  9674 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.878615  9674 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.879683  9674 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.867520  8889 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:21.869962  8220 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.880594  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.881306  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.867537  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.850041  9671 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:21.882050  8215 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:21.883364  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.885944  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.882710  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:21.886780  8363 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:21.884511  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.887212  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:21.887473  8368 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:21.881379  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.884287  8367 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:21.870910  9675 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.869369  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:21.870959  9642 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.889170  9675 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:21.889631  9675 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.889797  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:21.889981  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.884794  9677 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.890609  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.872349  9686 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.870702  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.891750  9686 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.870450  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.893062  8362 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:21.893311  8183 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.876477  8291 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:21.889957  9619 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.885483  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:21.896641  8290 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:21.906622  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.896893  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:21.884554  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.871855  9664 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:21.869796  9696 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.907487  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.908098  9642 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:21.910406  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.911108  8368 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:21.911255  9642 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.911913  9696 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:21.912279  9619 raft_consensus.cc:697] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:21.907933  9693 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:21.913277  9693 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:21.913185  9619 consensus_queue.cc:237] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.913765  9693 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.908032  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.901360  8889 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:21.914742  8363 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
W20260709 13:16:21.915763  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.905596  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:21.899149  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.917095  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.854549  9615 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:16:21.896037  9673 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.919100  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:21.919740  8290 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:21.920195  9643 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.922201  8286 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:21.922300  9628 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:21.923261  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.923420  9615 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:21.923772  9615 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.924441  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.926451  9643 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:21.927892  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.928393  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.929718  9643 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.924633  9615 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:21.932325  9698 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.916414  9671 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.932901  9615 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.933743  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.934517  9675 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:21.938930  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:21.907786  9616 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.905108  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:21.943207  8215 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.944231  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.908842  9664 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:21.946641  8290 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:21.949313  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.949905  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.950035  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.950582  8215 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.949438  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.951272  8293 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:21.951584  8290 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.951318  8261 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:21.954216  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.954532  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.928758  9586 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:21.957216  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.959376  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:21.928290  9673 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.916319  8212 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:21.956182  8365 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:21.963500  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.963721  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:21.967461  8215 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:21.967995  8290 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:21.968191  8218 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:21.968153  8183 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:21.966288  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.943044  9698 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:21.969357  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.945803  9696 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.952680  9649 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.960536  9652 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:21.952399  9697 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.945742  9671 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:21.974419  8290 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:21.956768  9682 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:21.946373  8289 raft_consensus.cc:2376] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2. Re-sending same reply.
I20260709 13:16:21.957216  9686 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:21.956393  9641 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:21.982209  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.964736  9676 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:16:21.962522  9673 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:21.985432  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.985749  8216 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:21.975399  9620 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.004964  8213 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.972764  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.006475  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.007246  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.008162  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:21.973210  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.976022  9684 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:21.982999  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:22.038523  8293 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:21.990514  8217 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:22.040270  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:22.041604  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.975244  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:21.988603  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:21.963025  9687 consensus_queue.cc:1059] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:16:21.973742  9586 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:21.982900  8214 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.001788  8927 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.002372  8290 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.003108  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:22.003173  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:22.060226  8216 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:22.003455  8361 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.064915  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:22.003784  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:22.004113  9637 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.009517  8215 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:22.043466  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:22.081452  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:22.044338  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:22.083258  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:22.084635  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:22.085711  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:22.085783  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:22.086488  8295 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:22.080981  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:22.045058  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:21.990496  9686 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:21.983736  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.969478  9664 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.061743  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:22.043340  9682 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:16:22.099210  8332 connection.cc:256] RPC call timeout handler was delayed by -1.8618782050000391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 13:16:22.063406  9703 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:16:21.995049  9611 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:22.007841  9702 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.008988  9696 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.038415  9691 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.097867  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:22.124423  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:22.099514  8213 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:22.101099  8926 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:22.123696  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:22.125443  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:22.110683  9652 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:22.099692  8332 connection.cc:256] RPC call timeout handler was delayed by -1.7133782050000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:16:22.061862  9675 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:22.088243  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:22.098719  8924 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:22.138388  8332 connection.cc:256] RPC call timeout handler was delayed by -1.4793782050001028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
I20260709 13:16:22.088016  9708 consensus_queue.cc:1059] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:22.139428  8295 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.148097  8363 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.154872  8290 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:22.155802  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 196498us
I20260709 13:16:22.167747  8261 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.137104  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:22.158522  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.163033  8332 connection.cc:256] RPC call timeout handler was delayed by -1.3236782050000784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 13:16:22.099134  9686 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.168851  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:22.088698  9616 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:16:22.172639  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:22.203016  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.138829  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:22.150538  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:22.233763  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 62613.8us
I20260709 13:16:22.246554  8369 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:22.246850  8364 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.247314  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.247579  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.248409  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:22.241225  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.176093  8261 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:22.242910  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 178081us
I20260709 13:16:22.111794  9611 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:22.249982  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.250497  8367 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:22.252502  8369 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:22.171940  9641 consensus_queue.cc:1059] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:16:22.240932  9643 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.165092  9687 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:16:22.256022  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.303134  8360 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:22.268740  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.251767  8211 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:22.061821  9698 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.113236  9671 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.303885  8367 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:22.251987  9611 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.333328  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.333616  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:22.362249  8219 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:22.377745  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.337858  9642 raft_consensus.cc:993] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:22.339154  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.339385  9685 consensus_queue.cc:1059] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:22.339704  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.339846  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:22.301728  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.341806  8364 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:22.344645  8116 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 185) took 1055 ms. Trace:
I20260709 13:16:22.347674  9589 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:22.349843  9649 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:22.356769  9709 ts_tablet_manager.cc:933] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:22.356539  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:22.357384  9673 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:22.382788  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 228359us
I20260709 13:16:22.396404  8927 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:22.234252  9586 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:22.400997  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 222462us
W20260709 13:16:22.401288  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 61504.6us
I20260709 13:16:22.379786  9712 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.402094  8261 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.402894  8924 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:22.404315  8261 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.399215  9649 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.403277  8361 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:22.396842  9589 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:22.392309  8116 rpcz_store.cc:276] 0709 13:16:21.288840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.291105 (+  2265us) service_pool.cc:224] Handling call
0709 13:16:22.344555 (+1053450us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:21.533521 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:21.534069 (+   548us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:21.534100 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:16:21.534117 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:21.534433 (+   316us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:21.534515 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:21.534549 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:21.534749 (+   200us) tablet.cc:701] Row locks acquired
0709 13:16:21.534765 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:16:21.534900 (+   135us) write_op.cc:270] Start()
0709 13:16:21.535010 (+   110us) write_op.cc:276] Timestamp: P: 1783602981534858 usec, L: 0
0709 13:16:21.535031 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:21.535663 (+   632us) log.cc:844] Serialized 530 byte log entry
0709 13:16:21.900321 (+364658us) op_driver.cc:464] REPLICATION: finished
0709 13:16:21.982561 (+ 82240us) write_op.cc:301] APPLY: starting
0709 13:16:21.982637 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:21.982741 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:21.984365 (+  1624us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:21.984614 (+   249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:21.984765 (+   151us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:21.984810 (+    45us) write_op.cc:312] APPLY: finished
0709 13:16:22.043045 (+ 58235us) log.cc:844] Serialized 23 byte log entry
0709 13:16:22.065051 (+ 22006us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.080635 (+ 15584us) write_op.cc:454] Released schema lock
0709 13:16:22.085546 (+  4911us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:22.085909 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.085937 (+    28us) write_op.cc:454] Released schema lock
0709 13:16:22.251079 (+165142us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.252895 (+  1816us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":82023,"apply.run_cpu_time_us":2406,"apply.run_wall_time_us":103312,"num_ops":1,"prepare.queue_time_us":90742,"prepare.run_cpu_time_us":25859,"prepare.run_wall_time_us":153506,"raft.queue_time_us":327362,"raft.run_cpu_time_us":51174,"raft.run_wall_time_us":402556,"replication_time_us":365147,"thread_start_us":362142,"threads_started":4,"wal-append.queue_time_us":193522}]]}
I20260709 13:16:22.423080  9589 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.424227  9676 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.424589  9676 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:22.424976  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.425460  9676 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.402928  9644 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:22.426573  9644 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.426724  9676 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.426952  9644 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.431572  9720 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:22.432103  9720 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:22.432569  9720 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:22.410292  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.396426  9642 raft_consensus.cc:1081] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:16:22.412972  9615 consensus_queue.cc:1059] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:22.416364  8219 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:22.420782  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:22.406984  9718 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.412530  9677 consensus_queue.cc:1059] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:16:22.442654  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.444947  8363 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:22.454340  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.456298  8368 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:16:22.428968  9649 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.433904  9611 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.459012  9637 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:22.460000  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:22.458117  9639 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:22.407454  9678 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:16:22.466763  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:22.436858  9589 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.470973  9682 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:22.477010  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 56300.8us
W20260709 13:16:22.478073  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 71488.4us
W20260709 13:16:22.473639  9674 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.593s	user 0.013s	sys 0.000s
I20260709 13:16:22.471513  9687 raft_consensus.cc:3055] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.456231  9717 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:16:22.476176  9682 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.474829  9637 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:22.483202  9687 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:22.479010  9699 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.478559  9596 raft_consensus.cc:3055] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:22.485529  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.487155  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.483346  9628 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:22.490723  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.497146  9628 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:22.497550  9628 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.491076  9709 tablet_copy_client.cc:323] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:16:22.489655  9596 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:22.492230  9718 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.498839  9718 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:22.499529  9674 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.499938  9674 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:22.499716  9718 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.500487  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:22.501111  8369 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:22.500738  9674 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.487067  9682 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.502122  9674 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.499068  9596 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.504467  9596 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.496174  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.500880  9644 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.506772  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.490878  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.509868  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.510926  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.479465  9688 consensus_queue.cc:1059] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:16:22.512395  9688 consensus_queue.cc:1243] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:22.513805  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.514030  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.514856  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.514998  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.516021  8258 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.516744  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.517117  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.508797  9671 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.520893  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.522174  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.519045  9685 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.516377  9677 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.519073  9619 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.528396  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.512903  9639 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.509009  9699 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:22.521123  9678 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.531101  9637 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.517011  9676 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.519043  9616 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.512831  9717 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:22.532167  9568 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.515843  9706 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:16:22.551859  9717 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.552313  9725 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.543040  9724 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:22.552568  9699 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.574208  8288 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:22.555671  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.577003  9725 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.569204  9652 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.578300  8291 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
W20260709 13:16:22.578910  9693 consensus_meta.cc:287] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.665s	user 0.013s	sys 0.009s
I20260709 13:16:22.579303  9693 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.580348  8220 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.576974  9628 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.583424  9664 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.550325  9639 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.589300  9682 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.585808  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:22.586727  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 120028us
I20260709 13:16:22.592861  9719 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.571658  9724 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:22.594014  9724 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.595872  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.599749  8217 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:22.601805  8217 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:22.603406  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:22.604154  8217 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.606446  9630 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.607398  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:22.587028  9677 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.612439  9685 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.610605  9620 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.606976  9630 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.612516  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.608007  9568 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.659969  9686 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.661383  9642 raft_consensus.cc:3055] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:22.661864  9642 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:22.662696  9717 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.662863  9642 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.663789  9686 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:22.664503  8292 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:22.665632  9687 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.666702  9642 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.666836  8218 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:22.668571  9628 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:22.670869  9652 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.671026  9649 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.672334  8369 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.643590  9693 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:22.642417  8217 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:22.615849  9675 raft_consensus.cc:3055] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:22.654170  9620 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:22.585146  9644 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:22.645183  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 53687.4us
I20260709 13:16:22.645663  8361 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:22.648227  9616 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.714424  9628 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:22.648345  9719 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:22.715621  9673 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:22.639647  9682 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:22.608728  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.677376  8114 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46474 (request call id 258) took 1343 ms. Trace:
W20260709 13:16:22.615170  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.725726  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 117063us
I20260709 13:16:22.694482  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:22.695318  9593 raft_consensus.cc:3055] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:22.698843  8369 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:22.699950  9712 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.713900  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:22.728524  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.729976  8889 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.715552  9719 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:22.731988  8889 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.715309  9724 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.649300  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.734344  8889 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.718379  9611 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:22.718950  9720 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.689981  9675 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:22.725342  8114 rpcz_store.cc:276] 0709 13:16:21.333556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.333669 (+   113us) service_pool.cc:224] Handling call
0709 13:16:22.677297 (+1343628us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30765,"reported_tablets":1}
I20260709 13:16:22.726809  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.728644  9644 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:22.728916  9593 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:22.735370  9616 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.737788  8889 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.735255  9708 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.744628  9675 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.742056  8292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:16:22.744375  9630 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:22.730993  9719 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.737015  9673 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:22.749331  8292 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.750280  8290 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.739871  9706 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.750677  8292 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:22.750926  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 222609us
I20260709 13:16:22.750290  9685 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.751411  9628 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.755847  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:22.756320  8921 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.764370  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.750478  9673 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:22.766788  9673 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.768256  9593 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.768635  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:16:22.769308  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-2ebc3be5b6ff4d2b90d60c9a508dafc7
I20260709 13:16:22.769461  9593 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.757452  9675 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.773082  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:22.780676  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.789157  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:22.790248  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.791332  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.774322  8292 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:22.793745  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 277056us
W20260709 13:16:22.793726  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 337421us
I20260709 13:16:22.797163  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:22.797343  8927 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:22.757230  9706 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:22.764786  9628 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:22.801097  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.806110  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.803196  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.807252  8292 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:22.807883  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 48668.2us
I20260709 13:16:22.817386  8364 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.819515  8294 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:22.821282  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:22.821796  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.821930  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.821882  8924 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:22.831220  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:22.849959  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:22.825309  8360 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:22.800535  9615 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:22.750674  9620 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:22.819748  9712 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.822409  9682 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.827664  9596 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:22.827283  9649 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:22.858827  9644 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:22.813521  9697 consensus_queue.cc:1059] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:16:22.868999  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 47147us
I20260709 13:16:22.849330  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:22.872359  9732 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.911540  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:22.919767  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.894485  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.886638  9706 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.886173  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:22.892879  8922 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.859577  9691 consensus_queue.cc:1059] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:16:22.856941  9619 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:22.855151  9615 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:22.919788  8364 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:22.896323  9696 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.944016  8186 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:22.952085  8294 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:22.896514  9596 raft_consensus.cc:697] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:22.937739  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:22.912156  9652 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:22.962062  9696 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.920382  9717 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:16:23.004257  9712 raft_consensus.cc:993] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower 9e95b04d03d241329435b6d08dd1f236 to start an election
I20260709 13:16:22.991933  8258 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:22.993038  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:22.963052  9729 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:16:22.957170  8261 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:22.989898  8290 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:22.991436  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47508.8us
I20260709 13:16:23.014818  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:23.004244  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.008251  8369 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.016477  8369 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:22.884063  9682 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:22.993090  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:22.988394  9649 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.029297  9649 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:23.026639  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 69551.9us
I20260709 13:16:23.030990  8290 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:23.008744  9652 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:23.017233  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:23.028244  8369 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:22.993822  9693 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:22.993621  8291 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:23.031478  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:23.031725  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:22.959192  9615 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.028605  9689 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:22.960511  9724 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:22.920737  9628 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:23.006588  9687 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.998507  9637 raft_consensus.cc:3055] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.002771  9620 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.000773  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:22.992198  9720 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:23.033217  9652 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.013453  9691 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.041215  9682 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.028326  9734 raft_consensus.cc:1081] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Signalling peer 9e95b04d03d241329435b6d08dd1f236 to start an election
I20260709 13:16:23.036255  9674 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:23.033449  9712 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:23.043741  9649 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:23.044517  9586 raft_consensus.cc:3055] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:23.045192  9684 raft_consensus.cc:3055] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.050391  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:23.002422  9673 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:22.992825  9730 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.046087  9697 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:23.061353  8369 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.061754  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:23.065069  9717 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.073137  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 219786us
I20260709 13:16:23.058609  8362 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:23.072722  9718 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:23.066567  9693 consensus_queue.cc:1059] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:23.073135  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:23.086874  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 72163.9us
I20260709 13:16:23.108006  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:23.094718  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 44431.4us
I20260709 13:16:23.844597  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:23.845961  8212 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:23.095301  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 298175us
I20260709 13:16:23.045974  9596 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:23.850441  9673 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:23.066450  9637 raft_consensus.cc:740] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:23.094107  9684 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:23.127442  9697 raft_consensus.cc:697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:23.646787  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.092509  9674 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.094885  9586 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:23.869235  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.028s	sys 0.042s
I20260709 13:16:23.087795  9691 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.855016  9684 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:23.854971  9637 consensus_queue.cc:260] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.878437  9684 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.857070  9697 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:23.883340  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:23.629488  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.003s	sys 0.008s
W20260709 13:16:23.647820  8922 consensus_meta.cc:287] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.012s
W20260709 13:16:23.619124  8216 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.003s	sys 0.030s
I20260709 13:16:23.101653  9708 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:23.892500  9752 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.892341  9675 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:23.095232  9712 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.185057  9718 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:23.904958  9673 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:23.905767  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:23.906526  9718 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:23.908102  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.648994  8921 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:23.647747  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.717110  9717 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:23.719436  9730 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:23.732832  9664 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.149s	user 0.014s	sys 0.023s
I20260709 13:16:23.826682  9696 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:23.830214  9642 consensus_meta.cc:287] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 1.163s	user 0.012s	sys 0.018s
I20260709 13:16:23.880702  9674 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:23.847641  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:23.864993  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.835686  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 146) took 1073 ms. Trace:
I20260709 13:16:23.857573  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:23.874965  9586 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:23.897485  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.029s	sys 0.042s
W20260709 13:16:23.879184  9615 consensus_meta.cc:287] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.813s	user 0.006s	sys 0.015s
I20260709 13:16:23.900301  9686 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:23.899971  8892 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:23.922282  9696 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.895109  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.005s	sys 0.020s
I20260709 13:16:23.901811  9593 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:23.911764  8216 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.017s	sys 0.040s
I20260709 13:16:23.908316  9641 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.910004  9675 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:16:23.913622  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:23.936223  9717 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:23.937243  9675 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:23.937523  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 900957us
I20260709 13:16:23.917883  9712 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:23.938421  8369 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.833s	user 0.015s	sys 0.006s
I20260709 13:16:23.938912  8369 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:23.939776  9730 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:23.937675  9686 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.940833  9644 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.941442  9742 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.941576  9644 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.942263  9742 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.942850  9702 raft_consensus.cc:3055] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.943356  9702 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:23.939520  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1205) took 1108 ms. Trace:
I20260709 13:16:23.944506  8369 rpcz_store.cc:276] 0709 13:16:22.830693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.830931 (+   238us) service_pool.cc:224] Handling call
0709 13:16:23.008141 (+177210us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5400265820. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd414e18 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:23.939425 (+931284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54099200}
I20260709 13:16:23.944615  9702 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.945808  9642 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.922847  8922 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:23.946544  9742 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:23.946992  9673 raft_consensus.cc:2764] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:23.921964  9734 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.842507  9737 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.714s	user 0.005s	sys 0.024s
W20260709 13:16:23.929073  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.919018  8924 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:23.927913  9593 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:23.932219  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 52298.5us
I20260709 13:16:23.933207  8219 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.933516  9677 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:23.933763  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 825643us
I20260709 13:16:23.933841  9696 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.893708  9752 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.935600  9586 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.937799  9675 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:23.945981  9702 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.946223  9641 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.879006  9691 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:23.880935  9637 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:23.916785  9719 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.163s	user 0.022s	sys 0.024s
I20260709 13:16:23.952523  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:23.946779  9642 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.993633  9719 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:23.995267  8927 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:23.995332  9642 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:23.956156  9620 consensus_meta.cc:287] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.882s	user 0.014s	sys 0.010s
I20260709 13:16:23.996502  9620 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.997262  9620 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.997733  9719 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:23.999383  9739 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.955757  9593 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:23.945863  9686 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:23.983376  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1080) took 1251 ms. Trace:
I20260709 13:16:23.984659  9751 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:23.985249  9652 consensus_meta.cc:287] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.897s	user 0.010s	sys 0.017s
I20260709 13:16:23.985533  9746 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:23.986616  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.986992  9753 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:23.972759  9644 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:23.924316  8220 rpcz_store.cc:276] 0709 13:16:22.762043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.762219 (+   176us) service_pool.cc:224] Handling call
0709 13:16:22.762600 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.763024 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.763066 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.772582 (+  9516us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.059134 (+286552us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:23.059190 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.059282 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.834746 (+775464us) raft_consensus.cc:1685] finished
0709 13:16:23.834800 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.835288 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":11206,"thread_start_us":236864,"threads_started":1,"wal-append.queue_time_us":289558}
I20260709 13:16:23.987865  9675 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:23.988948  9641 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:23.989430  9730 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.990096  9643 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:23.992280  9687 consensus_meta.cc:287] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.898s	user 0.012s	sys 0.015s
I20260709 13:16:23.931540  9615 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:23.999667  9620 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:23.964695  9712 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.005018  9593 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.008986  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:23.976884  9677 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:23.992228  9664 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:24.030239  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.007526  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 420) took 1205 ms. Trace:
I20260709 13:16:24.000407  8293 rpcz_store.cc:276] 0709 13:16:22.731883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.731995 (+   112us) service_pool.cc:224] Handling call
0709 13:16:22.732351 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.732695 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.732725 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.733159 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.868395 (+135236us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800231280. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:16:23.073302 (+204907us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:23.073341 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.073402 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.979096 (+905694us) raft_consensus.cc:1685] finished
0709 13:16:23.982760 (+  3664us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.983114 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2551,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":2879,"spinlock_wait_cycles":5286144,"thread_start_us":204744,"threads_started":1,"wal-append.queue_time_us":394444}
I20260709 13:16:23.972764  9734 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.042110  8219 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.043282  9753 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.039857  9664 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.044548  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.045513  8368 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:24.046209  9753 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.046402  9664 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.048262  8288 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.051265  9674 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.051740  9674 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.053139  8220 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:58422
I20260709 13:16:24.052717  9677 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.054704  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:24.055136  8291 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:24.055240  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:24.056270  9675 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.056639  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:24.057277  9696 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.057449  8295 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:24.057832  9696 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.058452  9696 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.059403  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.060002  8363 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:24.060806  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.061076  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.029212  9739 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.062249  9642 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.062577  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.063344  9739 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:24.063990  9644 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.034380  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.040354  9730 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.064631  9644 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:24.065897  9644 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.066815  9730 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.067268  9644 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.067512  9730 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.018567  9652 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.068466  9691 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:24.036701  8922 rpcz_store.cc:276] 0709 13:16:22.796202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.798009 (+  1807us) service_pool.cc:224] Handling call
0709 13:16:23.965517 (+1167508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.069528  8286 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.070784  9760 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:24.070945  9615 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.071642  9643 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.047112  9746 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.063683  9752 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.096103  8368 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:24.090415  9761 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.039037  9620 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.087128  9753 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.040361  9751 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.112075  9720 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.112738  9720 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.113372  9691 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.102372  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.116611  8366 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:24.100162  9615 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.118119  9712 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.120373  9712 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.085798  9641 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:24.121191  9641 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.121590  9734 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.121729  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1077) took 1391 ms. Trace:
I20260709 13:16:24.115741  9691 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.123369  8220 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.098593  9687 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:24.126932  8220 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.122440  8292 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:24.092864  9664 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.123258  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 149) took 1258 ms. Trace:
I20260709 13:16:24.115239  9720 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.134814  9641 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.118120  8289 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:24.136013  9751 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:24.137027  9747 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.235s	user 0.004s	sys 0.000s
I20260709 13:16:24.140667  9761 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.144495  9758 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:24.147405  9698 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.149682  9746 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:24.154150  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48552.1us
I20260709 13:16:24.105422  9752 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:24.104933  9642 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:24.122108  8288 rpcz_store.cc:276] 0709 13:16:22.730550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.730734 (+   184us) service_pool.cc:224] Handling call
0709 13:16:22.745601 (+ 14867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.048678 (+1303077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.121467 (+ 72789us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400024254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:24.121667 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2960663296}
I20260709 13:16:24.185365  8290 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:24.153098  9615 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:24.106567  9730 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.127933  9753 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.197218  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:24.200906  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.174559  9702 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.133366  8216 rpcz_store.cc:276] 0709 13:16:22.864972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.865123 (+   151us) service_pool.cc:224] Handling call
0709 13:16:22.885406 (+ 20283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.885599 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:23.942324 (+1056725us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.040192 (+ 97868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.088149 (+ 47957us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:24.105230 (+ 17081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.123055 (+ 17825us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.123195 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1719,"prepare.queue_time_us":958920,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":78,"raft.queue_time_us":4484,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":29314,"thread_start_us":1116724,"threads_started":2}
I20260709 13:16:24.167706  9691 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:24.206908  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.180553  9641 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:24.180823  9696 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.108163  9760 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.212950  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.215155  8364 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.208778  8368 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.179457  9620 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.185529  9630 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.194039  9664 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.222640  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:24.226977  8367 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.227187  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.224577  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:24.210983  9677 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:24.224860  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.210621  9758 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.244910  9738 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.245688  8211 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.245558  9738 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.246311  9758 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.246851  9758 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:24.234735  9596 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.237630  8287 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.229903  9720 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.241215  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:24.244112  9684 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.244396  8366 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.204609  9698 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.247331  9758 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.252740  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.244119  8291 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:24.263325  9771 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.245560  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.263510  9630 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.287130  9771 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:24.252806  8293 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:24.270265  9749 log.cc:927] Time spent T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.420s	user 0.000s	sys 0.001s
I20260709 13:16:24.222954  9642 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.254647  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:24.256000  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.253036  9596 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.291689  9768 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.292482  9630 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.292428  9768 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.293774  9596 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.270713  9696 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:24.304284  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.303927  9696 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.252879  9742 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.304975  9742 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.306244  9696 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.307230  9742 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:24.307756  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 63989.5us
I20260709 13:16:24.307972  9615 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.309689  8258 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:24.310817  9649 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:24.234112  9691 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.260699  8186 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:24.255126  9720 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.253959  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:24.274266  8218 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.255462  8286 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:24.274811  9620 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:24.275045  9759 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:16:24.239490  9752 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.218379  9702 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.252470  9738 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:24.282106  9766 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.321934  9593 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.282617  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.282744  9769 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.218534  9687 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.280294  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:24.286473  9767 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.258616  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:24.260848  9675 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.261300  9717 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.294600  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 386) took 1528 ms. Trace:
I20260709 13:16:24.234866  9641 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.297297  9682 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.244410  9755 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.298770  9664 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.257102  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.256191  8230 tablet_copy_source_session.cc:215] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:24.299616  9677 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.301069  9568 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.261780  9719 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.313656  9712 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:24.314277  9753 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.252446  9764 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.311303  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:24.318039  8287 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
W20260709 13:16:24.321007  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.276196  9698 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:24.323109  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.324361  8220 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:24.325505  9757 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:16:24.325846  9751 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.333866  9720 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:24.334487  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 74017.8us
I20260709 13:16:24.335052  9637 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.290490  9652 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.289179  8212 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.299124  9760 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:24.341966  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 83421.3us
I20260709 13:16:24.294682  9768 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.347074  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:24.324023  9643 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:24.335633  9620 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:24.352595  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.318128  9684 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.345932  9649 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.338536  9766 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.408952  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 388) took 1498 ms. Trace:
W20260709 13:16:24.553597  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.403118  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 136029us
I20260709 13:16:24.402878  8216 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
W20260709 13:16:24.622802  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 275783us
I20260709 13:16:24.349586  9586 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:24.446195  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1207) took 1399 ms. Trace:
I20260709 13:16:24.626744  9764 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:24.349687  9630 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.280s
I20260709 13:16:24.406589  9730 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.552603  9637 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.403869  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1079) took 1672 ms. Trace:
I20260709 13:16:24.404028  9677 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.486495  9773 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.495859  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:24.476523  9742 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:24.404608  8211 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:24.600025  8927 rpcz_store.cc:276] 0709 13:16:22.910716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.910872 (+   156us) service_pool.cc:224] Handling call
0709 13:16:22.911128 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.995881 (+1084753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.408688 (+412807us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400174654. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:24.408899 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492169088}
I20260709 13:16:24.626255  8295 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:24.483021  9589 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:24.387015  9675 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:24.627288  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 316030us
I20260709 13:16:24.474825  9758 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.404471  9719 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.624792  9644 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.488948  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:24.631814  9756 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.560s	user 0.002s	sys 0.001s
I20260709 13:16:24.628883  8217 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.446633  9763 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.445665  9702 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.631506  8292 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:24.634016  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.631857  8186 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:24.450299  9687 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.555065  9649 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.497926  8230 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:37896 (request call id 147) took 1733 ms. Trace:
I20260709 13:16:24.497367  9642 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:24.407750  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1082) took 1671 ms. Trace:
I20260709 13:16:24.633519  8213 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.451725  9674 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.489758  9752 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.488991  9641 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.449020  9691 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.631073  9630 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:16:24.346872  9593 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.692510  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.692842  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.693156  8368 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:24.693481  8364 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:24.694193  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.692520  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.694932  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.695640  8366 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:24.683235  8286 rpcz_store.cc:276] 0709 13:16:22.736199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.738463 (+  2264us) service_pool.cc:224] Handling call
0709 13:16:23.000634 (+262171us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:24.407502 (+1406868us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b5400127fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:24.407676 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296215040}
I20260709 13:16:24.446906  9771 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.679589  9649 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.664064  8216 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:24.628988  9774 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.628701  8360 rpcz_store.cc:276] 0709 13:16:23.046747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.047351 (+   604us) service_pool.cc:224] Handling call
0709 13:16:23.047767 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:23.048221 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:23.048262 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:23.048756 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:16:23.243526 (+194770us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:23.644898 (+401372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.645113 (+   215us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.265675 (+620562us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:24.445606 (+179931us) raft_consensus.cc:1685] finished
0709 13:16:24.445631 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.445963 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4512,"spinlock_wait_cycles":49646848,"thread_start_us":169561,"threads_started":1,"wal-append.queue_time_us":783357}
I20260709 13:16:24.631314  9720 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:24.631511  9637 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.406831  9717 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.633199  9768 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.631109  9764 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.346483  8921 rpcz_store.cc:276] 0709 13:16:22.765773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.767316 (+  1543us) service_pool.cc:224] Handling call
0709 13:16:22.767748 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.921391 (+1153643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.274033 (+352642us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b540065f754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:24.294508 (+ 20475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958827904}
I20260709 13:16:24.632007  8289 rpcz_store.cc:276] 0709 13:16:22.731517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.735230 (+  3713us) service_pool.cc:224] Handling call
0709 13:16:22.998960 (+263730us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:22.999104 (+   144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.186372 (+1187268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.403559 (+217187us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540005c3d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:24.403806 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485824640}
I20260709 13:16:24.632036  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.632897  9708 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.403132  9755 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.632825  9698 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.636176  9643 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.408643  9682 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.638095  9589 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.730141  9717 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:24.730293  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.726771  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.731369  8924 raft_consensus.cc:2393] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:24.691599  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.427264  9767 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:24.698732  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.726862  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.640409  9644 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:24.698925  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.731807  8360 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.744587  8215 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:24.756909  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.602962  8261 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:24.383507  9769 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.702277  8369 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:24.678491  8230 rpcz_store.cc:276] 0709 13:16:22.768200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.768371 (+   171us) service_pool.cc:224] Handling call
0709 13:16:24.255380 (+1487009us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b5400092c54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd41b3f7 00007f32023b1036 00007f32023baa3e 00007f31f9c7e27b 00007f32023ba9ba 00007f32023b5acc 00007f32023b0c7b 00007f32023a58d1 00007f32014594b4 00007f3201459442
0709 13:16:24.497793 (+242413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150059264}
I20260709 13:16:24.684345  9702 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.668362  8214 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:24.633096  9742 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.662367  9751 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.742375  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.777985  9766 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.687548  9761 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.686960  9734 consensus_queue.cc:1059] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:24.718441  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.719769  9674 consensus_queue.cc:1059] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:16:24.404285  9568 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.722867  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.731902  9589 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.726181  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.773828  9702 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.731899  8220 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.665503  9763 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:24.736886  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 102173us
I20260709 13:16:24.632464  9773 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:24.767037  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.794867  9776 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:16:24.762446  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 161093us
I20260709 13:16:24.757616  8360 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:24.775310  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.732026  9643 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.737524  9675 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:24.780825  9751 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.665925  9620 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.782851  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.745622  9682 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.734089  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.716449  9768 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.771457  9720 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.742748  9717 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.781260  9644 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:24.746459  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:24.781749  9728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.009s	sys 0.020s
I20260709 13:16:24.756953  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.771018  9586 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:24.791764  8369 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:24.789191  9684 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.757599  9774 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.795804  8367 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:24.739568  9698 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.791000  9674 raft_consensus.cc:3055] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.795343  9734 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:24.799656  8261 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:24.801211  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.792832  9702 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.794112  9761 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.802572  9768 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.803975  9719 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.807009  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:24.919487  8219 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.739223  9708 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.814568  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:24.835757  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:24.923194  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 124823us
I20260709 13:16:24.854928  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.804773  8211 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:24.855213  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.909991  8213 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:24.924480  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:24.853359  8186 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:24.921659  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.922840  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:24.855278  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:24.925709  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 72472.9us
I20260709 13:16:24.926241  9593 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.927016  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1164) took 1083 ms. Trace:
I20260709 13:16:24.927124  8368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:24.922086  9773 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:24.927819  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.939282  8217 rpcz_store.cc:276] 0709 13:16:23.844092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.846163 (+  2071us) service_pool.cc:224] Handling call
0709 13:16:24.598837 (+752674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.660816 (+ 61979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.926831 (+266015us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b540043dd50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:24.926958 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623147904}
I20260709 13:16:24.858522  9568 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.803668  9720 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.857494  9643 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.848407  9751 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.932354  9761 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.933332  9675 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.934124  9718 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.972096  9744 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:24.971882  9751 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.972615  9744 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.973029  9744 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:24.938321  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.939913  8928 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:24.939618  8368 raft_consensus.cc:606] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:24.919312  9734 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:24.806557  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:24.854666  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.806455  9755 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.976999  8183 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:24.951660  8216 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:24.905184  8924 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:24.952335  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:24.980767  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.994303  8186 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:24.807137  9767 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.940773  9684 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.917639  9674 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:24.986835  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.992409  8219 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:24.943822  9742 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:24.915122  9728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.009s	sys 0.021s
I20260709 13:16:25.002493  8920 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:24.806160  9717 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:24.973768  9720 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.985617  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.016852  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:25.017017  8213 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:24.996994  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.971614  9718 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.022032  9718 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.001778  9652 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:25.028477  9652 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.028801  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.999008  9682 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:25.029526  8920 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.947224  9620 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.029745  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:24.981603  9771 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:16:25.030575  9652 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.022814  9767 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.032250  9767 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.032716  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.032872  9720 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.033347  8363 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:25.003077  9753 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:25.034201  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:25.034523  9753 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.034744  9720 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.034960  9753 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.035354  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.035310  9718 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:24.973906  8921 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:24.919009  9649 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.037513  9718 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.039179  9649 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:24.999722  9568 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:25.018963  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:25.040706  8367 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:25.040724  9568 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.040982  9734 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.041548  9568 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.042503  9734 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.044447  9688 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:25.005532  9684 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:25.020143  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 219902us
I20260709 13:16:25.002379  8211 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:25.045118  9688 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.024724  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.025710  9709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:25.026224  9764 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.056496  9764 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.027149  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.045401  9684 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.051404  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.064059  8366 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:25.064581  9771 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.065092  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.065112  9771 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.065860  8366 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:25.066768  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.067699  9771 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.023260  9761 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.069087  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.068410  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.082381  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.082993  8288 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.083108  9643 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:25.059515  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:25.084765  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.060240  9739 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:25.085421  9739 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.085896  9739 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.061079  9708 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.087500  9708 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:25.088913  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.089740  8211 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:25.089839  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.090399  8216 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:25.088457  9708 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:25.091599  9708 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.002270  9769 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.034198  9767 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:24.977227  9586 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.083069  8295 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:25.097435  9586 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.072022  8363 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:25.101311  9769 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.102346  9769 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.103240  9742 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:25.103615  9742 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:25.101526  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.104449  9742 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.105387  8219 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:25.105751  9742 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.104240  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.107586  8220 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:25.107712  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:25.052037  9688 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.077595  9589 consensus_queue.cc:1059] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:16:25.119843  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.120417  9644 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:25.120677  8921 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.079934  9764 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.081558  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:25.123832  9589 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:25.124346  9589 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:25.125394  9589 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.126850  9589 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:25.127545  9773 consensus_queue.cc:1175] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:16:25.128804  8923 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:16:25.120842  9644 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.082724  8366 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:25.129762  9644 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.130568  9643 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:25.117908  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:25.141364  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:25.145025  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.057919  8214 raft_consensus.cc:2368] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:25.158223  8186 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:25.023813  9755 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.146875  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.011180  9675 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.163432  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:24.940646  9768 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.164384  8368 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:25.166889  8360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c835fd22b7643a981b446089ad74066"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:25.167613  8360 raft_consensus.cc:606] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:25.043974  9568 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.163502  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:25.170222  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:25.171834  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.171968  9779 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:25.175351  9779 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.175465  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.177138  8186 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:25.077371  8920 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:25.166985  9771 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:25.175908  9779 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.076411  9763 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.179738  9682 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:25.183863  9641 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:25.184244  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:25.184301  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.185379  9675 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.185922  9755 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.190253  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:25.192899  8289 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:25.181561  9593 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:25.224617  9593 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.198845  9568 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:25.224797  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.225267  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.200063  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.199970  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.201610  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.160878  9751 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.212478  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.212320  9673 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.216367  9781 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:16:25.222211  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.224123  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.173607  9728 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.230908  8220 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:25.224840  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.301810  8290 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:25.214519  9719 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:25.211767  9771 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.226158  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.309635  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.302729  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.310405  9644 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.311462  8291 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:25.212975  9717 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.219528  9641 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.301496  8922 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:25.225062  9593 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.225080  9755 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.270380  8212 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:25.327747  9769 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.328558  9769 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.329411  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1064) took 1052 ms. Trace:
I20260709 13:16:25.283447  8287 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:25.284169  8183 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:25.332557  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 48486.9us
I20260709 13:16:25.334100  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:25.183902  9620 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.233006  9780 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:25.291914  8218 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:25.295773  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.278806  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.298393  8293 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:25.300397  9774 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.300976  9728 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.312419  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.302647  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.310483  8289 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:25.317785  8290 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:25.312512  9641 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.318113  8286 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:25.319419  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.358676  8219 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:25.327420  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.335184  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:25.232146  9637 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.329773  8212 rpcz_store.cc:276] 0709 13:16:24.277302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.631744 (+354442us) service_pool.cc:224] Handling call
0709 13:16:25.329208 (+697464us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b5400035cd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:25.329356 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122647296}
I20260709 13:16:25.337653  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.337873  9769 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.345986  8294 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:25.313325  9719 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.352586  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.355609  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.355526  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.313232  9771 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.361963  8287 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:25.363257  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:25.339092  9763 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:25.357920  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.356009  9780 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.344688  9751 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:25.380553  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.347451  8288 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:25.383302  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.369954  9766 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:25.364358  9586 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:16:25.387996  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.388692  9780 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.302083  9673 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.387390  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.383955  8216 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:25.349161  9698 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.330909  9684 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.388020  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.289825  9674 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.397746  8290 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:25.381804  9719 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.397185  9644 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:25.401824  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.365564  8291 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:25.415865  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.416296  8291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:25.416560  8294 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:25.416916  8291 raft_consensus.cc:606] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:25.417251  8291 raft_consensus.cc:614] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:25.349010  9620 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.391029  8288 pending_rounds.cc:85] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 1
I20260709 13:16:25.387437  9766 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.389403  9751 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:25.404240  8214 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:25.409686  8287 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:25.417732  8294 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:25.387444  9682 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:25.423069  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.343743  9744 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.408504  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.423339  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:25.430187  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.430863  9744 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:25.431632  8928 raft_consensus.cc:2368] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:25.433117  8287 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:25.423084  8288 pending_rounds.cc:107] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:25.397481  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.434748  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.417850  9768 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.446136  8290 raft_consensus.cc:2393] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:25.428463  9766 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.436906  9751 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.437110  9682 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.441146  8288 raft_consensus.cc:2889] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.430852  8291 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
W20260709 13:16:25.455392  9702 consensus_meta.cc:287] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:16:25.466289  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.467638  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:25.468526  8360 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.465401  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.474748  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.475340  8293 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:25.454263  8924 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:25.475685  9728 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.458835  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.441989  9739 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.464116  9674 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:25.464385  9682 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.467156  9684 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.496680  8360 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.483114  9769 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.512885  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.517149  8287 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:25.513738  8186 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:25.515141  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:25.522217  9641 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.522760  9593 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.524137  8363 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.524387  9641 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.529548  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.469960  9702 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.537266  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:25.537955  8360 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.543793  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.530207  8291 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:25.548933  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:25.549309  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.550208  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.550837  8926 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:25.487668  8922 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:25.551658  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.549480  8293 raft_consensus.cc:606] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:25.553337  8293 raft_consensus.cc:614] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:25.560456  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:25.561028  8287 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.562443  8220 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:25.568410  8919 raft_consensus.cc:2368] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:25.568555  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.570781  8215 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:25.538064  9684 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:25.572929  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.551244  9673 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:25.551964  8364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.017s	sys 0.009s
W20260709 13:16:25.580441  8364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.018s	sys 0.009s
I20260709 13:16:25.497746  9753 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:25.590621  8926 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:16:25.590960  8219 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.592834  8926 pending_rounds.cc:85] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 4
I20260709 13:16:25.593191  8926 pending_rounds.cc:107] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:25.560822  9637 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:25.593474  8926 raft_consensus.cc:2889] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:25.563928  8258 connection.cc:256] RPC call timeout handler was delayed by -1.0691666679999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:16:25.599855  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:25.599901  8292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.031s	sys 0.036s
I20260709 13:16:25.541546  9769 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.602799  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.605515  8215 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:25.607550  8213 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:25.589792  9684 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:25.603677  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:25.613541  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:25.614416  8219 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:25.610787  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:25.590758  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.599853  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.637064  8360 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.631769  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:25.642448  8217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.017s	sys 0.024s
W20260709 13:16:25.642927  8217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.017s	sys 0.024s
I20260709 13:16:25.655881  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.613742  9620 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:25.606570  8362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.011s	sys 0.018s
I20260709 13:16:25.616909  8215 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.662369  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:25.624852  9755 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.624068  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.629518  9593 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.666949  8213 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:25.666775  8258 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:25.623823  9779 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.681738  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.683681  8215 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:25.686062  8186 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:25.600986  8292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.031s	sys 0.036s
I20260709 13:16:25.633767  8211 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:25.676720  8926 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:25.666450  8362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.011s	sys 0.018s
I20260709 13:16:25.640793  8212 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:25.682699  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.662555  9734 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:25.679847  9753 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.688388  8928 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEARNER]: Advancing to term 4
I20260709 13:16:25.691377  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:25.662289  8361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.005s	sys 0.025s
I20260709 13:16:25.670907  9688 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:25.688798  9620 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:25.701231  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:25.733351  8219 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
W20260709 13:16:25.689805  9708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.016s	sys 0.038s
I20260709 13:16:25.695803  8360 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.715049  8363 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.726845  8368 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:25.701840  9687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.002s	sys 0.026s
W20260709 13:16:25.727223  8361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.006s	sys 0.025s
I20260709 13:16:25.734304  9688 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.745774  9688 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.746040  8186 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:25.746251  9688 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:25.746580  9688 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.746889  9688 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.747675  9753 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:25.748685  9769 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:25.737514  9708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.017s	sys 0.038s
I20260709 13:16:25.683584  9755 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:25.737973  9687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.002s	sys 0.026s
I20260709 13:16:25.704573  9739 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:25.760104  8261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.046s	sys 0.065s
W20260709 13:16:25.760509  8261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.046s	sys 0.065s
I20260709 13:16:25.759656  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:25.762025  8368 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:25.738602  9702 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.742869  9620 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:25.750547  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.697172  9734 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.749198  9753 raft_consensus.cc:697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:25.765966  9637 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:25.786648  8258 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:25.787928  8360 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.738467  9684 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.768102  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.777151  9779 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:25.820812  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.822212  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.823376  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.773515  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.858605  8924 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:25.858148  9780 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.859547  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.860394  8921 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:25.861071  9780 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:25.862322  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 75793.4us
I20260709 13:16:25.863611  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:25.864193  8288 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:25.865340  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.866111  8288 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:25.866317  9719 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.866899  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.867467  8288 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.835843  9620 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.780401  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.857854  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.827472  9753 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.780612  9702 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.871474  8290 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:25.781113  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.873073  8287 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:25.874096  8360 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:25.875540  9675 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.884454  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.888423  8287 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.875667  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.903513  9675 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:25.904552  9734 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:25.905571  9734 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:25.879570  8289 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.906332  9734 raft_consensus.cc:697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:25.906929  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.905643  9675 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:25.913797  8928 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:25.910517  8360 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:16:25.914721  8360 pending_rounds.cc:85] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 4
I20260709 13:16:25.870913  9763 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.918032  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:25.909030  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.037s
W20260709 13:16:25.914254  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.798414  9637 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:25.918853  8293 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:25.993690  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.896117  8922 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:25.998812  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.023s	sys 0.050s
W20260709 13:16:26.047933  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.023s	sys 0.050s
I20260709 13:16:25.920605  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.004581  8186 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:26.049562  8290 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:26.011879  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:25.903785  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.015184  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:25.894771  8291 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:25.915014  8360 pending_rounds.cc:107] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 13:16:26.051298  8360 raft_consensus.cc:2917] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
W20260709 13:16:26.051935  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47497.2us
W20260709 13:16:26.032531  8294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.009s	sys 0.047s
I20260709 13:16:26.007526  8289 raft_consensus.cc:2368] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
W20260709 13:16:26.041838  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.008s	sys 0.037s
I20260709 13:16:26.043691  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:25.995112  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 151) took 1221 ms. Trace:
I20260709 13:16:26.049893  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:26.057035  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.057456  8923 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:25.991132  9719 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:26.061684  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.061610  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:26.053512  8294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.010s	sys 0.047s
I20260709 13:16:26.062636  8287 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
W20260709 13:16:26.030447  9786 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:16:26.071792  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:26.054968  8363 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:26.008064  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:25.895841  9702 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:26.096876  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.130625  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.060907  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 148) took 1376 ms. Trace:
I20260709 13:16:26.007913  9763 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.040438  9769 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.064118  8360 raft_consensus.cc:2889] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.063158  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:26.069680  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:26.050968  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.106791  9674 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.613s	user 0.006s	sys 0.005s
I20260709 13:16:26.053967  8926 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:26.057756  8289 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:16:26.074441  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.254549  8293 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
W20260709 13:16:26.075865  9751 consensus_meta.cc:287] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.005s
W20260709 13:16:26.077070  9766 consensus_meta.cc:287] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.615s	user 0.011s	sys 0.000s
W20260709 13:16:26.078193  9682 consensus_meta.cc:287] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.005s
I20260709 13:16:26.079433  9709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54790 (request call id 417) took 4183 ms. Trace:
I20260709 13:16:26.058879  9734 consensus_queue.cc:237] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.059067  8919 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:26.081284  9637 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.083455  9641 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:26.060246  9771 consensus_meta.cc:287] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.002s
I20260709 13:16:26.056785  8365 rpcz_store.cc:276] 0709 13:16:24.699733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.706651 (+  6918us) service_pool.cc:224] Handling call
0709 13:16:24.723885 (+ 17234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.736552 (+ 12667us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:25.299418 (+562866us) log.cc:844] Serialized 14 byte log entry
0709 13:16:25.857453 (+558035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.873789 (+ 16336us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:25.876360 (+  2571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.907877 (+ 31517us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.921134 (+ 13257us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":877938,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":21387,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":934295,"threads_started":2}
I20260709 13:16:26.085088  8290 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:16:26.089800  9784 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
W20260709 13:16:26.096201  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.030s
I20260709 13:16:26.295347  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.103020  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:26.055462  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 692227us
I20260709 13:16:26.296209  8363 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:26.296985  8183 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:26.188165  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 176) took 1466 ms. Trace:
W20260709 13:16:26.124236  8366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.069s	sys 0.090s
I20260709 13:16:26.259967  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 156) took 1285 ms. Trace:
I20260709 13:16:26.260869  8367 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:26.111771  8288 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:26.260113  9769 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.102535  9788 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.186060  8362 rpcz_store.cc:276] 0709 13:16:24.680379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.684876 (+  4497us) service_pool.cc:224] Handling call
0709 13:16:24.701661 (+ 16785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.802896 (+101235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.804585 (+  1689us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.806930 (+  2345us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.696235 (+889305us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:25.701077 (+  4842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.912711 (+211634us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b540010ca54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:25.921458 (+  8747us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.991917 (+ 70459us) raft_consensus.cc:1685] finished
0709 13:16:25.998505 (+  6588us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.056149 (+ 57644us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4141,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":9287,"spinlock_wait_cycles":189827968,"thread_start_us":882775,"threads_started":1,"wal-append.queue_time_us":985374}
I20260709 13:16:26.243752  9754 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.278288  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1642) took 1469 ms. Trace:
I20260709 13:16:26.097448  8286 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:26.280736  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:26.283046  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:26.276923  9789 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.400s	user 0.001s	sys 0.001s
I20260709 13:16:26.265163  9709 rpcz_store.cc:276] 0709 13:16:21.896160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.900730 (+  4570us) service_pool.cc:224] Handling call
0709 13:16:22.399577 (+498847us) ts_tablet_manager.cc:934] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
0709 13:16:25.017022 (+2617445us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:25.497558 (+480536us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:25.527109 (+ 29551us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:26.078529 (+551420us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:26.078857 (+   328us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:26.079184 (+   327us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:26.079301 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":13177,"tablet-copy.queue_time_us":396765,"thread_start_us":233367,"threads_started":2}
I20260709 13:16:26.253490  9719 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.257643  9739 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.119824  9688 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:26.295645  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.013s	sys 0.030s
I20260709 13:16:26.315101  8287 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:26.303252  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.338439  8369 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:26.057830  9779 raft_consensus.cc:993] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 9e95b04d03d241329435b6d08dd1f236 to start an election
I20260709 13:16:26.295400  8290 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:26.327522  8293 raft_consensus.cc:2368] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
W20260709 13:16:26.329908  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 49229.9us
I20260709 13:16:26.332647  8367 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:26.331635  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:26.336910  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:26.339247  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 475700us
I20260709 13:16:26.313050  8292 rpcz_store.cc:276] 0709 13:16:24.721584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.721735 (+   151us) service_pool.cc:224] Handling call
0709 13:16:24.732516 (+ 10781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.732760 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:24.787121 (+ 54361us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.089174 (+1302053us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:26.187730 (+ 98556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.187800 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:26.187856 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.187936 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.188065 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":873930,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":215665,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":2950912,"thread_start_us":1452153,"threads_started":3,"wal-append.queue_time_us":991094}
I20260709 13:16:26.311398  8364 rpcz_store.cc:276] 0709 13:16:24.809294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.826090 (+ 16796us) service_pool.cc:224] Handling call
0709 13:16:24.826554 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.934915 (+108361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.934951 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.935436 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.587239 (+651803us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:25.587309 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.599979 (+ 12670us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.278085 (+678106us) raft_consensus.cc:1685] finished
0709 13:16:26.278106 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.278232 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6643,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":651271,"threads_started":1,"wal-append.queue_time_us":832406}
I20260709 13:16:26.280002  9687 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:26.336185  9675 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.293279  9708 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:26.357300  9687 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.357757  9708 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.359264  8295 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:26.293139  9755 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.299108  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.342705  9739 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.361869  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:26.362171  9769 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:26.362412  9739 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:26.363070  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:26.267012  9751 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.364924  9751 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:26.365191  9763 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.352813  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.367261  8363 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
W20260709 13:16:26.311861  8366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.095s	sys 0.124s
I20260709 13:16:26.348603  8360 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.354904  9637 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.354568  8290 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.355808  8291 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:26.356321  9684 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:26.356493  8183 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:26.380122  8290 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.379987  8183 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:26.311894  9641 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:26.276602  9682 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.359905  9687 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:26.292528  9780 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.311318  8217 rpcz_store.cc:276] 0709 13:16:24.974993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.980614 (+  5621us) service_pool.cc:224] Handling call
0709 13:16:24.980880 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.981142 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:25.643271 (+662129us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.256915 (+613644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:26.256982 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:26.257024 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.257098 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.259895 (+  2797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100646,"prepare.queue_time_us":913546,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":120078,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":17258,"thread_start_us":1126293,"threads_started":2}
I20260709 13:16:26.293085  9674 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:26.370386  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 147) took 1706 ms. Trace:
I20260709 13:16:26.369303  9709 tablet_copy_client.cc:806] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:26.370280  9719 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.276764  9766 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.336527  9797 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:26.312376  9771 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.409790  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 181) took 1226 ms. Trace:
I20260709 13:16:26.362955  9739 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:26.364845  8258 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:26.413350  8183 leader_election.cc:400] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:26.373275  9755 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.410310  8295 rpcz_store.cc:276] 0709 13:16:25.183859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.183974 (+   115us) service_pool.cc:224] Handling call
0709 13:16:26.409554 (+1225580us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002e54d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:26.409711 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2394083200}
I20260709 13:16:26.402062  8289 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:26.418756  8183 leader_election.cc:403] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:26.387766  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1650) took 1226 ms. Trace:
I20260709 13:16:26.384747  9795 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.400871  9687 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.435482  8218 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:26.379598  9637 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.422704  8183 leader_election.cc:400] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:26.437505  8183 leader_election.cc:403] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:26.439059  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 74288.4us
I20260709 13:16:26.433862  8220 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:26.384883  9763 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:26.434245  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.408322  9797 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:26.450788  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 387646us
I20260709 13:16:26.420290  9702 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.392155  9751 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:26.406795  9674 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.458310  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:26.448482  9709 tablet_copy_client.cc:670] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:26.445356  9753 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.415544  9780 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.451642  9620 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.468765  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:26.470675  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:26.471305  8919 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.471401  9806 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.473388  9780 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:26.460628  8261 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:26.460616  8360 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:26.449280  9797 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.458017  9641 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:26.480345  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:26.481204  8923 raft_consensus.cc:2368] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:26.482496  8926 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
W20260709 13:16:26.486896  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 144928us
I20260709 13:16:26.511243  8290 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:26.512228  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:26.515266  8261 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:26.483388  9643 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.461344  9702 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:26.510625  9779 raft_consensus.cc:1081] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Signalling peer 9e95b04d03d241329435b6d08dd1f236 to start an election
I20260709 13:16:26.519897  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.520846  8368 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
W20260709 13:16:26.521111  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 81223.5us
I20260709 13:16:26.401314  8361 rpcz_store.cc:276] 0709 13:16:24.663851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.665152 (+  1301us) service_pool.cc:224] Handling call
0709 13:16:24.677672 (+ 12520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.976408 (+298736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.976439 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.980816 (+  4377us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.756818 (+776002us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:25.759957 (+  3139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.091214 (+331257us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400355a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:26.091286 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.366253 (+274967us) raft_consensus.cc:1685] finished
0709 13:16:26.366283 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.370317 (+  4034us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27332,"raft.queue_time_us":34984,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12176,"spinlock_wait_cycles":610556672,"thread_start_us":760725,"threads_started":1,"wal-append.queue_time_us":821432}
I20260709 13:16:26.535349  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:26.535406  9794 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:26.485329  9687 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.536576  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.537746  8363 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:16:26.460505  9803 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:16:26.536247  8261 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:26.539727  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:26.544584  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 90369.2us
I20260709 13:16:26.518163  9780 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:26.550261  9734 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.550837  9734 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.551283  9734 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.541531  9804 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.552860  9804 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.553295  9804 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.518903  9800 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:26.556442  9800 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.556965  9800 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.541923  9688 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.561002  9688 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.561435  9688 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.561897  9688 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:26.564913  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 49433.4us
I20260709 13:16:26.566160  8889 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:26.434700  8366 rpcz_store.cc:276] 0709 13:16:25.161716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.171679 (+  9963us) service_pool.cc:224] Handling call
0709 13:16:25.172020 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.174990 (+  2970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.175026 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.175539 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.380930 (+1205391us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:26.380981 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.381062 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:26.381120 (+    58us) raft_consensus.cc:1685] finished
0709 13:16:26.381136 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.386207 (+  5071us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4058,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":24188,"thread_start_us":1193657,"threads_started":1,"wal-append.queue_time_us":1132575}
I20260709 13:16:26.568226  8889 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:26.543078  9684 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:26.540669  9687 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:26.575165  9755 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:26.578585  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 120333us
I20260709 13:16:26.580147  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:26.574070  8892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.636s (SENT) [suppressed 25 similar messages]
I20260709 13:16:26.580559  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:26.538868  9643 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.543865  9702 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.579145  9687 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.581405  9755 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.603766  9755 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.604501  8258 leader_election.cc:400] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:26.605046  8258 leader_election.cc:403] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:26.613487  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:26.618168  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44137.9us
W20260709 13:16:26.619748  9805 log.cc:927] Time spent T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:16:26.582103  9754 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:26.623884  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:26.631392  9779 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:26.632280  9771 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.594484  9719 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.601310  9682 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:26.650691  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70654.3us
I20260709 13:16:26.577523  9684 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.633004  9674 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.638422  9754 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.664958  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:26.625702  9817 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.624330  9820 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:26.696722  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.647346  9803 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:26.697186  8366 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:26.708915  9819 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.613682  9755 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:26.710956  9675 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.711413  9675 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:26.652025  9802 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:16:26.712764  9807 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:16:26.713994  9801 log.cc:927] Time spent T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:16:26.667493  9719 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:26.706344  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 138231us
I20260709 13:16:26.706687  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.708209  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.708544  9674 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:26.709450  9819 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.698895  9734 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.699393  9800 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.711768  9755 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.723695  9824 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:26.723838  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.711812  9675 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.724370  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.657733  9637 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.729784  9820 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.708925  9803 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:26.733170  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.722465  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.729395  9771 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:26.764546  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:26.760703  9753 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:26.848996  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.849258  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:26.702682  9821 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:26.850219  9821 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:26.793802  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:26.653793  9814 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:16:26.793031  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:26.844640  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.765543  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:26.847059  8290 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.855222  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:26.861661  8294 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:26.861812  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:26.862614  8287 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:26.862612  8292 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:26.850864  9826 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:26.863924  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.863883  9826 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.867137  9826 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.867431  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.856061  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:26.868199  9755 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.868772  8919 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:26.847429  8367 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:26.850629  9821 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.721024  9719 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.863162  8295 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 1.
I20260709 13:16:26.890193  9719 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.871452  8217 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:26.759840  9674 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:26.881167  9734 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:26.793928  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:26.793457  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:26.854218  8361 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:26.863502  8366 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:26.887478  9769 raft_consensus.cc:993] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 9e95b04d03d241329435b6d08dd1f236 to start an election
I20260709 13:16:26.877439  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:26.799542  9620 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:26.934005  8293 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:26.960621  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1193) took 1413 ms. Trace:
I20260709 13:16:26.961118  8220 rpcz_store.cc:276] 0709 13:16:25.547488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.563225 (+ 15737us) service_pool.cc:224] Handling call
0709 13:16:25.563500 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.440641 (+877141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.960425 (+519784us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400092754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:26.960576 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971860352}
I20260709 13:16:26.759598  9825 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.899688  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:26.721138  9827 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.189s
I20260709 13:16:26.799547  9593 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.793064  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.970973  8365 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:26.970719  9825 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:26.959800  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 346394us
I20260709 13:16:26.972344  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:26.973649  9825 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.956894  9809 raft_consensus.cc:1081] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Signalling peer 9e95b04d03d241329435b6d08dd1f236 to start an election
I20260709 13:16:26.976208  9702 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:26.977701  9708 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.855759  9771 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.904227  8290 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:26.892340  9819 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:26.934041  9674 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.972249  9593 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.968742  8217 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.984004  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:26.985359  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:26.961175  9829 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:26.986812  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:26.873708  9643 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:26.801517  9688 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:26.898736  9766 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:26.988225  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:26.999861  8220 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:26.990181  8217 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:26.981009  8291 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:26.793064  9804 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.992188  9795 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:26.992436  9823 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.992555  9832 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.042972  9832 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.993489  9593 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:27.000892  9819 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:16:27.045367  9832 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.045552  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1238) took 1052 ms. Trace:
I20260709 13:16:27.048638  8360 rpcz_store.cc:276] 0709 13:16:25.992792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.312623 (+319831us) service_pool.cc:224] Handling call
0709 13:16:27.045375 (+732752us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b5400156154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:27.045499 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14787840}
I20260709 13:16:27.050943  9708 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:16:27.051469  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:27.051774  8290 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:26.994542  9688 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:26.997398  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:26.997741  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.052634  8213 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:27.052716  8214 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:27.053072  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:27.053591  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.053735  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.054145  8213 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:27.054358  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:27.055020  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.004546  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:27.055799  8293 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:27.056833  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:27.004546  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.057736  8216 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:27.058691  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.005769  8186 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:27.060511  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 61928.5us
I20260709 13:16:27.061023  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:27.061252  8186 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:27.061657  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:27.006807  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:27.062322  9825 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.062672  8292 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:27.062825  9825 raft_consensus.cc:697] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:27.062916  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:27.063555  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:27.007433  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.064378  8292 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:27.064508  8220 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:27.008081  9771 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:27.010144  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:27.064226  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:27.067468  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:27.010413  9675 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:27.013229  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:27.013341  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1077) took 1666 ms (client timeout 2152 ms). Trace:
I20260709 13:16:27.015215  9820 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:27.014506  8114 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 3, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 3 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.071676  8366 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:27.015321  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:27.001571  9803 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:27.016713  9800 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:26.930694  9754 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:27.076469  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 88278.1us
I20260709 13:16:27.072242  8114 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.018316  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:27.021862  8288 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:27.022799  9804 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:27.023586  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1575) took 1229 ms. Trace:
I20260709 13:16:27.025635  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:27.090657  8219 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:27.027742  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:27.091235  8366 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:27.035995  9719 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:27.036204  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:27.039783  9797 consensus_meta.cc:287] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 13:16:27.087160  9811 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.086967  8212 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:27.098641  9797 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:27.099123  9811 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:27.040926  9821 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.984184  9734 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:16:26.999105  9829 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:26.990891  9824 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:26.983529  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.054611  8214 raft_consensus.cc:2410] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:27.001179  8215 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:27.055191  8291 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:27.059868  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:27.001633  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:27.066112  8213 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:27.114573  8219 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:27.060295  9832 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:27.070924  8220 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:27.073860  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.072862  8889 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:27.081923  8114 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.091128  8258 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:27.033568  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:27.119917  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 47137.5us
I20260709 13:16:27.120381  8258 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:27.082046  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:27.091250  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:27.093195  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.120615  8114 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 3, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 3 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.094689  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:27.093264  8928 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:27.101392  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:27.095589  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:27.080327  9593 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:16:27.073730  9795 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.077078  9763 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.076913  9751 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:27.104665  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:27.086093  9688 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.087231  9643 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.126200  9675 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:27.188679  9688 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:27.189224  9688 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.189599  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.175915  8213 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c835fd22b7643a981b446089ad74066"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:58438
I20260709 13:16:27.190753  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.044543  9687 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:27.086503  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.193126  8362 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.192705  9643 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:27.194363  9829 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:27.089933  9810 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:27.195555  9643 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:27.068459  8218 rpcz_store.cc:269] 0709 13:16:25.347189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.355408 (+  8219us) service_pool.cc:224] Handling call
0709 13:16:27.013149 (+1657741us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001d4054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:27.013260 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437022976}
I20260709 13:16:27.197185  9821 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:27.095886  9827 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.116684  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:27.198676  8287 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:27.198815  8368 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:27.110807  8926 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:27.118351  8216 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:27.120814  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:27.112891  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:27.136588  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 54654.4us
I20260709 13:16:27.102669  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:27.124478  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:27.122200  8114 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.114151  8211 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:27.125326  9814 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:27.125396  9804 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:27.178527  9819 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.125888  8923 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:27.110500  9709 tablet_copy_client.cc:538] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:27.272157  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:27.267549  8365 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:27.273339  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.273492  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.273890  8368 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.274178  8365 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:27.123102  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:27.275048  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:27.275574  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 152517us
I20260709 13:16:27.265949  9814 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:27.276239  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:27.200282  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 79537.2us
I20260709 13:16:27.277633  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:27.124027  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:27.278781  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 154809us
I20260709 13:16:27.124253  8369 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:27.204330  8363 raft_consensus.cc:2368] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:27.157886  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.206127  9751 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.244133  9675 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.126379  8293 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:27.075820  9825 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:27.105988  9739 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:27.240248  9771 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:27.271142  9797 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:27.242659  8261 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:27.255160  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.267998  8114 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.328791  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:27.332401  9827 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.332825  9827 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.333230  9827 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.333623  8361 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:27.125627  9822 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:27.118566  9788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.012s	sys 0.011s
I20260709 13:16:27.128523  8367 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:27.089715  8289 rpcz_store.cc:276] 0709 13:16:25.793776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.298792 (+505016us) service_pool.cc:224] Handling call
0709 13:16:27.023330 (+724538us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b540005bc54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:27.023494 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29245824}
I20260709 13:16:27.117769  9755 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.188s
I20260709 13:16:27.276412  9814 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.190848  8213 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.401177  8213 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.280833  8360 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.126364  9779 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.191825  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:27.402211  8364 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:27.279945  8892 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:27.403358  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 123486us
I20260709 13:16:27.135663  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:27.241341  9824 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.192747  9687 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:27.240733  9763 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.192751  9811 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:27.295583  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:27.242354  8366 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:27.309151  9754 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:27.312006  8368 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:27.284081  9804 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:27.314033  9719 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:27.315570  9832 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:27.295692  9821 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.300994  9643 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.283493  9812 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.283166  9751 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.324985  8363 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.327818  8369 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:16:27.328819  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 86263.8us
I20260709 13:16:27.453178  8261 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:27.270473  8216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:58438
I20260709 13:16:27.455150  8216 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.455600  8216 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.244488  9620 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:16:27.284781  9833 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.302011  9675 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.265539  9795 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:27.382368  9788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.014s	sys 0.018s
W20260709 13:16:27.422624  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 287042us
I20260709 13:16:27.473985  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:27.474407  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:27.427322  8186 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:27.429723  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 364148us
I20260709 13:16:27.417550  9824 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:27.421608  9763 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.419708  8362 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:27.443415  8360 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:27.448226  9812 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:27.466097  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.429551  9811 raft_consensus.cc:2764] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:16:27.426622  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 131135us
I20260709 13:16:27.434926  9684 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:16:27.469019  8213 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:27.480263  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 53050.1us
I20260709 13:16:27.506289  8186 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:27.435328  9821 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:27.429404  9822 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:27.490283  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 85035.4us
I20260709 13:16:27.429462  9840 raft_consensus.cc:2764] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:27.468902  9675 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.469336  9823 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.434553  9771 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:27.513085  8366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:27.521049  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:27.532431  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 58072.5us
I20260709 13:16:27.521070  9821 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.469782  9687 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:27.486591  9788 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:27.483506  9824 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.495309  9812 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.554082  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:27.506877  9682 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.520675  9822 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:27.575353  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 54388us
I20260709 13:16:27.603479  8363 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:27.584052  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 110104us
I20260709 13:16:27.579614  9788 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:27.592267  9832 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.594395  8261 leader_election.cc:400] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:27.614796  8261 leader_election.cc:403] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:27.596994  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 103950us
I20260709 13:16:27.599156  8213 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:27.553098  9823 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.554666  9803 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.563333  9826 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.528573  9688 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:27.624715  8261 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:27.618742  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:27.620878  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:27.619494  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:27.628434  8919 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:27.620213  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:27.629004  9771 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:27.629429  9754 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:27.629894  9754 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:27.596634  9780 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:27.596962  9682 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:27.615849  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:27.625990  8928 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:27.626518  8261 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:27.629201  8183 leader_election.cc:400] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:27.634341  8183 leader_election.cc:403] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:27.603267  9822 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.561681  9804 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:27.613365  9788 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.634717  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:27.635623  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:27.656355  9771 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.656769  9771 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.657056  8183 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:27.657827  9820 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.658576  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:27.659356  9820 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.659688  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:27.660449  9820 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.638311  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:27.660840  9820 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:27.661255  9820 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.661636  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:27.662253  9709 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:27.623080  8258 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:27.623934  9826 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.640460  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:27.677525  9826 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.633095  9780 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.678086  9780 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:27.654363  9845 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:16:27.631019  9840 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:27.621096  9832 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:27.678387  8923 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:27.623718  9803 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.660847  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:27.674937  9795 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:27.662737  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:27.623792  9687 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:27.621953  9823 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.633548  9754 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.662480  9779 raft_consensus.cc:2764] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:27.621654  9834 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:16:27.688592  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 53954us
I20260709 13:16:27.637398  9682 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:27.736399  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 73726.3us
I20260709 13:16:27.766098  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:27.636741  9620 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
W20260709 13:16:27.677559  9674 consensus_meta.cc:287] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.000s
I20260709 13:16:27.657106  9771 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:27.743917  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 83132us
I20260709 13:16:27.642711  9643 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.678728  9811 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.704754  9854 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:27.707352  9832 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.737506  9803 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.739782  9810 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:27.737236  9855 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.795640  8183 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:27.758306  9795 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:27.881070  9843 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:16:27.804566  9687 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:27.809243  9779 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:27.792964  9674 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:27.876055  9810 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:27.881844  9795 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:27.988131  9811 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:27.988948  9811 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:27.856736  9854 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:27.901324  9856 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:28.012074  8286 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:28.029742  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 234299us
W20260709 13:16:28.030179  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 263905us
I20260709 13:16:27.973503  9810 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.033643  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:28.038746  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:28.038991  8183 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:28.039489  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:27.800109  9643 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:27.993674  9795 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.041215  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:28.043071  8183 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:28.046837  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 423612us
W20260709 13:16:28.052196  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.007s	sys 0.007s
W20260709 13:16:28.053642  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.007s	sys 0.007s
I20260709 13:16:28.054864  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:28.059924  9840 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:28.061589  9855 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:28.062956  9855 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.064328  9755 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:28.044685  9643 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.046651  9779 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.046620  9620 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.047307  9684 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:28.054239  9688 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.047243  9857 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:28.091492  9865 raft_consensus.cc:2764] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:28.146618  9684 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:28.146724  9870 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.138825  9779 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:28.138507  9620 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:28.152444  9858 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
W20260709 13:16:28.147684  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 402465us
W20260709 13:16:28.180035  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 72544.8us
W20260709 13:16:28.152602  9862 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:16:28.165221  9870 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:28.182961  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:28.183269  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 128475us
I20260709 13:16:28.183542  8363 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.184000  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:28.184859  8186 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:28.186975  8114 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.020s	sys 0.028s
W20260709 13:16:28.187412  8114 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.020s	sys 0.028s
I20260709 13:16:28.156644  9684 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:28.170488  9620 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.165827  9779 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:28.191784  8216 consensus_meta.cc:287] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.012s
I20260709 13:16:28.193079  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:28.171769  9811 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:28.196360  8216 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.182578  9865 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.207855  8363 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:28.215920  8216 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.216655  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:58438 (request call id 1095) took 1139 ms. Trace:
I20260709 13:16:28.217038  8216 rpcz_store.cc:276] 0709 13:16:27.077297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.240815 (+163518us) service_pool.cc:224] Handling call
0709 13:16:28.216583 (+975768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:28.194439  9856 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.185792  9870 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.167554  9688 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:28.248489  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:28.257886  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:28.254793  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:28.259449  8287 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
W20260709 13:16:28.259778  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 220323us
I20260709 13:16:28.213352  9811 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.260381  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:28.260473  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:28.188225  9857 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:28.212730  9865 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:28.221904  9674 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:28.315462  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:28.315829  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:28.316501  8369 raft_consensus.cc:2368] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5.
I20260709 13:16:28.317492  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:28.240451  9856 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:28.261891  9868 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.333140  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:28.342080  8289 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:28.342005  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1672) took 1253 ms. Trace:
I20260709 13:16:28.266631  9819 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.342595  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 158467us
I20260709 13:16:28.347404  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:28.347956  8369 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:28.348467  8369 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:28.346159  8183 leader_election.cc:400] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:28.299299  9865 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.350387  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:28.319770  8889 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.006s	sys 0.009s
I20260709 13:16:28.356591  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:28.335427  9856 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.359117  8293 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:28.358611  8369 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:28.359527  8889 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.007s	sys 0.009s
I20260709 13:16:28.362630  8369 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:28.362784  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 819833us
I20260709 13:16:28.266238  9755 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:16:28.358302  8295 raft_consensus.cc:2376] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2. Re-sending same reply.
I20260709 13:16:28.341125  9674 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.199818  9854 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.368038  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:28.402478  8926 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:28.403208  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 52448.9us
I20260709 13:16:28.295877  9811 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.345961  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:28.429303  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:28.430024  8295 raft_consensus.cc:2376] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:16:28.443045  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:28.444787  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:28.445274  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:28.446554  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:28.442607  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 182197us
I20260709 13:16:28.448751  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:28.462990  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:28.364432  9819 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.437126  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:28.486397  9780 consensus_meta.cc:287] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.045s
I20260709 13:16:28.361617  9868 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.465785  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:28.412025  9674 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:28.492122  9824 consensus_meta.cc:287] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.867s	user 0.015s	sys 0.015s
I20260709 13:16:28.494761  9855 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.460410  9833 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.449643  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:28.469205  9708 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:28.510115  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 82063.2us
W20260709 13:16:28.490234  9788 consensus_meta.cc:287] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.834s	user 0.016s	sys 0.012s
I20260709 13:16:28.342593  8365 rpcz_store.cc:276] 0709 13:16:27.088423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.275949 (+187526us) service_pool.cc:224] Handling call
0709 13:16:27.400616 (+124667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.426080 (+ 25464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.429331 (+  3251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.434724 (+  5393us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:27.443827 (+  9103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.451623 (+  7796us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.341802 (+890179us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b540010d950. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:28.341935 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218469120}
W20260709 13:16:28.515249  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 64081.7us
I20260709 13:16:28.493487  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:28.517074  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:28.514550  9861 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:16:28.511529  9833 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.538631  9702 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:28.514657  9875 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:28.502559  9857 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:16:28.516706  9708 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.582945  9708 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.534766  9880 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.553109  9868 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:28.514644  8291 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:28.514770  9842 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:28.557381  9819 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.514647  9873 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.549497  9884 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:28.499748  9824 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.495880  9780 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.531131  9788 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.578339  9869 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:28.579540  9674 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:28.518667  9877 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:28.568145  9833 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.518401  8362 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:28.574267  9702 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:28.558724  9763 consensus_meta.cc:287] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.060s	user 0.009s	sys 0.016s
I20260709 13:16:28.539340  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1679) took 1352 ms. Trace:
I20260709 13:16:28.513597  9855 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.567610  9875 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.609263  8369 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:28.618157  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1256) took 1498 ms. Trace:
I20260709 13:16:28.599071  9811 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:28.620618  8292 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:28.624497  8368 rpcz_store.cc:276] 0709 13:16:27.119296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.422097 (+302801us) service_pool.cc:224] Handling call
0709 13:16:27.444266 (+ 22169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.452547 (+  8281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.452573 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.460663 (+  8090us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.708606 (+247943us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:27.708665 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.708769 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:28.617885 (+909116us) raft_consensus.cc:1685] finished
0709 13:16:28.617915 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.618082 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":663,"raft.queue_time_us":1034,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":16991,"thread_start_us":199692,"threads_started":1,"wal-append.queue_time_us":477188}
I20260709 13:16:28.612996  9842 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:28.611723  9881 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.595533  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 75798us
I20260709 13:16:28.629443  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:28.632620  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:28.619325  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:28.602249  9684 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.633443  8369 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:28.630595  8289 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:28.622068  9877 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:28.649410  9788 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.622344  8361 rpcz_store.cc:276] 0709 13:16:27.182430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.445623 (+263193us) service_pool.cc:224] Handling call
0709 13:16:27.606365 (+160742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.632378 (+ 26013us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:28.148096 (+515718us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.506110 (+358014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:28.509570 (+  3460us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:28.514919 (+  5349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.520798 (+  5879us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.534638 (+ 13840us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27227,"prepare.queue_time_us":523646,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":127235,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":5888,"thread_start_us":635371,"threads_started":3,"wal-append.queue_time_us":269806}
W20260709 13:16:28.651346  9643 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.505s	user 0.003s	sys 0.011s
W20260709 13:16:28.651657  9879 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:16:28.613693  9869 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.603050  9883 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:16:28.625903  9875 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:28.659986  9682 consensus_meta.cc:287] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.865s	user 0.037s	sys 0.060s
I20260709 13:16:28.680245  9620 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:28.681663  9675 consensus_meta.cc:287] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.109s	user 0.012s	sys 0.030s
W20260709 13:16:28.675379  9821 consensus_meta.cc:287] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 1.114s	user 0.029s	sys 0.014s
I20260709 13:16:28.638499  9842 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:28.662231  9823 consensus_meta.cc:287] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.881s	user 0.006s	sys 0.007s
I20260709 13:16:28.624135  9763 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:28.693953  9803 consensus_meta.cc:287] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.819s	user 0.034s	sys 0.018s
I20260709 13:16:28.660502  9824 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:28.661084  9702 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.661588  9780 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:28.678519  8286 consensus_meta.cc:287] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.026s
W20260709 13:16:28.655978  9812 consensus_meta.cc:287] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 1.048s	user 0.008s	sys 0.015s
I20260709 13:16:28.706389  8360 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:28.710844  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 193826us
I20260709 13:16:28.612557  9873 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.605472  9886 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 13:16:28.703475  9820 consensus_meta.cc:287] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.042s	user 0.029s	sys 0.000s
I20260709 13:16:28.638818  9881 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:28.728106  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.037s	sys 0.040s
W20260709 13:16:28.774129  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.037s	sys 0.040s
W20260709 13:16:28.774495  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 589642us
I20260709 13:16:28.777099  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:28.696601  9682 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.678900  9643 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.702015  9763 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:28.716967  9811 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:28.787652  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:28.776315  9877 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.792327  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:28.792904  8218 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:28.728886  8286 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:28.733224  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:28.783025  9754 consensus_meta.cc:287] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.037s	user 0.058s	sys 0.040s
I20260709 13:16:28.696326  9675 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.697266  9821 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.797874  8364 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:28.700423  9803 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.787932  9811 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:28.795276  9827 consensus_meta.cc:287] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.462s	user 0.005s	sys 0.008s
I20260709 13:16:28.779191  9682 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:28.802549  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 339601us
I20260709 13:16:28.716078  9823 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:28.795954  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 62852.7us
I20260709 13:16:28.802896  8217 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:28.798141  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:28.773496  9868 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:28.785483  9857 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:28.809137  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:28.785501  9702 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:28.796494  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:28.820322  8218 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:28.731616  9812 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.813118  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:28.814201  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 181625us
I20260709 13:16:28.780524  9820 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.816892  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:28.795217  9896 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:28.882952  9896 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.884150  9820 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.884943  9788 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:28.885288  8286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1604) took 1824 ms (client timeout 1742 ms). Trace:
I20260709 13:16:28.885439  9788 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:28.885695  8286 rpcz_store.cc:269] 0709 13:16:27.060879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.062661 (+  1782us) service_pool.cc:224] Handling call
0709 13:16:28.885099 (+1822438us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54001275d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:28.885217 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179759360}
I20260709 13:16:28.886137  8925 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:28.886937  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:28.887641  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:28.888466  8928 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:28.889161  9682 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:28.825091  9857 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.892140  9895 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:28.892534  8366 raft_consensus.cc:606] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:28.819037  8367 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:28.819778  8216 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:28.824826  8215 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:28.894385  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1681) took 1593 ms. Trace:
I20260709 13:16:28.894747  8364 rpcz_store.cc:276] 0709 13:16:27.301152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.471457 (+170305us) service_pool.cc:224] Handling call
0709 13:16:28.058690 (+587233us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:28.058894 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.803667 (+744773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.894186 (+ 90519us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b540010d454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:28.894334 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705905920}
W20260709 13:16:28.876930  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 48251us
W20260709 13:16:28.877074  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60266.9us
W20260709 13:16:28.824656  8889 leader_election.cc:336] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.506s (SENT)
W20260709 13:16:28.878679  9822 consensus_meta.cc:287] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.224s	user 0.008s	sys 0.029s
W20260709 13:16:28.880443  9795 consensus_meta.cc:287] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.814s	user 0.022s	sys 0.013s
W20260709 13:16:28.881338  9810 consensus_meta.cc:287] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.814s	user 0.017s	sys 0.001s
I20260709 13:16:28.882298  9675 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:28.812613  9811 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:28.898530  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:28.702795  9842 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.891816  9857 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.812399  9890 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.919077  9890 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.892676  9895 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:28.921304  9890 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.802878  9754 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:28.900835  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 79957us
I20260709 13:16:28.904579  8922 raft_consensus.cc:2368] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:28.902449  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37538 (request call id 9) took 1408 ms. Trace:
I20260709 13:16:28.927722  8366 rpcz_store.cc:276] 0709 13:16:27.484888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.485030 (+   142us) service_pool.cc:224] Handling call
0709 13:16:28.887967 (+1402937us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023edc40 00007f32023d9bb9 00007f32023d947c 00007f31fb95f7d4
0709 13:16:28.893164 (+  5197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39669632}
I20260709 13:16:28.811152  9892 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:28.942533  8892 leader_election.cc:336] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.636s (SENT)
I20260709 13:16:28.887670  8286 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:28.918264  9812 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.914480  9883 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:16:28.903681  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:28.817653  9827 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.819576  9868 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.900799  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:28.896647  9702 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:28.903764  9852 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.283s	user 0.003s	sys 0.003s
I20260709 13:16:28.915318  9795 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:28.912211  9822 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.914642  9833 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.929152  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:29.072031  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 173574us
I20260709 13:16:29.073788  8217 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:29.074286  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:29.074419  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 152181us
I20260709 13:16:29.075564  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:29.071662  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 129159us
W20260709 13:16:29.077126  8892 leader_election.cc:336] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.774s (SENT)
W20260709 13:16:28.928709  9751 consensus_meta.cc:287] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.453s	user 0.025s	sys 0.005s
W20260709 13:16:28.945053  9814 consensus_meta.cc:287] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.523s	user 0.031s	sys 0.031s
I20260709 13:16:28.927452  9684 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:28.968595  9771 consensus_meta.cc:287] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.168s	user 0.012s	sys 0.018s
W20260709 13:16:28.999450  9832 consensus_meta.cc:287] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.160s	user 0.003s	sys 0.021s
W20260709 13:16:29.068274  9903 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:16:29.021391  9821 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.993487  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.091638  9814 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:28.985049  9620 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.084513  8218 raft_consensus.cc:2410] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:29.086974  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:29.104437  8295 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:29.113891  8217 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:29.087200  8928 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:29.088799  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:29.018091  9873 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:29.074700  9823 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.996234  9863 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.020432  9865 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.640s	user 0.000s	sys 0.010s
I20260709 13:16:29.042622  9803 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.068609  9881 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:28.953394  9867 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.081271  9826 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.403s	user 0.030s	sys 0.047s
I20260709 13:16:29.115958  8216 raft_consensus.cc:2393] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:28.947062  9892 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:29.116776  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:29.105050  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:29.106549  9896 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.103523  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:29.114544  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.117903  9682 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.118566  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.086995  9751 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:29.081535  9820 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.079716  9869 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.123698  9863 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:29.105876  9708 consensus_meta.cc:287] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.000s
I20260709 13:16:29.104148  9702 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.128026  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:29.165432  8216 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:29.128578  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.166772  8928 raft_consensus.cc:2368] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4.
I20260709 13:16:29.108422  9795 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.124305  9814 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:28.917141  9810 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.132640  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.081148  9643 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:29.134769  8332 connection.cc:256] RPC call timeout handler was delayed by -1.9467804940002225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20260709 13:16:29.134203  8925 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:29.170928  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:29.141070  9870 consensus_meta.cc:287] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.889s	user 0.011s	sys 0.000s
I20260709 13:16:29.141005  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.141342  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.131289  9892 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.091955  9900 consensus_queue.cc:1059] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:29.104219  9832 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.105875  9771 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.168417  8215 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:16:29.171950  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:29.174739  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:29.130054  9865 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.187647  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.156554  8286 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:29.187769  9875 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.165089  8921 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:29.174244  8919 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:29.202047  9904 log.cc:927] Time spent T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:16:29.191097  9821 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:29.134384  9826 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.191802  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:29.207572  8218 raft_consensus.cc:2368] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:29.135241  9867 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.196494  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.197053  8927 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.198640  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:29.210899  8294 raft_consensus.cc:2368] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3.
I20260709 13:16:29.201217  9863 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.192325  9702 raft_consensus.cc:476] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:29.166667  9708 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.173399  9812 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:29.206555  8287 raft_consensus.cc:2410] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:29.202558  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:29.289624  8892 leader_election.cc:336] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.684s (SENT)
W20260709 13:16:29.353543  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 143354us
W20260709 13:16:29.167866  9905 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:29.207404  8924 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:29.190079  9870 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.194888  9820 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:16:29.389055  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.205463  9675 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:29.387465  8219 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:16:29.206394  9825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.416s	user 0.026s	sys 0.035s
I20260709 13:16:29.207139  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.206233  9821 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:29.204169  9886 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.406778  8294 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:29.540330  9833 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:29.566773  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.567565  8294 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.388630  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:29.352846  9894 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.352494  9869 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.541574  8928 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:29.544330  9868 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.388232  9687 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.409435  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.422762  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 414) took 1038 ms. Trace:
I20260709 13:16:29.211637  9881 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.385597  9643 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.165s
I20260709 13:16:29.553077  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 194) took 1299 ms. Trace:
I20260709 13:16:29.585246  9821 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:29.544109  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 195141us
I20260709 13:16:29.406266  9812 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:29.628929  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 339347us
I20260709 13:16:29.630712  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1262) took 1435 ms. Trace:
I20260709 13:16:29.630568  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.654156  8290 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:29.564721  9825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.819s	user 0.032s	sys 0.039s
W20260709 13:16:29.639196  9913 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:16:29.631454  9869 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.424777  9822 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.553915  9827 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.379375  9900 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.187s
I20260709 13:16:29.653877  8368 rpcz_store.cc:276] 0709 13:16:28.195630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.632987 (+437357us) service_pool.cc:224] Handling call
0709 13:16:28.637595 (+  4608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.801957 (+164362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:28.802003 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:28.804289 (+  2286us) log.cc:844] Serialized 26 byte log entry
0709 13:16:28.878792 (+ 74503us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:28.878834 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.878903 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.630500 (+751597us) raft_consensus.cc:1685] finished
0709 13:16:29.630518 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.630651 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80352,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":211941,"threads_started":2,"wal-append.queue_time_us":148378}
I20260709 13:16:29.637152  9780 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:29.632079  9687 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:29.662624  8286 raft_consensus.cc:2368] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4.
W20260709 13:16:29.659565  9779 consensus_meta.cc:287] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 1.445s	user 0.010s	sys 0.005s
I20260709 13:16:29.661710  9812 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:29.655987  9856 consensus_meta.cc:287] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.263s	user 0.009s	sys 0.002s
I20260709 13:16:29.659271  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:29.652592  9880 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:29.657259  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:29.658285  9897 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.664541  9873 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.691119  8290 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
W20260709 13:16:29.691609  8290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 198) took 1437 ms (client timeout 1892 ms). Trace:
I20260709 13:16:29.684295  9880 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.679983  9856 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.669909  9810 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.639717  8924 rpcz_store.cc:276] 0709 13:16:28.369915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.373938 (+  4023us) service_pool.cc:224] Handling call
0709 13:16:29.140821 (+766883us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:29.408728 (+267907us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10080000}
I20260709 13:16:29.685636  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 202) took 1427 ms. Trace:
I20260709 13:16:29.680392  9832 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.671454  9867 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.703130  8927 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:29.706228  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:29.691921  8290 rpcz_store.cc:269] 0709 13:16:28.254674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.255229 (+   555us) service_pool.cc:224] Handling call
0709 13:16:29.630410 (+1375181us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:29.691566 (+ 61156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28933888}
I20260709 13:16:29.707540  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:29.709900  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:29.710405  8217 raft_consensus.cc:2376] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:16:29.700471  8211 raft_consensus.cc:2393] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:29.711597  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.712913  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:29.713562  8293 raft_consensus.cc:606] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:29.713953  8293 raft_consensus.cc:614] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:29.715183  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.715919  8290 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:29.687700  9857 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.698364  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.696560  9875 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.701663  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:29.698297  9869 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.719830  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:29.700896  9826 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.696326  9771 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.706079  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.722139  8921 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.722357  9708 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:29.677623  9779 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.700441  9856 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.702099  8291 rpcz_store.cc:276] 0709 13:16:28.258082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.001595 (+743513us) service_pool.cc:224] Handling call
0709 13:16:29.070480 (+ 68885us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.114760 (+ 44280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.116928 (+  2168us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.168952 (+ 52024us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.640985 (+472033us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:29.643874 (+  2889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.651946 (+  8072us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.668815 (+ 16869us) raft_consensus.cc:1685] finished
0709 13:16:29.672033 (+  3218us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.684620 (+ 12587us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23075,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6563,"thread_start_us":352646,"threads_started":1,"wal-append.queue_time_us":473996}
W20260709 13:16:29.727952  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 338473us
I20260709 13:16:29.698468  9897 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.692226  9873 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.735942  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:29.692809  9687 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.738480  8290 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:16:29.735013  9842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.020s	sys 0.017s
I20260709 13:16:29.735525  9780 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:29.747733  8368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:29.748495  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 203) took 1487 ms. Trace:
I20260709 13:16:29.748944  8368 raft_consensus.cc:606] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:29.748910  8290 rpcz_store.cc:276] 0709 13:16:28.258341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.729637 (+1471296us) service_pool.cc:224] Handling call
0709 13:16:29.738195 (+  8558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.745469 (+  7274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.745741 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.750180  8291 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:29.750559  9887 raft_consensus.cc:3055] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:29.750926  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 208) took 1391 ms. Trace:
I20260709 13:16:29.751036  9887 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:29.747226  8286 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 2: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:29.752099  9887 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.753671  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 211) took 1311 ms. Trace:
I20260709 13:16:29.753816  9887 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.754325  9855 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.756083  9873 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.756351  9675 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.740381  9875 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:29.743834  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:29.758913  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.759042  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.759253  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.762310  8363 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.762444  8366 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.645607  8288 rpcz_store.cc:276] 0709 13:16:28.253445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.266515 (+ 13070us) service_pool.cc:224] Handling call
0709 13:16:29.202473 (+935958us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:29.204094 (+  1621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.388144 (+184050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.406028 (+ 17884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.443673 (+ 37645us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:29.540139 (+ 96466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.544113 (+  3974us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.550371 (+  6258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3267,"raft.queue_time_us":31810,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":35688,"spinlock_wait_cycles":8376192}
W20260709 13:16:29.748344  9842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.020s	sys 0.018s
I20260709 13:16:29.751478  8291 rpcz_store.cc:276] 0709 13:16:28.359740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.748486 (+1388746us) service_pool.cc:224] Handling call
0709 13:16:29.749971 (+  1485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.750638 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.750865 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.759311  9856 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:29.767099  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 417) took 1323 ms. Trace:
I20260709 13:16:29.749403  8368 raft_consensus.cc:614] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:29.780491  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.768095  8363 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:29.769505  8360 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:29.756879  9675 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.769620  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.769857  8365 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:29.770052  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.770216  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.770632  8919 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:29.770551  9897 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:29.788203  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.771857  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.772205  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:29.773952  8295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 210) took 1350 ms (client timeout 1549 ms). Trace:
W20260709 13:16:29.774773  9892 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.000s
I20260709 13:16:29.774889  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1677) took 2664 ms. Trace:
W20260709 13:16:29.791874  8295 rpcz_store.cc:269] 0709 13:16:28.424015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.430758 (+  6743us) service_pool.cc:224] Handling call
0709 13:16:29.773779 (+1343021us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54001270d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:29.773899 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497346432}
I20260709 13:16:29.776252  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.760677  9780 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.760430  9687 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.780376  8926 rpcz_store.cc:276] 0709 13:16:28.444166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.444277 (+   111us) service_pool.cc:224] Handling call
0709 13:16:29.173603 (+729326us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:29.173863 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.192388 (+ 18525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.192442 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.196009 (+  3567us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.496667 (+300658us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:29.496732 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.496855 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:29.756621 (+259766us) raft_consensus.cc:1685] finished
0709 13:16:29.756644 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.767031 (+ 10387us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14986,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3528,"spinlock_wait_cycles":12335488,"thread_start_us":286170,"threads_started":1,"wal-append.queue_time_us":466141}
I20260709 13:16:29.786866  9771 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.783079  9856 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.787516  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:29.754086  8286 rpcz_store.cc:276] 0709 13:16:28.442296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.752832 (+1310536us) service_pool.cc:224] Handling call
0709 13:16:29.753137 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.753309 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.753348 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:29.753397 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:29.753438 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.753506 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:29.753616 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.790875  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.796916  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.797272  9779 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.797015  9771 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:29.811409  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.811987  8362 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.813141  9771 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:29.813179  8921 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:29.814270  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.814636  9856 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.815742  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:29.816181  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1213) took 1004 ms. Trace:
I20260709 13:16:29.815331  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.816818  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:29.817444  9880 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.817940  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:29.818111  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.818620  8216 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:29.818847  8364 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:29.819326  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:29.799045  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:29.792198  8367 rpcz_store.cc:276] 0709 13:16:27.110433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.417815 (+307382us) service_pool.cc:224] Handling call
0709 13:16:27.419309 (+  1494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:28.893621 (+1474312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.774641 (+881020us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400366ad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:29.774811 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3218504064}
I20260709 13:16:29.801081  9709 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:16:29.824167  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.824801  8367 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:29.825160  9709 tablet_bootstrap.cc:492] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:29.825886  8367 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:29.825961  9709 ts_tablet_manager.cc:1403] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 2.164s	user 0.033s	sys 0.017s
I20260709 13:16:29.802016  9895 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:29.832415  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:29.831678  8368 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:29.833914  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.834947  8368 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:29.803303  9870 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.797282  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 201) took 1539 ms. Trace:
I20260709 13:16:29.802232  9866 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:29.802389  8261 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:29.826691  9780 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.836725  9866 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:29.806468  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.809544  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.810123  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1206) took 1011 ms. Trace:
I20260709 13:16:29.810585  8288 raft_consensus.cc:2368] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:29.809458  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.820508  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:29.787678  9788 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.819344  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.826993  8367 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:29.828636  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1217) took 1008 ms. Trace:
I20260709 13:16:29.816642  8211 rpcz_store.cc:276] 0709 13:16:28.812098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.814767 (+  2669us) service_pool.cc:224] Handling call
0709 13:16:29.815969 (+1001202us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540019a354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:29.816131 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436614784}
I20260709 13:16:29.831429  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:29.832777  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.836297  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:29.803470  9811 consensus_meta.cc:287] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.854s	user 0.007s	sys 0.004s
I20260709 13:16:29.830901  8183 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:29.794834  9892 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.837574  8261 leader_election.cc:400] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5.
I20260709 13:16:29.934432  9751 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.934746  8261 leader_election.cc:403] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:29.935026  9811 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:29.935317  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 97866.5us
I20260709 13:16:29.935407  9874 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5.
I20260709 13:16:29.848964  9754 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.936808  8295 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:29.937585  9892 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:29.937703  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.939028  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.939682  8295 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:29.846437  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:29.940573  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 109214us
I20260709 13:16:29.941136  8220 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.942384  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:29.934751  8290 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:29.849295  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.943681  8364 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:29.843020  8292 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:29.839911  8294 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:29.881353  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 204) took 1622 ms. Trace:
I20260709 13:16:29.844327  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:29.940181  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 109339us
I20260709 13:16:29.946113  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:29.946784  8216 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:29.947340  8366 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:29.945058  8287 rpcz_store.cc:276] 0709 13:16:28.258610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.260137 (+  1527us) service_pool.cc:224] Handling call
0709 13:16:29.881113 (+1620976us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54001284d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:29.881281 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2171447552}
I20260709 13:16:29.948731  8360 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:29.949188  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.949762  8287 raft_consensus.cc:2376] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5. Re-sending same reply.
I20260709 13:16:29.950345  8217 raft_consensus.cc:2376] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:16:29.950870  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.952543  8926 raft_consensus.cc:2368] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
W20260709 13:16:29.875351  8922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 444) took 2262 ms (client timeout 1795 ms). Trace:
I20260709 13:16:29.947379  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:29.958916  8922 rpcz_store.cc:269] 0709 13:16:27.613224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.614283 (+  1059us) service_pool.cc:224] Handling call
0709 13:16:29.874940 (+2260657us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002c29d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:29.875259 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2735050112}
I20260709 13:16:29.959388  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.938647  9895 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.967322  8290 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:29.968576  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.969316  8290 raft_consensus.cc:2376] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:16:29.969475  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.970387  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.961064  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.971316  8287 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.962395  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.972816  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:29.943681  8215 rpcz_store.cc:276] 0709 13:16:28.820311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.903520 (+ 83209us) service_pool.cc:224] Handling call
0709 13:16:28.903835 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.195071 (+291236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.828441 (+633370us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54001b1f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:29.828588 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607943552}
I20260709 13:16:29.973563  8217 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:29.974406  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.819329  9880 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:29.976343  8183 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:29.970619  8295 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:29.956804  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:29.944567  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.977233  8183 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:29.977689  8292 raft_consensus.cc:2410] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:29.959762  8294 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:29.976671  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:29.979219  8367 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:29.975637  8366 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:29.968019  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.977969  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:29.953270  9780 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.994038  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.955966  9892 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:29.875967  9687 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.845216  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:29.997417  8363 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:29.877588  9883 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:29.852269  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:30.002207  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 49776.2us
I20260709 13:16:29.994956  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.835826  8289 rpcz_store.cc:276] 0709 13:16:28.257822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.342840 (+ 85018us) service_pool.cc:224] Handling call
0709 13:16:28.343225 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:28.649698 (+306473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.797021 (+1147323us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54001004d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:29.797223 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660136832}
I20260709 13:16:30.040710  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:29.877039  9821 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.960219  9779 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:30.039258  8367 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:30.039809  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:29.888315  9855 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:29.955435  8291 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:30.090068  8364 raft_consensus.cc:3055] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:29.994247  8369 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:29.930573  9675 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.095510  8287 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:30.041982  8220 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:30.046168  8363 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:30.015261  8365 raft_consensus.cc:2410] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:30.058599  8294 raft_consensus.cc:2393] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:30.002548  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:29.995088  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.106325  8360 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:30.105580  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:30.106912  8220 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:30.091192  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 113300us
I20260709 13:16:30.091387  8364 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:30.013078  8290 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.107540  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:29.953624  9874 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:16:30.016265  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.093614  8921 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:30.093525  9880 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:29.965955  9709 raft_consensus.cc:359] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.995638  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:30.114645  8220 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:30.096522  8368 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:30.065765  9892 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:30.099694  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 244690us
I20260709 13:16:30.117311  8290 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:30.118207  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:30.118539  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 116109us
I20260709 13:16:30.118819  8290 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:30.100162  8362 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:30.093444  8925 raft_consensus.cc:2368] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:30.123375  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:30.123723  9788 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:30.124162  8925 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:30.124979  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:30.125160  9788 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:30.125442  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:30.126344  8919 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:30.126535  8925 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:30.104198  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.127022  8925 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:30.127494  8919 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:30.128249  8923 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:30.128371  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:30.015657  9869 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:30.129107  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1208) took 1329 ms. Trace:
I20260709 13:16:30.129189  9869 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:30.116012  9855 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:30.129453  8213 rpcz_store.cc:276] 0709 13:16:28.799704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.809244 (+  9540us) service_pool.cc:224] Handling call
0709 13:16:30.128238 (+1318994us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:30.129057 (+   819us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5878016}
I20260709 13:16:30.130585  9855 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.131271  8217 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:30.131456  9869 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:30.101256  9811 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:30.112386  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:30.056876  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:30.111896  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.015942  9751 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:29.940313  8214 rpcz_store.cc:276] 0709 13:16:28.799033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.800045 (+  1012us) service_pool.cc:224] Handling call
0709 13:16:29.772099 (+972054us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:29.810065 (+ 37966us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29369216}
I20260709 13:16:30.132601  8288 raft_consensus.cc:2376] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:16:30.133213  9751 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:30.133376  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.133807  8288 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:30.134259  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1109) took 1003 ms. Trace:
I20260709 13:16:30.108596  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:30.134716  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:30.132694  8292 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:30.114234  8261 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:30.096118  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:30.135500  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1110) took 1002 ms. Trace:
I20260709 13:16:30.135633  8291 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.137156  8212 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:30.137681  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1104) took 1039 ms. Trace:
I20260709 13:16:30.138000  8212 rpcz_store.cc:276] 0709 13:16:29.098026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.730250 (+632224us) service_pool.cc:224] Handling call
0709 13:16:30.137624 (+407374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.139348  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1212) took 1327 ms. Trace:
I20260709 13:16:30.139597  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1221) took 1104 ms. Trace:
I20260709 13:16:30.139704  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.097465  9675 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:30.115592  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.105580  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:30.119508  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:30.117739  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:30.126605  9865 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:30.134414  9751 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.042662  9687 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:29.844235  9866 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.130599  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.135836  8215 rpcz_store.cc:276] 0709 13:16:29.133378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.975182 (+841804us) service_pool.cc:224] Handling call
0709 13:16:30.134583 (+159401us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:30.135449 (+   866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5640064}
I20260709 13:16:30.145212  8183 leader_election.cc:400] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
W20260709 13:16:30.180341  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 66173.4us
I20260709 13:16:30.457504  8183 leader_election.cc:403] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:30.151643  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:30.180745  8287 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:30.042130  9883 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:30.133450  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:30.111936  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1102) took 1018 ms. Trace:
I20260709 13:16:30.071938  8286 raft_consensus.cc:2376] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5. Re-sending same reply.
I20260709 13:16:30.144626  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:30.119598  8290 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:16:30.468743  8290 raft_consensus.cc:606] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:30.469121  8290 raft_consensus.cc:614] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:30.188572  8293 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:30.469955  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1134) took 1345 ms. Trace:
I20260709 13:16:30.470311  8293 rpcz_store.cc:276] 0709 13:16:29.124807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.145779 (+1020972us) service_pool.cc:224] Handling call
0709 13:16:30.146186 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.469681 (+323495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.469899 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.980569  9895 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.186795  8364 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.471395  8364 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:16:30.190272  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 70795.6us
I20260709 13:16:30.135142  8922 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:30.192061  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.112434  9880 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:30.196831  8289 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:30.139997  8212 rpcz_store.cc:276] 0709 13:16:29.035531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.138809 (+1103278us) service_pool.cc:224] Handling call
0709 13:16:30.139110 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.139282 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.139308 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.139349 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:30.139387 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.139451 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.139550 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.198689  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:30.134481  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1131) took 1017 ms. Trace:
I20260709 13:16:30.144500  9893 raft_consensus.cc:2764] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:30.200121  8291 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:30.200238  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:30.191630  9754 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:30.202129  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.205499  8332 leader_election.cc:400] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4.
I20260709 13:16:30.198096  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1222) took 1123 ms. Trace:
I20260709 13:16:30.199643  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:30.199623  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:30.380707  9865 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:30.381168  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.203655  8116 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 3 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.382522  9709 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:30.383490  9866 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.386498  8213 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:30.313079  8925 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:30.390676  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.376504  9892 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.413547  8362 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:30.204496  9869 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:30.140465  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:30.198072  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.139714  8219 rpcz_store.cc:276] 0709 13:16:28.811755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:28.811876 (+   121us) service_pool.cc:224] Handling call
0709 13:16:28.827586 (+ 15710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.406841 (+579255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.139134 (+732293us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54002f4754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:30.139296 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287061248}
I20260709 13:16:30.174237  8211 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.450517  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 449) took 1266 ms. Trace:
I20260709 13:16:30.134690  8214 rpcz_store.cc:276] 0709 13:16:29.131319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.133098 (+1001779us) service_pool.cc:224] Handling call
0709 13:16:30.134198 (+  1100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.459205  8287 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:30.460388  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.466084  8216 rpcz_store.cc:276] 0709 13:16:29.093682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.953778 (+860096us) service_pool.cc:224] Handling call
0709 13:16:30.111873 (+158095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202624}
I20260709 13:16:30.467690  9883 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:30.714711  8892 leader_election.cc:336] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.601s (SENT)
I20260709 13:16:30.569624  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.843926  8261 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:30.578574  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.842437  8332 leader_election.cc:403] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:16:30.497936  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 352879us
I20260709 13:16:30.843127  8218 rpcz_store.cc:276] 0709 13:16:29.074768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.116476 (+ 41708us) service_pool.cc:224] Handling call
0709 13:16:30.197902 (+1081426us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b5400379bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:30.198037 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180657408}
I20260709 13:16:30.621938  8364 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:30.846067  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1620) took 1080 ms. Trace:
I20260709 13:16:30.842882  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:30.846364  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.847245  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1097) took 1764 ms. Trace:
I20260709 13:16:30.847678  8218 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:30.848400  8294 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:30.849071  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.846591  8287 rpcz_store.cc:276] 0709 13:16:29.765468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.458552 (+693084us) service_pool.cc:224] Handling call
0709 13:16:30.458863 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.845759 (+386896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.846016 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.568919  8293 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:30.850333  8218 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 2: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:30.593245  8114 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 186) took 4293 ms. Trace:
W20260709 13:16:30.844905  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.569360  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.471664  8215 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:30.847010  8363 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:30.845623  8183 leader_election.cc:400] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:30.850149  8928 rpcz_store.cc:276] 0709 13:16:29.184133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.186834 (+  2701us) service_pool.cc:224] Handling call
0709 13:16:29.187165 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.585490 (+398325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.450250 (+864760us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400214b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:30.450460 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544193280}
I20260709 13:16:30.852018  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1098) took 1766 ms. Trace:
I20260709 13:16:30.852713  8215 rpcz_store.cc:276] 0709 13:16:29.085449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.311542 (+1226093us) service_pool.cc:224] Handling call
0709 13:16:30.471494 (+159952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.851812 (+380318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.851970 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.851212  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1622) took 1085 ms. Trace:
I20260709 13:16:30.854835  8293 rpcz_store.cc:276] 0709 13:16:29.765773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.568265 (+802492us) service_pool.cc:224] Handling call
0709 13:16:30.568629 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.850951 (+282322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.851148 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.847685  8213 rpcz_store.cc:276] 0709 13:16:29.083323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.210789 (+1127466us) service_pool.cc:224] Handling call
0709 13:16:30.386082 (+175293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.846997 (+460915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.847197 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.849506  8116 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 3 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.852238  8183 leader_election.cc:403] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:16:30.665980  9688 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.031s	sys 0.080s
W20260709 13:16:30.572136  9923 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 13:16:30.858242  8287 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:30.858731  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1624) took 1092 ms. Trace:
I20260709 13:16:30.555547  8186 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:30.859273  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:30.458775  9687 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:30.830286  9855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.028s	sys 0.061s
I20260709 13:16:30.862311  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.860845  8116 catalog_manager.cc:5697] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:30.857661  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.864943  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1631) took 1072 ms. Trace:
I20260709 13:16:30.450826  9810 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:30.859956  9688 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.035s	sys 0.096s
I20260709 13:16:30.554569  9675 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.333s
I20260709 13:16:30.867347  8920 raft_consensus.cc:2368] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:30.859859  9863 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:16:30.868086  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.580621  9875 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:30.898272  8287 rpcz_store.cc:276] 0709 13:16:29.792335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.857827 (+1065492us) service_pool.cc:224] Handling call
0709 13:16:30.858095 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.864722 (+  6627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.864893 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.512771  9811 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:30.897202  9855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.029s	sys 0.061s
I20260709 13:16:30.932677  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 220) took 1037 ms. Trace:
I20260709 13:16:30.868068  9869 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:30.884353  8294 rpcz_store.cc:276] 0709 13:16:29.766074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.858117 (+1092043us) service_pool.cc:224] Handling call
0709 13:16:30.858331 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.858438 (+   107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.858453 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.858478 (+    25us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:30.858496 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.858527 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.858666 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.868662  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:30.941491  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 72891.6us
I20260709 13:16:30.927513  8361 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:30.513164  9857 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:30.873781  9821 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:30.851220  9880 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:30.898169  8116 catalog_manager.cc:5697] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 3 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.554872  9874 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.344s
I20260709 13:16:30.928653  8293 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:30.964455  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1632) took 1163 ms. Trace:
I20260709 13:16:30.964999  8293 rpcz_store.cc:276] 0709 13:16:29.801507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.859138 (+1057631us) service_pool.cc:224] Handling call
0709 13:16:30.921024 (+ 61886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.964172 (+ 43148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.964396 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.929246  8219 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:30.930095  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.966857  8217 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:30.931270  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 461) took 1272 ms. Trace:
I20260709 13:16:30.843670  8288 rpcz_store.cc:276] 0709 13:16:29.116977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.133352 (+1016375us) service_pool.cc:224] Handling call
0709 13:16:30.133638 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.134248 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.134426 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.933204  8287 rpcz_store.cc:276] 0709 13:16:29.895570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.929316 (+1033746us) service_pool.cc:224] Handling call
0709 13:16:30.929606 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.932215 (+  2609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.932257 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.932314 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:30.932358 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.932442 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.932607 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2281}
W20260709 13:16:30.476500  9886 consensus_queue.cc:1175] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
I20260709 13:16:30.929641  9709 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:30.937340  8920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 447) took 1761 ms (client timeout 1542 ms). Trace:
I20260709 13:16:30.925774  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1621) took 1160 ms. Trace:
I20260709 13:16:30.865337  8925 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.900544  9827 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:30.972694  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:30.992395  9827 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:30.897064  9895 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:30.993330  8211 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:30.993507  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:30.994078  9895 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.994287  8211 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1223) took 1881 ms (client timeout 2132 ms). Trace:
I20260709 13:16:30.994658  9895 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.995667  9709 ts_tablet_manager.cc:1434] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 1.169s	user 0.015s	sys 0.017s
I20260709 13:16:30.903142  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:30.996133  9709 ts_tablet_manager.cc:1467] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Tablet startup took 1169ms
I20260709 13:16:30.899508  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1617) took 1104 ms. Trace:
I20260709 13:16:30.927104  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:30.951578  9863 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:16:30.964736  8116 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.944128  9869 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.943956  9811 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:30.925431  9810 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:30.975389  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:30.956267  9687 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:30.977694  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:30.972512  9930 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:16:30.958271  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:30.978590  8286 rpcz_store.cc:276] 0709 13:16:29.765614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.468331 (+702717us) service_pool.cc:224] Handling call
0709 13:16:30.468869 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.536277 (+ 67408us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:30.566353 (+ 30076us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.848629 (+282276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.853187 (+  4558us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:30.863814 (+ 10627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.867864 (+  4050us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.905672 (+ 37808us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3123,"prepare.queue_time_us":15707,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":2044,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":3772,"spinlock_wait_cycles":20608,"thread_start_us":255728,"threads_started":1}
I20260709 13:16:31.021442  9810 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:30.942929  9875 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:31.002303  9869 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.853475  9754 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:30.863027  9865 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:30.971760  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59420 (request call id 173) took 1207 ms. Trace:
I20260709 13:16:30.993439  9827 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:30.991806  8925 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:16:30.851186  8114 rpcz_store.cc:276] 0709 13:16:26.300435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.300794 (+   359us) service_pool.cc:224] Handling call
0709 13:16:30.593113 (+4292319us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:28.174613 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:28.212221 (+ 37608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:28.241143 (+ 28922us) write_op.cc:435] Acquired schema lock
0709 13:16:28.256493 (+ 15350us) tablet.cc:662] Decoding operations
0709 13:16:28.500805 (+244312us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:28.515548 (+ 14743us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:28.525533 (+  9985us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:16:28.556648 (+ 31115us) tablet.cc:701] Row locks acquired
0709 13:16:28.556685 (+    37us) write_op.cc:260] PREPARE: finished
0709 13:16:28.556865 (+   180us) write_op.cc:270] Start()
0709 13:16:28.584776 (+ 27911us) write_op.cc:276] Timestamp: P: 1783602988556800 usec, L: 0
0709 13:16:28.584824 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:16:28.620083 (+ 35259us) log.cc:844] Serialized 2412 byte log entry
0709 13:16:29.110218 (+490135us) op_driver.cc:464] REPLICATION: finished
0709 13:16:29.584814 (+474596us) write_op.cc:301] APPLY: starting
0709 13:16:29.631374 (+ 46560us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:29.638703 (+  7329us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:29.638890 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:29.652279 (+ 13389us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:29.653428 (+  1149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:16:29.653479 (+    51us) write_op.cc:312] APPLY: finished
0709 13:16:29.682416 (+ 28937us) log.cc:844] Serialized 53 byte log entry
0709 13:16:29.709147 (+ 26731us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:29.717912 (+  8765us) write_op.cc:454] Released schema lock
0709 13:16:29.724601 (+  6689us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:29.744662 (+ 20061us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:29.745497 (+   835us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57347,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":433156,"apply.run_cpu_time_us":4403,"apply.run_wall_time_us":178650,"num_ops":6,"prepare.queue_time_us":544482,"prepare.run_cpu_time_us":27463,"prepare.run_wall_time_us":640522,"raft.queue_time_us":188108,"raft.run_cpu_time_us":37091,"raft.run_wall_time_us":86284,"replication_time_us":525193,"thread_start_us":902181,"threads_started":4,"wal-append.queue_time_us":271772,"wal-append.run_cpu_time_us":17597,"wal-append.run_wall_time_us":1852903}]]}
I20260709 13:16:30.975935  9821 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4.
I20260709 13:16:31.005312  8217 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:31.007541  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1132) took 1890 ms. Trace:
I20260709 13:16:31.014125  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:31.017268  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:31.017771  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1099) took 1931 ms. Trace:
I20260709 13:16:30.969431  8924 rpcz_store.cc:276] 0709 13:16:29.658828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.767591 (+108763us) service_pool.cc:224] Handling call
0709 13:16:29.771292 (+  3701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.771730 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.771768 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.795308 (+ 23540us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.102310 (+307002us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:30.102482 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.102620 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.569283 (+466663us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:30.867806 (+298523us) raft_consensus.cc:1685] finished
0709 13:16:30.867823 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.931172 (+ 63349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":548,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":14497024,"thread_start_us":240615,"threads_started":1,"wal-append.queue_time_us":399502}
W20260709 13:16:30.994850  8211 rpcz_store.cc:269] 0709 13:16:29.113323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.958028 (+844705us) service_pool.cc:224] Handling call
0709 13:16:30.994217 (+1036189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:30.976501  8920 rpcz_store.cc:269] 0709 13:16:29.175947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.181578 (+  5631us) service_pool.cc:224] Handling call
0709 13:16:30.200079 (+1018501us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:30.937246 (+737167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4416256}
I20260709 13:16:31.041738  8219 rpcz_store.cc:276] 0709 13:16:29.086435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.007170 (+1920735us) service_pool.cc:224] Handling call
0709 13:16:31.017235 (+ 10065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.017433 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.017461 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.017509 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:31.017540 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.017596 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.017711 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.040161  8292 rpcz_store.cc:276] 0709 13:16:29.117626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.135606 (+1017980us) service_pool.cc:224] Handling call
0709 13:16:30.135910 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.136256 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.136287 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.136765 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.193687 (+ 56922us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:30.193746 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.193828 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.007271 (+813443us) raft_consensus.cc:1685] finished
0709 13:16:31.007300 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.007469 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32977,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":92612,"thread_start_us":56538,"threads_started":1,"wal-append.queue_time_us":541397}
I20260709 13:16:31.041559  8364 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:31.056437  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 583491us
I20260709 13:16:31.001194  8116 catalog_manager.cc:5697] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:16:31.081444  8116 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 3, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 3 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.022912  9687 raft_consensus.cc:697] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:31.038209  8925 pending_rounds.cc:85] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 4
I20260709 13:16:30.994375  8365 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:31.030802  9895 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:31.091064  9682 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:31.091269  9875 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:30.999485  8289 rpcz_store.cc:276] 0709 13:16:29.765012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.195600 (+430588us) service_pool.cc:224] Handling call
0709 13:16:30.196223 (+   623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.850946 (+654723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.869212 (+ 18266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.092553  8212 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:31.093297  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1100) took 2003 ms. Trace:
I20260709 13:16:31.093706  8212 rpcz_store.cc:276] 0709 13:16:29.089980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.050166 (+1960186us) service_pool.cc:224] Handling call
0709 13:16:31.092347 (+ 42181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.093006 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.093231 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.094705  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:31.095360  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 183) took 1983 ms. Trace:
I20260709 13:16:31.087257  8925 pending_rounds.cc:107] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:31.021479  9880 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:31.096306  8925 raft_consensus.cc:2889] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:31.097059  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 422) took 1155 ms. Trace:
I20260709 13:16:31.097116  9811 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:31.088225  9938 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:31.091596  9682 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.093299  8213 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:31.102538  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1105) took 2003 ms. Trace:
I20260709 13:16:31.102991  8213 rpcz_store.cc:276] 0709 13:16:29.099486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.092742 (+1993256us) service_pool.cc:224] Handling call
0709 13:16:31.093102 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.102246 (+  9144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.102474 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.083776  8116 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:16:31.098753  8360 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:31.040571  8362 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:31.107805  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 223) took 1211 ms. Trace:
I20260709 13:16:31.046002  8361 rpcz_store.cc:276] 0709 13:16:29.762957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.796676 (+ 33719us) service_pool.cc:224] Handling call
0709 13:16:30.140324 (+343648us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:30.970350 (+830026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429184}
I20260709 13:16:31.107173  9754 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.118017  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:31.097481  8925 rpcz_store.cc:276] 0709 13:16:29.942113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.126135 (+184022us) service_pool.cc:224] Handling call
0709 13:16:30.126412 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.096811 (+970399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.097003 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.119903  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:31.120378  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 564896us
I20260709 13:16:31.108599  8116 catalog_manager.cc:5697] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.107107  9682 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.111491  8294 rpcz_store.cc:276] 0709 13:16:29.896562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.941374 (+1044812us) service_pool.cc:224] Handling call
0709 13:16:30.943078 (+  1704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.107262 (+164184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.107293 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.107339 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:31.107368 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.107443 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.107739 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8230,"raft.queue_time_us":45654,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":148363,"threads_started":1}
I20260709 13:16:31.128018  9938 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:31.129725  8116 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:31.098069  9880 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:31.134411  8116 catalog_manager.cc:5697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
W20260709 13:16:31.137064  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 267619us
I20260709 13:16:31.139071  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 184) took 2013 ms. Trace:
I20260709 13:16:31.139562  8213 rpcz_store.cc:276] 0709 13:16:29.125588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.118211 (+1992623us) service_pool.cc:224] Handling call
0709 13:16:31.138536 (+ 20325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.138704 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.138728 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.138770 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:31.138814 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.138885 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.139007 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.141737  8186 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:31.136495  9865 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:31.154819  8219 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:31.155203  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 949857us
I20260709 13:16:31.138336  9938 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:31.095784  8212 rpcz_store.cc:276] 0709 13:16:29.111808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.094580 (+1982772us) service_pool.cc:224] Handling call
0709 13:16:31.094849 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.095022 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.095050 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.095094 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:31.095126 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.095184 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.095305 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.158253  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 181) took 2064 ms. Trace:
I20260709 13:16:31.157194  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:31.163509  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.170182  8290 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.163897  8219 rpcz_store.cc:276] 0709 13:16:29.094052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.085911 (+1991859us) service_pool.cc:224] Handling call
0709 13:16:31.154456 (+ 68545us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:31.154652 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.157937 (+  3285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.158182 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21795712}
I20260709 13:16:31.165599  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:31.158715  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 444018us
I20260709 13:16:31.167292  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:31.175627  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.175916  8294 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.182111  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.182670  8287 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:31.164326  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:31.180307  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 334772us
I20260709 13:16:31.185032  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:31.191534  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 110937us
W20260709 13:16:31.194137  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.199717  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:31.214708  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:31.216218  8290 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:31.148095  9687 consensus_queue.cc:237] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.156165  9937 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:31.241750  8219 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:31.245462  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1224) took 1391 ms. Trace:
I20260709 13:16:31.245807  8219 rpcz_store.cc:276] 0709 13:16:29.854395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.181294 (+1326899us) service_pool.cc:224] Handling call
0709 13:16:31.241429 (+ 60135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.245179 (+  3750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.245400 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.246387  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 194) took 1588 ms. Trace:
I20260709 13:16:31.242695  9874 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:31.246825  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.246857  8215 rpcz_store.cc:276] 0709 13:16:29.658398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.152335 (+1493937us) service_pool.cc:224] Handling call
0709 13:16:31.160850 (+  8515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.246078 (+ 85228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.246110 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.246152 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:31.246180 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.246240 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.246336 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20095,"thread_start_us":64784,"threads_started":1}
I20260709 13:16:31.249487  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.250272  8219 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:31.249994  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:31.252240  8219 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:31.239980  8294 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:31.224996  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:31.242231  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.198897  9880 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:31.205441  9875 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.195597  9946 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:31.265633  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 79720.3us
I20260709 13:16:31.267980  8292 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:16:31.268137  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.227052  9866 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:31.255113  9832 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:31.278613  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.281517  8292 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:31.280121  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 86901.6us
I20260709 13:16:31.286324  8287 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:31.295539  8290 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:31.265154  9880 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.205670  9863 consensus_queue.cc:1059] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 13:16:31.289450  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 74821.6us
I20260709 13:16:31.275978  9874 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:31.290987  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 148347us
I20260709 13:16:31.218128  9682 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.292992  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:31.205529  9865 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:16:31.288407  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 185) took 2161 ms. Trace:
I20260709 13:16:31.206404  9947 consensus_queue.cc:1059] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:16:31.264106  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:31.306118  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:31.311308  8292 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:31.335667  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:31.313830  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:31.314213  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:31.275765  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:31.278721  9866 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.337059  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:31.321918  8213 rpcz_store.cc:276] 0709 13:16:29.126712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.140692 (+2013980us) service_pool.cc:224] Handling call
0709 13:16:31.146593 (+  5901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.287957 (+141364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.287989 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.288066 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:31.288105 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.288178 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.288342 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":145707,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":14839,"thread_start_us":140941,"threads_started":1}
I20260709 13:16:31.332690  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.289258  9946 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.338052  8258 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:31.338758  8287 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:31.333457  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:31.334828  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.290481  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:31.303185  8212 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:31.292793  8289 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:31.349898  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:31.328397  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48426.2us
I20260709 13:16:31.276537  9875 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.315112  9880 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:31.313036  9821 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:31.352408  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46385us
I20260709 13:16:31.350865  9946 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.358068  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.278959  9937 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:16:31.362947  8892 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:31.280937  9939 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:16:31.364313  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.313139  9956 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:31.366914  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 52789.3us
I20260709 13:16:31.318534  9943 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.369599  8216 raft_consensus.cc:2393] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:16:30.996572  9709 ts_tablet_manager.cc:1469] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Trace:
0709 13:16:21.896160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.900730 (+  4570us) service_pool.cc:224] Handling call
0709 13:16:22.399577 (+498847us) ts_tablet_manager.cc:934] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
0709 13:16:25.017022 (+2617445us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:25.497558 (+480536us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:25.527109 (+ 29551us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:26.078529 (+551420us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:26.078857 (+   328us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:26.079184 (+   327us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:26.079301 (+   117us) inbound_call.cc:177] Queueing success response
0709 13:16:27.661853 (+1582552us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:16:29.826396 (+2164543us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:16:29.931229 (+104833us) tablet_replica.cc:261] Starting instrumentation
0709 13:16:29.931975 (+   746us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":13177,"mutex_wait_us":6606,"tablet-copy.queue_time_us":396765,"tablet-download-pool.queue_time_us":78899,"tablet-download-pool.run_cpu_time_us":1663,"tablet-download-pool.run_wall_time_us":536326,"thread_start_us":233367,"threads_started":2}
I20260709 13:16:31.358676  9886 raft_consensus.cc:3055] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:31.365461  9810 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:31.396994  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 127137us
I20260709 13:16:31.413800  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:31.415057  8332 leader_election.cc:400] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3.
I20260709 13:16:31.370136  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.419876  8186 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:31.346818  9866 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:31.363713  9945 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:16:31.358968  9947 raft_consensus.cc:3055] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.349598  9863 raft_consensus.cc:2764] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:31.458029  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.458175  8332 leader_election.cc:403] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:16:31.457964  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 120003us
I20260709 13:16:31.370404  9892 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.331969  9874 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:31.461069  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 98757.3us
W20260709 13:16:31.464720  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 131345us
W20260709 13:16:31.463230  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 48396.2us
I20260709 13:16:31.466071  8292 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:31.467216  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:31.450042  9956 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:31.472476  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:31.472958  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:31.473567  8292 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:31.473862  8332 leader_election.cc:400] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4.
I20260709 13:16:31.474334  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:31.475339  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.475937  8292 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:31.459915  9810 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.480093  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:31.482894  8183 leader_election.cc:400] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:31.477804  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:31.483300  8183 leader_election.cc:403] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:16:31.483621  8889 connection.cc:256] RPC call timeout handler was delayed by -1.2035697699998309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:16:31.480970  8292 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:31.456259  9886 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:31.485778  9937 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:31.451579  9821 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.465557  9811 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3.
I20260709 13:16:31.478734  9754 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:31.462164  9947 raft_consensus.cc:740] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:31.464852  9892 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:31.455711  9967 consensus_queue.cc:1059] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:31.510977  8287 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.486714  8213 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:31.455888  9943 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.513996  9948 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:31.514475  9954 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:31.514696  9874 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:31.516618  9832 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.477083  9956 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.482185  9865 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:31.479588  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:31.486937  9810 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:31.507221  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:31.560382  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 197523us
I20260709 13:16:31.478956  9958 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
W20260709 13:16:31.562079  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 78337.8us
I20260709 13:16:31.572829  8258 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:31.563635  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 80855.5us
I20260709 13:16:31.528187  9937 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:31.575974  9937 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.587028  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:31.588450  8258 leader_election.cc:400] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:31.589195  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.518805  9962 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:31.560788  9967 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:31.626293  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:31.558211  9865 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:31.625967  9751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.420s	user 0.016s	sys 0.066s
I20260709 13:16:31.622995  9971 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:31.630313  9988 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:31.630438  8212 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:31.588805  8258 leader_election.cc:403] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:31.631206  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.505717  9964 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:16:31.556788  9832 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:31.558362  9948 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:31.629240  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:31.634485  9967 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.581245  8289 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:31.631973  9754 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.647593  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.638221  9751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.435s	user 0.016s	sys 0.066s
I20260709 13:16:31.646986  9780 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:31.649312  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 60993.6us
I20260709 13:16:31.651513  8294 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:31.622789  8287 raft_consensus.cc:2410] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:31.652525  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:31.641932  9865 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:31.561854  9886 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.635998  9682 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:31.675382  8368 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:31.640602  9959 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:31.588614  9963 raft_consensus.cc:3055] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:31.656899  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.696161  8213 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:31.644516  9978 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.654356  9986 consensus_queue.cc:1059] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:16:31.700388  9986 raft_consensus.cc:1064] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:31.704787  9780 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.705415  9780 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.716323  9946 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:31.643118  9892 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.720220  9821 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:31.722757  8295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 213) took 1844 ms (client timeout 2206 ms). Trace:
W20260709 13:16:31.697691  9961 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:31.729029  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:31.723271  8295 rpcz_store.cc:269] 0709 13:16:29.878139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.072703 (+194564us) service_pool.cc:224] Handling call
0709 13:16:30.199505 (+126802us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:31.722506 (+1523001us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b540005da54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:31.722683 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429425920}
I20260709 13:16:31.730154  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1227) took 1215 ms. Trace:
I20260709 13:16:31.630466  9875 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:31.671252  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:31.673146  8220 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 3. Ops: []
I20260709 13:16:31.476557  9939 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:31.654448  9863 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:31.697403  9978 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:31.680382  9975 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3.
I20260709 13:16:31.680925  9990 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:31.681468  9682 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.886860  9943 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:31.736371  9960 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 13:16:31.888018  9990 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.684680  9962 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.889410  9962 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:31.890190  9990 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:31.890288  9962 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.891583  9962 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.893640  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:31.894551  8922 raft_consensus.cc:2410] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:31.656400  9967 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.687340  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.692083  9948 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:31.736980  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 65838.2us
I20260709 13:16:31.738322  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.695660  9963 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:31.742143  9857 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.765398  8365 consensus_meta.cc:287] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.654s	user 0.006s	sys 0.005s
W20260709 13:16:31.775700  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 201126us
I20260709 13:16:31.777763  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:31.786788  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.789124  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 311394us
W20260709 13:16:31.824997  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0430140620001112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:16:31.916157  8183 connection.cc:256] RPC call timeout handler was delayed by -1.025014062000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
I20260709 13:16:31.839154  9687 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.846248  9956 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.737812  9988 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Leader election lost for term 2. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:31.929514  8892 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:31.874922  9869 consensus_meta.cc:287] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.829s	user 0.008s	sys 0.000s
I20260709 13:16:31.882123  8213 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:31.904287  9974 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.937666  9974 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:31.930198  9943 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:16:31.939155  9943 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:31.939553  9943 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:31.938845  9974 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.940577  9974 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.940374  9943 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.941519  9943 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:31.941977  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:31.943622  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.944303  8212 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:31.945420  8212 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:31.946528  8212 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:31.948253  9985 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:31.948388  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:31.949112  8213 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:31.949960  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:31.932390  9687 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.886422  9682 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.950914  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:31.951567  8924 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:31.951683  9952 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.683231  8364 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:31.952152  9952 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.953331  9963 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.954176  9952 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:31.954348  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1285) took 1005 ms. Trace:
I20260709 13:16:31.954859  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:31.955015  8364 rpcz_store.cc:276] 0709 13:16:30.948568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.089314 (+140746us) service_pool.cc:224] Handling call
0709 13:16:31.089639 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.952278 (+862639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.954078 (+  1800us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400366fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:31.954277 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364658048}
I20260709 13:16:31.685128  9832 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.958035  9832 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.958887  9940 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:31.959390  9940 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:31.961401  9880 consensus_meta.cc:287] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 13:16:31.961644  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:31.894191  9865 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.732316  9874 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.901903  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:31.680282  9751 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.730638  8218 rpcz_store.cc:276] 0709 13:16:30.514574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.728668 (+1214094us) service_pool.cc:224] Handling call
0709 13:16:31.730089 (+  1421us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:31.908991  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.877954  9959 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:31.921475  9992 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.922209  9857 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.923220  9990 raft_consensus.cc:3055] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.925050  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:31.896941  9942 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.928144  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:31.929124  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 151436us
I20260709 13:16:31.930694  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:31.930099  9875 consensus_queue.cc:1059] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:16:31.933138  9958 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:31.707831  9780 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:31.933498  9675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.002s	sys 0.016s
I20260709 13:16:31.935595  9978 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.950548  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:31.956276  9869 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.662024  9754 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:31.956910  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:31.997691  8922 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:31.998060  8288 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:31.957163  9682 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:31.998886  9857 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:31.999946  9869 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:32.002251  9956 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:31.989243  9952 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:31.898566  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.004786  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1287) took 1055 ms. Trace:
I20260709 13:16:31.986665  9995 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.005765  9754 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:31.993283  9675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.003s	sys 0.016s
I20260709 13:16:31.968374  9751 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.009117  9751 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:32.005261  8361 rpcz_store.cc:276] 0709 13:16:30.949179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.116911 (+167732us) service_pool.cc:224] Handling call
0709 13:16:31.138169 (+ 21258us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:31.152176 (+ 14007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.153074 (+   898us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:31.268419 (+115345us) log.cc:844] Serialized 52 byte log entry
0709 13:16:31.463374 (+194955us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:31.465772 (+  2398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.471839 (+  6067us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.004564 (+532725us) raft_consensus.cc:1685] finished
0709 13:16:32.004580 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.004732 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1717,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":1886,"thread_start_us":106527,"threads_started":1,"wal-append.queue_time_us":634999}
I20260709 13:16:32.010216  9811 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:31.962678  8364 raft_consensus.cc:2393] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:16:31.963703  8186 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.218s (SENT) [suppressed 36 similar messages]
W20260709 13:16:31.962643  8211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.020s	sys 0.027s
I20260709 13:16:31.918493  8365 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:31.954416  9963 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.000895  9687 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.028903  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:31.976389  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 74597.3us
I20260709 13:16:31.988245  9992 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.013762  9987 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:16:31.985363  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:31.987018  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 58951us
I20260709 13:16:32.174057  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:31.987844  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 62887.6us
I20260709 13:16:31.926574  9866 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:31.966056  9959 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:31.966460  9990 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:31.997371  9958 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:31.968276  9874 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.010732  9811 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.015180  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:32.189193  8364 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.013038  9985 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:16:32.022718  8211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.021s	sys 0.027s
I20260709 13:16:31.992308  9895 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:32.023198  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1283) took 1078 ms. Trace:
I20260709 13:16:32.094324  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.186025  8183 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:32.085884  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.099633  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 90699.3us
W20260709 13:16:32.146199  8892 leader_election.cc:336] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.527s (SENT)
I20260709 13:16:32.146696  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:32.152555  8291 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:31.961818  9880 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:32.153663  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.169574  9992 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:32.153455  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 168168us
I20260709 13:16:32.015199  9875 raft_consensus.cc:3055] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.995010  8215 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:16:32.175439  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.156924  9998 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:31.986289  9942 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.201514  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:32.210111  8889 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:32.213327  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:32.188825  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1295) took 1019 ms. Trace:
I20260709 13:16:32.204730  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:32.185220  9959 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:32.218659  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.232390  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 201640us
W20260709 13:16:32.235661  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.236347  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.237958  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:32.239130  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.235037  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:32.219218  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 120035us
I20260709 13:16:32.243743  8258 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:32.217687  9994 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:16:32.252566  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.253085  8364 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:32.259543  8261 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:32.266248  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 300660us
W20260709 13:16:32.270069  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 56841.9us
I20260709 13:16:32.270985  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:32.272337  8183 leader_election.cc:400] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:32.273082  8183 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:32.218061  9875 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:32.244462  9957 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.001s	sys 0.013s
I20260709 13:16:32.218341  9980 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:32.209743  9940 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:32.232489  9937 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.208947  8365 rpcz_store.cc:276] 0709 13:16:30.944639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.993218 (+ 48579us) service_pool.cc:224] Handling call
0709 13:16:32.023117 (+1029899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.218516  9999 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.264418  9960 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.254026  9983 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:32.278730  9957 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.001s	sys 0.013s
I20260709 13:16:32.265089  9855 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:32.282454  9992 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:32.304338  8261 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.264549  9990 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.267748  9975 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:16:32.308986  9875 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.280615  9895 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:32.256706  9734 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:32.250957  9998 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:32.266669  9869 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.256376  9687 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.251519  9754 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:16:32.274936  9971 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:32.257582 10005 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.264611  9950 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:32.303385  9887 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.255524  9948 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:16:32.278229  9996 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:32.283025  9865 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:32.302057  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:32.287038  8186 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:32.278430  8925 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:32.337205  8183 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:32.268687  9863 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:32.291036  9999 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:32.217497  9958 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:31.962793  9872 consensus_queue.cc:1175] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e95b04d03d241329435b6d08dd1f236" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:32.328162  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 214) took 2449 ms. Trace:
I20260709 13:16:32.311503  9992 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:32.329200  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1703) took 1848 ms. Trace:
I20260709 13:16:32.346949  8360 rpcz_store.cc:276] 0709 13:16:30.480692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.861898 (+381206us) service_pool.cc:224] Handling call
0709 13:16:32.329022 (+1467124us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400355554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:32.329150 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234712320}
I20260709 13:16:32.329334  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1293) took 1161 ms. Trace:
I20260709 13:16:32.331676  9971 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:32.319862  9990 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.342245  8362 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:32.323421  9869 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:32.285027 10001 consensus_queue.cc:1059] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:16:32.337675  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 50729.4us
I20260709 13:16:32.230559  8361 rpcz_store.cc:276] 0709 13:16:31.169325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.010676 (+841351us) service_pool.cc:224] Handling call
0709 13:16:32.011018 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.115110 (+104092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.153674 (+ 38564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.159798 (+  6124us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:32.163406 (+  3608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.168105 (+  4699us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.187031 (+ 18926us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.325482  9875 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:32.288157  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 83394.2us
W20260709 13:16:32.384102  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.330646  9827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.013s	sys 0.003s
I20260709 13:16:32.300585 10004 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:32.385972  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:32.346966  8365 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:32.387768  9934 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.416s	user 0.004s	sys 0.000s
I20260709 13:16:32.343520  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:32.388384  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:32.336959  9810 consensus_meta.cc:287] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
W20260709 13:16:32.389087  9968 log.cc:927] Time spent T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.952s	user 0.011s	sys 0.000s
I20260709 13:16:32.389200  9810 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.391381  9810 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:32.344527  8291 rpcz_store.cc:276] 0709 13:16:29.878433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.868674 (+990241us) service_pool.cc:224] Handling call
0709 13:16:30.958828 (+ 90154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.202033 (+1243205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.327883 (+125850us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400425254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:32.328105 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2458430720}
I20260709 13:16:32.328773  9734 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:32.395030  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:32.396086  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:32.331130  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 65125.8us
I20260709 13:16:32.336396  9940 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:32.348179  8368 rpcz_store.cc:276] 0709 13:16:31.167695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.881161 (+713466us) service_pool.cc:224] Handling call
0709 13:16:31.905783 (+ 24622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.906080 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:31.922285 (+ 16205us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.329043 (+406758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.329090 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:32.329127 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.329187 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.329286 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16657,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":63529,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":13888,"thread_start_us":406304,"threads_started":2,"wal-append.queue_time_us":334231}
I20260709 13:16:32.338289  9963 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.341287  9995 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:32.301934  9980 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:32.354209  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1113) took 1139 ms. Trace:
I20260709 13:16:32.407935  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:32.346028  9962 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.342974  9999 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.360548  9942 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:32.349951  9855 raft_consensus.cc:697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:32.385275  9811 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.387518  9948 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:32.388834  9989 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:16:32.388648  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 45200.1us
I20260709 13:16:32.391414  9866 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:32.393013  8369 raft_consensus.cc:2393] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:32.331941  9887 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:32.333911 10005 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:32.356158 10006 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:32.400542  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:32.358667  9869 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.392382  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:32.355370  9981 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:32.355317  9895 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.460027  9883 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.400321  9810 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:16:32.410802  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:32.406384  9734 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:32.411907  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:32.411219  8217 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:32.412451  9995 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.348910  9992 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:32.408999  8215 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:32.347175  9967 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.407189  8219 rpcz_store.cc:276] 0709 13:16:31.215120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.253202 (+ 38082us) service_pool.cc:224] Handling call
0709 13:16:31.253469 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.456143 (+202674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.456184 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.460921 (+  4737us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.713758 (+252837us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b4800080358. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f 00007f3202428f37 00007f320243d55c 00007f320243d508 00007f320243d488 00007f320243d443 00007f320243c6ec 00007f3201366a96
0709 13:16:31.805908 (+ 92150us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:31.967318 (+161410us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.988794 (+ 21476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.989687 (+   893us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.347225 (+357538us) raft_consensus.cc:1685] finished
0709 13:16:32.354008 (+  6783us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.354141 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20547,"prepare.queue_time_us":460392,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4633,"raft.queue_time_us":225743,"raft.run_cpu_time_us":1304,"raft.run_wall_time_us":332656,"spinlock_wait_cycles":11929216,"thread_start_us":638714,"threads_started":3,"wal-append.queue_time_us":497614}
W20260709 13:16:32.386842  9827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.014s	sys 0.003s
I20260709 13:16:32.455102  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:32.458530  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:32.467031  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:32.477435  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1096) took 3395 ms. Trace:
I20260709 13:16:32.413429  9962 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:32.489476  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1101) took 3397 ms. Trace:
I20260709 13:16:32.516268  8217 rpcz_store.cc:276] 0709 13:16:29.092410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.404207 (+3311797us) service_pool.cc:224] Handling call
0709 13:16:32.410533 (+  6326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.489176 (+ 78643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.489421 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1152896}
W20260709 13:16:32.517259  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.489688  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:32.491252  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.492208  9948 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:32.493054  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1290) took 1543 ms. Trace:
I20260709 13:16:32.468586  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1288) took 1519 ms. Trace:
I20260709 13:16:32.416678  9971 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.495638  9967 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:32.496754  8215 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:32.497784  9986 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.498360  9734 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.456125  9887 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.411262  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:32.499410  9974 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:32.500149  8366 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:32.501227  8365 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.500600  9995 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.503947  9810 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:32.506382  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 111846us
W20260709 13:16:32.478751  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.510834  8220 rpcz_store.cc:276] 0709 13:16:29.081937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.180172 (+1098235us) service_pool.cc:224] Handling call
0709 13:16:30.450662 (+270490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.736917 (+1286255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.477173 (+740256us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400019354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:32.477341 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2810832128}
I20260709 13:16:32.520630  8219 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:32.472620 10002 log.cc:927] Time spent T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:16:32.473951  9993 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:16:32.537956  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 82974us
I20260709 13:16:32.580273  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:32.537446  8363 rpcz_store.cc:276] 0709 13:16:30.949995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.361917 (+411922us) service_pool.cc:224] Handling call
0709 13:16:31.362238 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.478249 (+116011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.478375 (+   126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.484428 (+  6053us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.825019 (+340591us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:31.825078 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.825169 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.492866 (+667697us) raft_consensus.cc:1685] finished
0709 13:16:32.492885 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.492999 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":267,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":91749,"thread_start_us":387752,"threads_started":2,"wal-append.queue_time_us":690630}
I20260709 13:16:32.416953  9935 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:32.420595  9980 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.472386  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:32.541072  8286 raft_consensus.cc:2393] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:32.563524  9976 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.567806  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.539825  8362 rpcz_store.cc:276] 0709 13:16:30.949457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.143095 (+193638us) service_pool.cc:224] Handling call
0709 13:16:32.331361 (+1188266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.358759 (+ 27398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.468324 (+109565us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400355550. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:32.468509 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2702656896}
I20260709 13:16:32.536405  9962 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.509272  9939 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37894 (request call id 12) took 14157 ms. Trace:
I20260709 13:16:32.537114  9827 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.541167 10014 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:32.537818  9688 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:32.539543  9948 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:32.578292  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:32.568866  9893 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.563989  9880 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.615099  9886 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.583252  9978 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.583758  9963 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:32.583261  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1639) took 1417 ms. Trace:
I20260709 13:16:32.534623  9947 consensus_queue.cc:260] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.626422  9947 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.626096  8286 rpcz_store.cc:276] 0709 13:16:31.165479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.167012 (+  1533us) service_pool.cc:224] Handling call
0709 13:16:32.458414 (+1291402us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:32.583191 (+124777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14976384}
I20260709 13:16:32.540071  9687 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.570176  9974 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:32.585516  9988 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:32.585600  9935 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:32.534888  9682 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:32.400353  9998 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:32.591572  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.642079  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.561301  9997 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:32.643078  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.573562  9810 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:32.612062  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:32.611804  9688 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:32.617455  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.648666  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.582401  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:32.649730  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 67443.3us
I20260709 13:16:32.619228  9893 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.621750  9883 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.613658  9827 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:32.624531  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.622592  9963 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:32.656642  9943 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:32.571316  9855 consensus_queue.cc:237] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.620388  8214 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:16:32.617152 10014 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:32.563584 10005 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.635167  9960 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.645160  8219 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:32.611896  9976 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.652304 10004 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:32.653424  9997 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:32.622167  9995 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:32.654644  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:32.658505  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.647862  9810 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.658641  9883 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:32.660476  9688 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.654105  9880 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:32.661567  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:32.621063  9959 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.667109  9996 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:32.649616  9999 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:32.656636  9963 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.674175  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.674839  9955 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:32.671682  9992 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.664506  9857 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.698928  9857 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.699556  9827 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.665719 10014 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.678404  9810 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.675634  9997 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.678301  9887 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.630436  9948 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.679347  8363 raft_consensus.cc:2376] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3. Re-sending same reply.
I20260709 13:16:32.680666  9941 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:32.682797  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:32.683662  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1230) took 2168 ms (client timeout 2875 ms). Trace:
W20260709 13:16:32.714769  8216 rpcz_store.cc:269] 0709 13:16:30.515537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.860079 (+344542us) service_pool.cc:224] Handling call
0709 13:16:31.094530 (+234451us) spinlock_profiling.cc:243] Waited 909 us on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:32.683496 (+1588966us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54001d5e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:32.683610 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592940672}
I20260709 13:16:32.684345  8217 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:32.700024  9992 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.684635  8360 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:32.689280  8366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1699) took 2482 ms (client timeout 2007 ms). Trace:
I20260709 13:16:32.676251  9811 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:32.694840  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:32.719915  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:32.697252  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.686841  9943 raft_consensus.cc:3055] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:32.698194  9883 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.669231  9940 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:16:32.644531  9988 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.676131  9974 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.690256  8362 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.678781  9977 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:16:32.661825  9935 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:32.717248  8366 rpcz_store.cc:269] 0709 13:16:30.200624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.201924 (+  1300us) service_pool.cc:224] Handling call
0709 13:16:32.682926 (+2481002us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400356954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:32.683018 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3798046464}
I20260709 13:16:32.714386  9875 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.722433  8368 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:32.726190  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.700414  8213 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:32.733350  9869 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.733812  9999 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:32.734568  9887 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:32.741073  8363 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:32.742092  9976 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.724148  9943 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:32.727281 10016 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.745703  8366 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:32.722997  9941 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:32.728340  9880 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:32.768637  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.818933  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.730206  9948 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:32.784835  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 58737.8us
I20260709 13:16:32.786120  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1707) took 1130 ms. Trace:
I20260709 13:16:32.784569  9883 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.788152  9857 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.745807  9974 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.739130  9893 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:32.782370  9751 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:32.824226  8363 rpcz_store.cc:276] 0709 13:16:31.657997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.740591 (+1082594us) service_pool.cc:224] Handling call
0709 13:16:32.740915 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.785864 (+ 44949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.786069 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.854224  8363 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:32.592034  9939 rpcz_store.cc:276] 0709 13:16:18.254510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.337806 (+ 83296us) service_pool.cc:224] Handling call
0709 13:16:18.363517 (+ 25711us) log.cc:844] Serialized 492 byte log entry
0709 13:16:18.556683 (+193166us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b18002bbdc0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f31fd36ab0b 00007f31fd3efb63 00007f31fd417752 00007f32023d7d29
0709 13:16:32.392633 (+13835950us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171657,"raft.queue_time_us":140537,"raft.run_cpu_time_us":1491,"raft.run_wall_time_us":16350,"spinlock_wait_cycles":17985920,"thread_start_us":55238,"threads_started":1,"wal-append.queue_time_us":82204,"wal-append.run_cpu_time_us":1757,"wal-append.run_wall_time_us":1015488}
I20260709 13:16:32.786151  9811 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:32.826406  9883 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.826948  8368 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:32.840498  9827 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:32.852881  9959 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.825556  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.860713  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1711) took 1029 ms. Trace:
I20260709 13:16:32.868361  8363 rpcz_store.cc:276] 0709 13:16:31.830984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.853665 (+1022681us) service_pool.cc:224] Handling call
0709 13:16:32.854013 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.860376 (+  6363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.860643 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.868386  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1710) took 1038 ms. Trace:
I20260709 13:16:32.869277  8368 rpcz_store.cc:276] 0709 13:16:31.829822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.826462 (+996640us) service_pool.cc:224] Handling call
0709 13:16:32.826785 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.868089 (+ 41304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.868333 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.871555  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46094.3us
I20260709 13:16:32.822796  9935 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:32.882773  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:32.879967  8363 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:32.860922  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.867796  9827 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.855980  8362 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:32.905455  8368 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:32.890211  9880 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:32.878427 10016 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.918128 10016 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.921547  9821 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:32.921965  9874 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.922130  9821 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:32.906499  9893 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:32.934309  8364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.029s	sys 0.040s
W20260709 13:16:32.935252  8364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.029s	sys 0.040s
I20260709 13:16:32.935680  8368 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:32.878669  9943 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:32.942492  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.012s	sys 0.043s
W20260709 13:16:32.943015  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.012s	sys 0.043s
W20260709 13:16:32.944190  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.934535 10000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.023s	sys 0.030s
W20260709 13:16:32.939090  9958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.030s
W20260709 13:16:32.950132  8889 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.061s
W20260709 13:16:32.935249  9832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.015s	sys 0.037s
W20260709 13:16:32.961021  8889 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.010s	sys 0.061s
W20260709 13:16:32.961352  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 562287us
W20260709 13:16:32.961907  8889 leader_election.cc:336] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.206s (SENT)
I20260709 13:16:32.964082  8369 raft_consensus.cc:2410] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:32.964242  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:32.953573 10000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.023s	sys 0.030s
I20260709 13:16:32.967324  8928 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:32.960561  9958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.016s	sys 0.030s
W20260709 13:16:32.962447  9832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.016s	sys 0.037s
I20260709 13:16:32.930213 10016 consensus_queue.cc:1059] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:16:32.968577  9883 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:32.931113  9941 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:32.980000  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1296) took 1799 ms. Trace:
I20260709 13:16:32.980741  9941 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:32.973912  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:32.974396  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.969774  9895 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.022s	sys 0.019s
W20260709 13:16:32.983006 10021 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:16:32.998524  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.975663  9967 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.982856  9869 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:32.976006  9991 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:33.040439  8365 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:33.045039  9962 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:32.980437  8364 rpcz_store.cc:276] 0709 13:16:31.180990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.273779 (+1092789us) service_pool.cc:224] Handling call
0709 13:16:32.274181 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.285621 (+ 11440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.285673 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.286531 (+   858us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.936842 (+650311us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:32.936897 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.937013 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.979786 (+ 42773us) raft_consensus.cc:1685] finished
0709 13:16:32.979807 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.979943 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27806,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":628197,"threads_started":1,"wal-append.queue_time_us":678471}
W20260709 13:16:33.023092  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.975829 10017 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.008810  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:33.007493  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.998024  9895 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.022s	sys 0.019s
W20260709 13:16:33.095194  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.100662  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.089016 10024 log.cc:927] Time spent T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Append to log took a long time: real 0.091s	user 0.001s	sys 0.001s
I20260709 13:16:33.051231  9947 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.094120  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:33.103114  8364 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:33.104205  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.105480  8364 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:33.030230  9988 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.106369  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.107034  8364 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:33.055263  9967 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:33.107354  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 98671us
I20260709 13:16:33.101656  9947 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:33.107170  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.096350  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 429914us
I20260709 13:16:33.108680  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:33.109342  8926 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:33.106417 10017 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.096206  9991 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.111333  9967 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:33.111513  9991 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.112149  9980 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.112584  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.113423  9980 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:33.113866  8364 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:33.114480  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:33.108726  9855 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.114615  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:33.115530  9980 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:32.995265  9995 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.027078  9971 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.116655  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:33.067942  8922 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:16:33.119374  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.122424  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:33.116775  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.125769  8290 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:33.126119  9971 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.126808  9995 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.127854  8291 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:33.116643  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.128687 10017 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.129669  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:33.141041  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.141784  8928 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:33.132407  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:33.142799  8286 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:33.133294  8293 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:16:33.133716 10033 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:33.072024  9827 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.138939  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:33.131024  8287 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:33.145246  8294 raft_consensus.cc:2376] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:16:33.146602  9895 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.147114  9895 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.115990  9980 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:33.152451  8928 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:33.083595  9963 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.161384  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:33.158842  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.171065  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.174919  8219 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:33.155910  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:33.175367  8217 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.174831  8220 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:33.175705  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.173017  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.177012  8220 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:33.177405  8213 raft_consensus.cc:2410] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:33.180227  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:33.180997  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 58630.9us
I20260709 13:16:33.185501  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.171240  9751 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:33.188732  8183 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:33.169546  8288 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.190294  8295 raft_consensus.cc:2410] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:33.192081  8219 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:33.139585  9863 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:33.148444 10037 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.196267  8183 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:33.184913  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.197415  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:33.194365  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:33.200474  8217 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:33.206687  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.207417  8295 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:33.207504  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.208302  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.210785  8295 raft_consensus.cc:2410] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:33.195370  9988 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:33.212889  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:33.213204  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.136343 10034 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:16:33.214774  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:33.216439  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.217021  8295 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:33.194171  8920 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:33.204113  9939 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:33.203442  9751 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:33.206557  9947 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.206452  9997 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:33.213194  9940 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.222666  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.212936  9962 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.213604 10037 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:33.224550  8258 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:33.258396  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-2ebc3be5b6ff4d2b90d60c9a508dafc7 received from {username='slave'} at 127.0.0.1:37896
I20260709 13:16:33.258998  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-2ebc3be5b6ff4d2b90d60c9a508dafc7 on tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:33.261881  9995 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.227500 10000 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.263116  9893 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:33.224550  9946 raft_consensus.cc:3055] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:33.216171 10014 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:33.264454  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.266484  8364 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:33.266428  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.266173  9751 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.267722  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.268410  8289 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:33.266834  8365 raft_consensus.cc:1240] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:33.264459  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.270514  8365 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:33.264791  9946 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:33.271658  8365 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:33.271459  9946 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.272802  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.273334  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.273589  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.274406  8288 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:33.222190  9827 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.224996  8923 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:33.307929  8213 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 1.
I20260709 13:16:33.309999  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:33.317749  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 93299.9us
I20260709 13:16:33.317621  8295 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:33.324671  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:33.245527  9971 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.325135  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:33.326035  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:33.327620  9751 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.327986  9986 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:33.328284  9975 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:33.328438  9986 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.328805  9986 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.330199  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:33.331630  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:33.326506  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:33.333288  8213 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.334988  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:33.326107 10039 log.cc:927] Time spent T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:33.322687  9863 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.335134  9962 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:33.344674  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:33.340595  8363 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:33.341264  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.342152  9957 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.335526  9872 raft_consensus.cc:2764] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:33.338810  9997 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:33.350591  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.353773  8213 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:33.342670 10014 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:33.337997  9751 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:33.365796  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.365792  8258 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:33.356319  9957 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:33.223412  9980 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.365639  8216 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:33.367549  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.366163  9997 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.368500  8213 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:33.372931  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:33.336849  9971 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:33.351150  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:33.364871  9975 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:33.365346  9751 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.388860  9975 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.365291 10037 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.374537  9997 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:33.399025  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.401134  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:33.402354  9962 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.402530  9940 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.403373  9953 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:33.406644  8927 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:33.390308  9947 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:33.403069  9827 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.403474  8186 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:33.367635  9959 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:16:33.385460  9963 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.406502  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.391175  9751 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.395288  9975 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.415469  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.391146  9895 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:33.422562  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:33.412951 10042 log.cc:927] Time spent T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:16:33.410377  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.413558  8288 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:33.408798 10025 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.435781  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:33.403128  9992 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:33.428836  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:33.435141  9955 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.433779  9963 raft_consensus.cc:3055] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:33.436470  9987 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:33.430941  9941 consensus_queue.cc:1059] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:16:33.449479  9963 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:33.424108  9827 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.458468  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.461539  8889 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:33.462004  9947 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:33.465493  8217 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:33.445262  9971 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:16:33.491253  9827 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.445569 10053 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:33.471576 10048 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:33.473819  9821 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.439632  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:33.441722  9967 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:33.454941  8362 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:33.431790 10005 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:33.441457  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.459751  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 337) took 1511 ms. Trace:
I20260709 13:16:33.451553  8925 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:33.486469  8220 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:33.494724  9974 raft_consensus.cc:3055] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:33.496073  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:33.438865 10025 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.484483  9955 raft_consensus.cc:697] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:33.509179  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:33.468273  9943 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.435992  9957 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:33.505908 10052 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:16:33.491549  9863 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.507508  9941 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:33.564970  8892 leader_election.cc:336] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 3.054s (SENT)
I20260709 13:16:33.588007  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:33.513659  9967 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:33.566744  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:33.515873  8923 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:33.516273  9974 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:33.612699  9974 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:33.613399 10056 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:16:33.613998  9974 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.615424  8214 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.615286  9997 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.605247  9955 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.617929  9980 raft_consensus.cc:476] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:33.593065  9960 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.620205  8214 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:33.620402  9975 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.587150  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1713) took 1225 ms. Trace:
I20260709 13:16:33.621582  8363 rpcz_store.cc:276] 0709 13:16:32.361717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.887894 (+526177us) service_pool.cc:224] Handling call
0709 13:16:32.888149 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.349505 (+461356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.586806 (+237301us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b540010cf54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:33.587071 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039987456}
I20260709 13:16:33.605877  9893 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.622673  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.514621 10060 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.623275  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:33.623667  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.592590  8290 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:33.624472  8363 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:33.624578  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.625130  8362 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:33.577111  9821 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.625445 10025 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.626283  8362 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:33.626536  8363 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:33.627679  9935 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:33.579165  9987 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:33.628084  9935 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.628278  9987 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.628535  9935 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.628759  9987 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.628894 10053 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:33.603828  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.590905  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.511648  8361 raft_consensus.cc:2376] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3. Re-sending same reply.
I20260709 13:16:33.621167  8926 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:33.623327 10060 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.511817  8920 rpcz_store.cc:276] 0709 13:16:31.949014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.949703 (+   689us) service_pool.cc:224] Handling call
0709 13:16:33.459537 (+1509834us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540024e354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:33.459677 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518022016}
I20260709 13:16:33.587893  9941 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:33.644654  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:33.647121  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.622994  9975 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.653399  8363 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:33.657994  8217 raft_consensus.cc:1240] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:33.636854  9998 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.637017  9960 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.664544  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.667254  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.650943  8922 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEARNER]: Advancing to term 3
I20260709 13:16:33.622967  9893 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.652489  9941 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.637660 10053 consensus_queue.cc:1059] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:33.679282  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1706) took 2023 ms. Trace:
I20260709 13:16:33.682663  8360 rpcz_store.cc:276] 0709 13:16:31.655803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.352299 (+696496us) service_pool.cc:224] Handling call
0709 13:16:32.684329 (+332030us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.716971 (+ 32642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.679096 (+962125us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540018fe50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:33.679226 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762670976}
I20260709 13:16:33.679186  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:33.665263  9957 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.640938  9947 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.666747  9980 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:16:33.695521  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 284412us
I20260709 13:16:33.697202  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:33.699604  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 89867.2us
I20260709 13:16:33.673518  9960 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.684473  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.691334  8214 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:33.687554  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:33.693593  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:33.673178  9998 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.696429  8362 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.705086  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:33.710106 10059 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:16:33.709156  8261 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:33.711705  9960 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.712713  9892 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:33.712924  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.714519  8920 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:33.703828  9751 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.717216  9883 raft_consensus.cc:3055] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.717599  9883 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:33.718364  9751 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.718421  9883 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.719928  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.721024  9893 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.699940  9955 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.723722  8220 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:33.725744  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:33.713135 10027 log.cc:927] Time spent T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.932s	user 0.000s	sys 0.004s
I20260709 13:16:33.722762  9998 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.724450  9857 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:33.730893 10053 consensus_queue.cc:1175] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" responder_term: 4 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: [3.5-3.5]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:16:33.741268 10057 log.cc:927] Time spent T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:16:33.741281  9857 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.743119  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:33.743693  8213 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.744510  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.745151  8214 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:33.746411  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.747428  8214 raft_consensus.cc:2410] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:33.740190  9892 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.752938  9892 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:33.753690  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1714) took 1360 ms. Trace:
I20260709 13:16:33.754042  8369 rpcz_store.cc:276] 0709 13:16:32.393643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.719602 (+325959us) service_pool.cc:224] Handling call
0709 13:16:33.753513 (+1033911us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000f4954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:33.753638 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538248064}
I20260709 13:16:33.757831  8213 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
W20260709 13:16:33.755930  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1241) took 1370 ms (client timeout 1595 ms). Trace:
I20260709 13:16:33.719818  9883 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.745235  9857 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:33.759848  8218 rpcz_store.cc:269] 0709 13:16:32.385620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.388118 (+  2498us) service_pool.cc:224] Handling call
0709 13:16:33.755757 (+1367639us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b540019ad54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:33.755881 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295695744}
I20260709 13:16:33.719810  9986 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.768357  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 182) took 4674 ms. Trace:
I20260709 13:16:33.736801  9863 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:33.695547  9967 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.773255  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1307) took 1109 ms. Trace:
I20260709 13:16:33.715816 10060 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.771376  9987 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.789752  8364 rpcz_store.cc:276] 0709 13:16:32.664036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.146169 (+482133us) service_pool.cc:224] Handling call
0709 13:16:33.146667 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.266989 (+120322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.772975 (+505986us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540010ed54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:33.773188 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275126656}
W20260709 13:16:33.789256 10064 log.cc:927] Time spent T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
W20260709 13:16:33.796182  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.802232  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 76327.8us
I20260709 13:16:33.806669  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:33.796865  9751 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:33.796147  9955 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.819571  9960 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.820178  9960 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.820878  9955 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.822917  9955 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.808697  9980 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:33.745152  9963 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:33.809300  9997 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.840358  8919 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:33.809700 10017 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:33.813977 10005 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:16:33.852279  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:33.818440  9751 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.851509  9963 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:33.871846  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.860522  9941 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:33.875037 10072 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:16:33.876255 10066 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:16:33.877295  9751 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.861400  9935 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:33.885016  9987 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:33.776109  8211 rpcz_store.cc:276] 0709 13:16:29.094375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.099222 (+2004847us) service_pool.cc:224] Handling call
0709 13:16:31.137138 (+ 37916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.877662 (+740524us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fa3070ac 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa321455 00007f31fd409060
0709 13:16:32.229928 (+352266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.234619 (+  4691us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.300723 (+ 66104us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.780545 (+479822us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:32.780595 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.780682 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.712534 (+931852us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:33.761239 (+ 48705us) raft_consensus.cc:1685] finished
0709 13:16:33.761265 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.768280 (+  7015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88867,"raft.queue_time_us":171766,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":20158,"spinlock_wait_cycles":15386752,"thread_start_us":1485528,"threads_started":2,"wal-append.queue_time_us":456601}
I20260709 13:16:33.886710  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:33.886127  8922 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:33.887269  8211 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:33.889031  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:33.890230  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.890764  8921 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:33.896507  8927 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:33.881583  9986 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:33.906589  9734 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:33.907572 10000 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:33.906857  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 197747us
I20260709 13:16:33.908775  8261 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:33.909803  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:33.910573  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:33.911118  9959 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.911648  9874 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.913645  8258 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:33.898070  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.930735  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.932204  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.932791  8287 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:33.932971  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.911146 10000 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:33.935309  8215 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:33.920869  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:33.937168  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:33.938699  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.938862  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.930960 10071 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:33.939538 10071 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.939713  8213 raft_consensus.cc:2393] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:33.939857 10071 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.940210  9855 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:33.940490  9874 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:33.940522  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:33.935348 10000 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.941785 10000 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.941565 10053 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:33.943832  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:33.944649  8258 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:33.937254  8921 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
W20260709 13:16:33.948694 10026 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.995s	user 0.006s	sys 0.000s
I20260709 13:16:33.953282  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:33.956511  8213 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:33.972281  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.974040  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:33.976466  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.942922  8365 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:33.930663  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.977133  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:33.980624  8295 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:33.980564  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:33.992462  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 47915.4us
I20260709 13:16:33.993795  8368 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:33.993646  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:33.996941  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:33.998520  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:34.004218  9959 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:34.004645  9959 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.004755 10060 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:34.005018  9959 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.005362 10060 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:34.006326 10060 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:34.039213  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.044478  8287 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
W20260709 13:16:34.044687  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.045981  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:33.977360  9980 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:16:34.046660  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:34.052007  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1294) took 2883 ms. Trace:
W20260709 13:16:34.050949  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 45027.4us
I20260709 13:16:34.010775  9855 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:34.008713  8288 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:34.055212  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:34.065188  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.997238 10067 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:16:34.047356 10014 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:34.053555  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:34.057135  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:34.147464  8287 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:34.149209  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:34.149981  8287 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.046422  8921 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:34.054153  8367 rpcz_store.cc:276] 0709 13:16:31.168498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.989264 (+820766us) service_pool.cc:224] Handling call
0709 13:16:31.989599 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.290836 (+301237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.290878 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.305636 (+ 14758us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.690605 (+384969us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:32.690645 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.690707 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:33.948417 (+1257710us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b24002c51a8. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa1aa9c4 00007f31fa1a8acb 00007f31fa363dc9 00007f31fa363a55 00007f31fa36309d 00007f31fcf9510e 00007f31fcfac88c 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221
0709 13:16:34.051737 (+103320us) raft_consensus.cc:1685] finished
0709 13:16:34.051760 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.051950 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":939,"raft.queue_time_us":20118,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":32673152,"thread_start_us":659453,"threads_started":2,"wal-append.queue_time_us":593780}
W20260709 13:16:34.117421 10032 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:16:34.145027  9935 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:34.147667  9996 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:34.117931  9874 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:16:34.207342  8920 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:34.172374  8923 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:34.176791 10014 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:34.056255  8362 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:34.222635  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:34.656643  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:34.262897  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.657377 10014 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.657883 10014 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:34.659163  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.657241 10099 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.660846 10099 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.663769 10014 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:34.663233 10099 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:34.390522 10093 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:16:34.339329 10088 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
W20260709 13:16:34.399853  9963 consensus_meta.cc:287] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.000s
W20260709 13:16:34.392874 10092 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:16:34.636370 10101 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.667822 10101 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:34.670559 10101 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:34.545079 10000 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.000s
W20260709 13:16:34.337234  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.201052  9996 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:34.540010  9959 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.003s
W20260709 13:16:34.425385 10095 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:16:34.677330  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 465) took 1472 ms. Trace:
I20260709 13:16:34.677866  8922 rpcz_store.cc:276] 0709 13:16:33.204746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.579892 (+375146us) service_pool.cc:224] Handling call
0709 13:16:33.638604 (+ 58712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.886003 (+247399us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:33.926637 (+ 40634us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.145414 (+218777us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.204598 (+ 59184us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.300127 (+ 95529us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:34.349668 (+ 49541us) log.cc:844] Serialized 14 byte log entry
0709 13:16:34.363919 (+ 14251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.426591 (+ 62672us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.677068 (+250477us) raft_consensus.cc:1685] finished
0709 13:16:34.677099 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.677257 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11965,"prepare.queue_time_us":14463,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":10160,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":42312,"thread_start_us":140805,"threads_started":1,"wal-append.queue_time_us":269553}
W20260709 13:16:34.336509 10087 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:16:34.322706  9883 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.681942  9883 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.684903  9959 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.687453  9959 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:34.671306 10000 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:34.690698 10000 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:34.619602 10071 consensus_meta.cc:287] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
I20260709 13:16:34.691697 10071 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.694613 10071 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:34.674067  9996 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.697343  9996 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:34.704563  8361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.002s	sys 0.006s
W20260709 13:16:34.705050  8361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.002s	sys 0.006s
W20260709 13:16:34.719363  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.015s	sys 0.020s
I20260709 13:16:34.719702 10100 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.748525 10100 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.751276 10100 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:34.755441  9883 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:34.047674  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:34.861672  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:34.862138  8261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.000s	sys 0.011s
W20260709 13:16:34.862757  8261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.000s	sys 0.011s
W20260709 13:16:34.865033  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.866158  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 207) took 1590 ms. Trace:
I20260709 13:16:34.866808  8217 rpcz_store.cc:276] 0709 13:16:33.275131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.488740 (+213609us) service_pool.cc:224] Handling call
0709 13:16:33.489036 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.658474 (+169438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.865441 (+1206967us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400198a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:34.865923 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388128640}
W20260709 13:16:34.869585  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.007s	sys 0.024s
W20260709 13:16:34.869783  8219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1263) took 1710 ms (client timeout 2005 ms). Trace:
W20260709 13:16:34.870253  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.007s	sys 0.024s
W20260709 13:16:34.870379  8219 rpcz_store.cc:269] 0709 13:16:33.159326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.175493 (+ 16167us) service_pool.cc:224] Handling call
0709 13:16:34.869241 (+1693748us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5400198f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:34.869588 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35553664}
I20260709 13:16:34.170053  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:34.873605  8216 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:16:34.874136  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.875360  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:34.875730  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:34.876770  8288 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.877211  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:34.877305  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:34.878450  8290 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:34.880122  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 208) took 1604 ms. Trace:
W20260709 13:16:34.880897  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.880734  8220 rpcz_store.cc:276] 0709 13:16:33.275668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.514278 (+238610us) service_pool.cc:224] Handling call
0709 13:16:33.514587 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.724090 (+209503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.879519 (+1155429us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54000357d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:34.879893 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480519424}
W20260709 13:16:34.719909  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.015s	sys 0.020s
W20260709 13:16:34.885438  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 830117us
I20260709 13:16:34.878216  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:34.880079  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:34.890887  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1258) took 1732 ms (client timeout 2269 ms). Trace:
I20260709 13:16:34.891553  9827 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.892660  9827 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:34.897156  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 900247us
W20260709 13:16:34.891551  8212 rpcz_store.cc:269] 0709 13:16:33.158035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.169570 (+ 11535us) service_pool.cc:224] Handling call
0709 13:16:34.877689 (+1708119us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:34.890764 (+ 13075us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16026880}
I20260709 13:16:34.878311  8289 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:34.914402  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:34.916146 10101 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:34.888435  9995 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:34.917721  9995 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:34.919735  8211 consensus_meta.cc:287] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.032s	user 0.007s	sys 0.003s
I20260709 13:16:34.920590  8211 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:34.916282  9986 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.922150  9827 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:34.926029  9935 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:34.926074  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:34.927142  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:34.928791  8293 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:34.930763  8293 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:34.930836  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:34.932227 10101 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:34.933763  9943 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:34.934712  9943 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.937511  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:34.938709  9959 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.939494  9959 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.941388  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:34.942267  9959 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:34.927246  9935 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:34.943460  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:34.943490 10060 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:34.944427  8365 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.945469  9935 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:34.946210  8290 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.925788  9986 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.949555  9963 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:34.950073  9995 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:34.950778  9986 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:34.951679  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 468) took 1359 ms. Trace:
I20260709 13:16:34.952239  8919 rpcz_store.cc:276] 0709 13:16:33.591752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.593039 (+  1287us) service_pool.cc:224] Handling call
0709 13:16:33.719778 (+126739us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:34.951064 (+1231286us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b54004817d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:34.951384 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196468736}
I20260709 13:16:34.950402  9963 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:34.954272 10101 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:34.954769 10101 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:34.955302 10101 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.956867  9963 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:34.958611  9962 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:34.958981  9962 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:34.922137  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 215) took 1053 ms. Trace:
I20260709 13:16:34.965122  8293 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:34.942955  9959 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:34.967397  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1165) took 1009 ms. Trace:
I20260709 13:16:34.968128  8293 rpcz_store.cc:276] 0709 13:16:33.956348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.931715 (+975367us) service_pool.cc:224] Handling call
0709 13:16:34.947332 (+ 15617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.965536 (+ 18204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.965987 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:34.964298  8211 rpcz_store.cc:276] 0709 13:16:33.869238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.886426 (+ 17188us) service_pool.cc:224] Handling call
0709 13:16:34.922051 (+1035625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:34.977329  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:34.978132  8367 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.980350  9946 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.982508  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:34.983328  8364 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.986581  8368 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:34.989208  9935 consensus_queue.cc:1059] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:34.993829  8293 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:34.995258  8290 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:34.996238  9962 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.003154  9962 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:35.008360  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 71086.7us
I20260709 13:16:35.009220  8288 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:35.013303  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1168) took 1043 ms. Trace:
I20260709 13:16:35.013895  8288 rpcz_store.cc:276] 0709 13:16:33.970233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.875159 (+904926us) service_pool.cc:224] Handling call
0709 13:16:35.013185 (+138026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.008136  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1174) took 1026 ms. Trace:
I20260709 13:16:35.024899  8293 rpcz_store.cc:276] 0709 13:16:33.975470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.993022 (+1017552us) service_pool.cc:224] Handling call
0709 13:16:34.993588 (+   566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.001633 (+  8045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.001778 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.015985  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:35.016616  8289 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:35.019196  9941 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.021214  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:35.021596  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:35.015733  9935 consensus_queue.cc:1243] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:35.037016  9935 raft_consensus.cc:3055] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:35.037511  9935 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:35.037807 10101 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.038570  9883 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:35.042232  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.043202  9883 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.043617  8365 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:35.039608  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:35.044317  9883 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.045154  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 467) took 1455 ms. Trace:
I20260709 13:16:35.045665  8927 rpcz_store.cc:276] 0709 13:16:33.589901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.606383 (+ 16482us) service_pool.cc:224] Handling call
0709 13:16:35.044730 (+1438347us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540062eb54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:35.044997 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565058944}
I20260709 13:16:35.046952  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:35.047123 10100 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.047703 10100 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.048170 10100 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.049316  9998 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:35.050853  9998 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:35.051239  9998 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:35.047108  9883 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:35.053455 10034 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:35.053658  8287 consensus_meta.cc:287] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.903s	user 0.009s	sys 0.005s
I20260709 13:16:35.054243  8287 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:35.055159  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1161) took 1120 ms. Trace:
I20260709 13:16:35.055512  8287 rpcz_store.cc:276] 0709 13:16:33.934319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.148856 (+214537us) service_pool.cc:224] Handling call
0709 13:16:35.055085 (+906229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.036167  8367 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:35.069845  8293 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:35.038697  9935 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.071118  8924 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
W20260709 13:16:35.071913  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 431) took 2108 ms (client timeout 2084 ms). Trace:
I20260709 13:16:35.072278  9935 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.076529  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:35.072455  8924 rpcz_store.cc:269] 0709 13:16:32.963605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.965781 (+  2176us) service_pool.cc:224] Handling call
0709 13:16:35.020881 (+2055100us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:35.071799 (+ 50918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22653184}
I20260709 13:16:35.073752 10099 raft_consensus.cc:2764] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:16:35.077461  8926 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:35.079113 10101 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.080200  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:35.075235  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:35.076006  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:35.076452  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1175) took 1094 ms. Trace:
I20260709 13:16:35.084493  8290 rpcz_store.cc:276] 0709 13:16:33.975806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.001549 (+1025743us) service_pool.cc:224] Handling call
0709 13:16:35.025259 (+ 23710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.069767 (+ 44508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.069797 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:35.069838 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:35.069863 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.069942 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.070050 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.088476 10106 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.091490  9963 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.085454  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:35.092376  8925 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:35.092273  9963 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.093504  9943 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:35.094944  9963 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.089813  8920 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
W20260709 13:16:35.095870  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.095135 10106 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.089303  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:35.090158  8892 leader_election.cc:336] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 3.058s (SENT)
I20260709 13:16:35.097028  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:35.097599  8919 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:16:35.097725  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.096382  8927 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.098802  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:35.104321  8364 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
W20260709 13:16:35.115866  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.119586  8926 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:35.127993  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.124688  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 103178us
I20260709 13:16:35.158802 10107 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.087839 10101 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.161125  8927 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
W20260709 13:16:35.107841  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.119045  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:35.097609  9734 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:35.170560  9973 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.170614  9963 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.172900 10107 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.188921  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.174775 10101 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.175366 10054 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:35.120164  8186 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:35.177170  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:35.177682  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1166) took 1220 ms. Trace:
I20260709 13:16:35.178282  9943 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.178417  9893 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.182163  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 203) took 1908 ms. Trace:
I20260709 13:16:35.183557  8362 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:35.184329  9998 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.186964  8361 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:35.130438 10106 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:35.200126  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.122997  9941 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.197935  8216 rpcz_store.cc:276] 0709 13:16:33.274154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.368310 (+ 94156us) service_pool.cc:224] Handling call
0709 13:16:34.872779 (+1504469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.874317 (+  1538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.181870 (+307553us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400198f50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:35.182083 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3408273280}
I20260709 13:16:35.101480 10100 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.204161  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.115641  9960 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.187906  9734 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:16:35.207477  8294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1163) took 1266 ms (client timeout 1520 ms). Trace:
I20260709 13:16:35.193740 10054 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:35.193457 10107 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:35.213577  8294 rpcz_store.cc:269] 0709 13:16:33.936604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.951828 (+ 15224us) service_pool.cc:224] Handling call
0709 13:16:35.118700 (+1166872us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:35.203167 (+ 84467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47035136}
W20260709 13:16:35.245048  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.235399  9893 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:35.250525  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:35.251346  8366 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.251151  9963 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:35.252424  9893 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:35.252945  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.253366  9963 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.253568  8295 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:35.253829  9943 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.254096  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:35.254927  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 58106.2us
W20260709 13:16:35.255182  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.255592  8220 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.252352  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.258529  9943 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.261551 10107 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:35.263043  8361 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:35.263170  9941 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.263751  9941 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.264153  9996 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.264595  9996 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.264932  9996 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.261619  8368 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:35.265786  9941 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:35.266507 10114 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.266654  9963 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:35.267061 10114 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.267261  9963 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.268425  9977 raft_consensus.cc:3055] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:35.268855  9977 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:35.269160  9963 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.269356 10107 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:35.270058  9977 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.270581  8360 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:35.270529 10107 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.271345 10061 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:35.273017  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 186420us
I20260709 13:16:35.269160 10114 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.266484  9941 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.274269  9941 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.274624  8186 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:35.275568  9962 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:35.276429 10114 consensus_queue.cc:1059] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:35.277465  9962 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:35.278363  9962 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:35.280380  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 103409us
I20260709 13:16:35.279837  9962 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.196914  8289 rpcz_store.cc:276] 0709 13:16:33.957267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.964090 (+1006823us) service_pool.cc:224] Handling call
0709 13:16:34.970941 (+  6851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.030982 (+ 60041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.177395 (+146413us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b540005a5d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:35.177600 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67711872}
I20260709 13:16:35.285171 10100 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.277534 10114 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:35.289774  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.256594  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:35.295501 10104 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.295810 10100 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.296152 10104 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.296463 10100 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.298419 10104 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.298481 10100 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.295604  9935 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.299503  9935 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.300894  8360 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:35.301203  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.303287  9935 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:35.303992  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.304369  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:35.310165  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:35.310487  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:35.311108  8216 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.311110 10104 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.311736 10104 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:35.312317 10104 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.315255  9935 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:35.316349  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.317003  9893 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:35.317627  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.317595  9893 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.318605  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.319650  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.320114  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.326589  9734 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.330016  8217 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:35.320842  9821 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.263211 10110 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.333305 10054 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.334448 10054 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.334007 10110 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.335883  8216 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:35.322145  8214 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:35.337210  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.316022  9935 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:35.337903  9935 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.338351 10034 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.337632  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.339844  8363 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:35.327484  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.295975 10101 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:35.311787  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 111921us
I20260709 13:16:35.341007 10110 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.327698  8366 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:35.331089  9963 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:35.342345  9998 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.263962 10105 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.343943  8369 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:35.321597  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:35.290589 10114 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:35.345498  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.346028 10114 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:35.347661  8219 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:35.351660  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.246722  9973 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.332585  9734 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.337297  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.324173  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:35.341248  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.346697  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.319859  9893 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.331099  9821 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.361349  9973 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.361732  9821 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.357983  8217 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
W20260709 13:16:35.364967  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 45428.8us
W20260709 13:16:35.364179  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.354221  8216 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:35.347884 10114 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:35.369940  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.364199  8212 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.370929  9893 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.379583  9893 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:35.380689  9893 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.382370  9821 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.383973  9977 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:35.386446  9821 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:35.377815 10105 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:35.388631 10105 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.391235 10105 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.378741  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.393479  8215 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:35.375550  9996 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.402105  9996 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.405368  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.406039  8295 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:35.408171  9688 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.411430  9941 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:35.413422  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.417163 10089 log.cc:927] Time spent T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.210s	user 0.007s	sys 0.008s
I20260709 13:16:35.417481  8220 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:35.417582  9947 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.418807  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 239) took 1506 ms. Trace:
I20260709 13:16:35.418884  9947 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.419373  8291 rpcz_store.cc:276] 0709 13:16:33.912057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.913168 (+  1111us) service_pool.cc:224] Handling call
0709 13:16:33.913464 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.913649 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.913681 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.914066 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.936733 (+ 22667us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:33.936774 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.943530 (+  6756us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.416368 (+1472838us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:35.418250 (+  1882us) raft_consensus.cc:1685] finished
0709 13:16:35.418281 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.418608 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214364544,"thread_start_us":20399,"threads_started":1,"wal-append.queue_time_us":292725}
W20260709 13:16:35.421151  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46867us
I20260709 13:16:35.421907  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.422587  8292 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
W20260709 13:16:35.424937  8292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1171) took 1453 ms (client timeout 1605 ms). Trace:
I20260709 13:16:35.425176  8212 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
W20260709 13:16:35.425655  8258 connection.cc:256] RPC call timeout handler was delayed by -1.1455815839999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 13:16:35.425812 10094 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.426455 10094 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.428834  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:35.428982 10034 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.429847  9869 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.429595 10034 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.430356  9869 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.433190  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.433736 10023 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.433917  8286 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:35.448102  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:35.434978  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.430207  8258 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:35.452168  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 60726.1us
W20260709 13:16:35.425266  8292 rpcz_store.cc:269] 0709 13:16:33.971626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.999022 (+ 27396us) service_pool.cc:224] Handling call
0709 13:16:35.424733 (+1425711us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002e8bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:35.424877 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3150563584}
I20260709 13:16:35.432425  9869 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.457628  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:35.459708  8926 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:35.434222 10023 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.387552  9935 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:35.460465  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 50194.4us
I20260709 13:16:35.428849 10094 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.487978  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.488876  8290 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:35.464339 10023 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.459350 10101 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.490226 10034 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.500885  9986 raft_consensus.cc:2764] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:35.506678  9964 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:35.497587  9821 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:16:35.508682  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:35.509197  9947 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.510170  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:35.503533 10098 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:35.498731  9688 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.511790  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.512279  9688 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.492677  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:35.513401  8919 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:35.493577 10099 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.512284  9981 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.514251 10099 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.511507  9963 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.514732 10099 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.515034  9963 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.517114  9963 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.512797  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.465340 10105 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:35.498613  9869 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:35.517874 10105 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.518023  9869 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.519819 10105 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.497362  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.520380 10105 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.520567  8213 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:35.521068 10105 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.521711  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.522706  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.523187 10105 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.523610  9821 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.523983  9883 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:35.524730  9883 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:35.525424  8920 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:16:35.502996  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 72872.6us
I20260709 13:16:35.519812  9869 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.526432 10101 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:35.527769  8286 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.522662  8186 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:35.505380  8116 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46486 (request call id 266) took 8327 ms. Trace:
I20260709 13:16:35.528735  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.529006  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.529621  8295 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:35.530128  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.528777 10104 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.530870  8291 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:35.531656  8214 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:35.532160 10104 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.532810 10104 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.533241 10104 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:35.533883  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.534111 10104 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.534855  8365 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:35.534938  8364 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:35.535975  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.536662  8367 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:35.533936  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.537086  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.537360  9973 consensus_queue.cc:1059] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:35.537715  8366 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:35.538544 10100 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.538793  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.538993 10100 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.539283  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:35.539358 10100 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.539542  9943 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.514325  9688 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.510095  8369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:35.540184  8290 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:35.540220  9943 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.524204  9821 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:35.540747  9943 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.513402 10098 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.541625 10098 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:35.541577  9821 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.525656  9883 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:35.547688  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.548760 10101 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:35.539736  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.544195 10025 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.544824  8261 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.543035 10098 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.559053  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.559901  8367 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:35.563582  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.565658  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.566601  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.567338  8290 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:35.568682 10101 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:35.568763  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.569036  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.569205 10101 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.569608 10101 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:35.572973  8366 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:35.576402  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:35.580179  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.589139  9973 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.589919  9973 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.592056  9947 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:35.592756  9947 raft_consensus.cc:697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:35.593818  9947 consensus_queue.cc:237] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.604239  8117 catalog_manager.cc:5697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.529249  8116 rpcz_store.cc:276] 0709 13:16:27.177638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.177858 (+   220us) service_pool.cc:224] Handling call
0709 13:16:35.505132 (+8327274us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:31.652201 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:31.733584 (+ 81383us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:31.736092 (+  2508us) write_op.cc:435] Acquired schema lock
0709 13:16:31.738386 (+  2294us) tablet.cc:662] Decoding operations
0709 13:16:32.010306 (+271920us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:32.010366 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:32.010395 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:16:32.168871 (+158476us) tablet.cc:701] Row locks acquired
0709 13:16:32.168901 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:16:32.195505 (+ 26604us) write_op.cc:270] Start()
0709 13:16:32.208559 (+ 13054us) write_op.cc:276] Timestamp: P: 1783602992192197 usec, L: 0
0709 13:16:32.208613 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 13:16:32.319872 (+111259us) log.cc:844] Serialized 4342 byte log entry
0709 13:16:33.257854 (+937982us) op_driver.cc:464] REPLICATION: finished
0709 13:16:33.386104 (+128250us) write_op.cc:301] APPLY: starting
0709 13:16:33.386205 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:33.386442 (+   237us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:33.386556 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:33.387993 (+  1437us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:33.388337 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:16:33.388380 (+    43us) write_op.cc:312] APPLY: finished
0709 13:16:33.388683 (+   303us) log.cc:844] Serialized 83 byte log entry
0709 13:16:33.395167 (+  6484us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.410710 (+ 15543us) write_op.cc:454] Released schema lock
0709 13:16:33.415321 (+  4611us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:33.439643 (+ 24322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.441820 (+  2177us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":83818,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":126790,"apply.run_cpu_time_us":3521,"apply.run_wall_time_us":45906,"num_ops":11,"prepare.queue_time_us":370057,"prepare.run_cpu_time_us":47074,"prepare.run_wall_time_us":1143769,"raft.queue_time_us":150877,"raft.run_cpu_time_us":39471,"raft.run_wall_time_us":91663,"replication_time_us":1038688,"thread_start_us":725377,"threads_started":4,"wal-append.queue_time_us":642645,"wal-append.run_cpu_time_us":22565,"wal-append.run_wall_time_us":1420213}]]}
I20260709 13:16:35.612450  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.613498  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.614363  8360 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:35.615249  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.617928  8364 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:35.566015 10025 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:35.619493 10025 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.607200  8117 catalog_manager.cc:5697] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.620415  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.622937  9935 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.633316  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.634022  8360 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:35.577255  9893 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.624148  8117 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1), VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2), VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3), NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:35.643114  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:35.580183 10105 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.646821  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:35.651227  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 114969us
W20260709 13:16:35.652245  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 73496us
I20260709 13:16:35.658030  8928 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:35.644874  9893 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:35.662992  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.661355  8117 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 1 to 3, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:35.666967  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 156939us
I20260709 13:16:35.667866  8183 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:35.647624  9996 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:35.676343  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.668967  8183 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:35.674343  8117 catalog_manager.cc:5697] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 1 to 2, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.665977  9893 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.656140  9935 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:35.697125  8216 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:35.699817  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:35.676911  9977 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:35.703835  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.704569  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.677551  9973 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.669207 10106 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:35.705382  8295 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:35.690297 10105 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:35.709649  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:35.708434  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 140982us
I20260709 13:16:35.691066  9964 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:35.711480  8919 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:35.676018 10107 consensus_queue.cc:1059] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:16:35.714143  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:35.711606  9978 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:35.715385  8292 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:35.714434  8889 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:35.699373  9821 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.709488  8214 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:35.707332  9977 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.723469  8295 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:35.708039  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:35.711628  8286 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:35.727279 10107 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:35.727728 10107 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:35.727662  9943 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.724625  9977 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.726791  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:35.728962  8363 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:35.729266  8216 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:35.729719  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:35.715055 10105 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.709239 10106 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:35.732733  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:35.735005  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.735105 10105 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.737247 10114 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:35.741267  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.720597  9821 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:35.747277  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.712767  9996 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.774777  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.775112  8889 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:35.775548 10132 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:35.775674  8292 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:35.771981  8216 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.779824  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.747440  9821 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.784372  8216 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:35.787642  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:35.788277  8213 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.768903 10110 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.770310  8920 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.780452  8295 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:35.791617  9935 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.793875  8286 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:35.794059 10130 log.cc:927] Time spent T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:35.758975 10137 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:35.794766  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.741415 10099 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.795732  9978 consensus_queue.cc:1059] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:35.795949  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 47035.5us
I20260709 13:16:35.799675  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.832430  8290 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:35.799753  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.801378  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.833720  8363 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:35.834466  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.803874  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.807096  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.835703  8216 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:35.792065 10110 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.798375  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.798028 10104 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:35.822767  9935 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.839221  8889 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:35.797216  9996 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.835089  8295 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:35.844422  8369 raft_consensus.cc:606] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:35.844801  8369 raft_consensus.cc:614] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:35.838928  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:35.847535  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:35.842970 10110 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.796036 10100 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.802102 10123 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:16:35.854138  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.852864  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.845155  9935 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:35.846314  9978 consensus_queue.cc:1243] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:35.864862  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:35.797473 10106 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.874292  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:35.877830  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:35.883824  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.845839  9977 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.886597  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:35.887296  8291 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.838538 10137 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.882951  9943 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:35.899611 10139 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:35.900416  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.901271  8218 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:35.902992 10140 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.910802  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.912036  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.912693  8215 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:35.913556  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.914572  9947 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.915108  9947 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.917281  9947 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:35.918395  9998 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:35.917964  9821 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.918766  9998 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:35.920342  8361 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:35.921273  8211 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:35.860309 10023 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.885424 10106 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.929862  8213 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:35.886365 10135 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.937222  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.937667 10135 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.935746  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.938647  8218 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:35.939709 10135 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.938148  8215 raft_consensus.cc:2410] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:35.946513  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:35.933391  8360 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
W20260709 13:16:35.917979 10129 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:16:35.876753 10104 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:35.887897  9964 consensus_queue.cc:1175] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:16:35.940838 10136 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:16:35.941696  9973 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.942641  8186 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:35.942749  9978 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:35.935129 10147 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:35.937095  9977 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.944460  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:35.946980  8295 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:35.951875  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.971060  8219 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:35.964180  9893 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:35.964886 10023 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:35.919699  9998 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:35.969060  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.976811  8362 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:35.991742  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:35.992309  8366 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:35.992671  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.993247  8290 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:35.969633 10135 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:35.995694  8213 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:35.968552  9978 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.998037  8364 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 5. Ops: []
I20260709 13:16:35.970088 10147 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:35.998406  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 64494.1us
I20260709 13:16:35.954053 10101 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:35.953953 10139 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:16:35.985832  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:36.009881  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:35.988583  9996 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:35.994920  9821 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:36.002174  9998 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.002873  9978 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.016510  8367 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:36.018307  8366 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:36.000598  9869 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:36.002521 10147 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.017122  8211 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:36.020511 10149 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.020927  9893 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.021370 10101 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:36.051961 10149 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.054286 10149 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.021835  8920 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:36.023622 10137 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:36.024142  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 81595.9us
I20260709 13:16:36.024441  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.027014  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.027556 10100 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:36.027664  9935 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.032984  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.034737  8292 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:36.036968  8362 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.037559  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.038030  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.038669  8289 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:16:36.042027  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.044974 10104 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.014215 10099 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:35.995180  9973 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.050802  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:36.059834  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:36.059620  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 212268us
W20260709 13:16:36.063171  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 52651.4us
I20260709 13:16:36.067414  8295 raft_consensus.cc:2410] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:16:36.070806  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.063774  9996 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:36.066653 10106 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:36.074672  8291 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:36.075707 10025 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.068800  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.082257  8366 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:36.084156 10106 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:36.084883  8261 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:36.085223  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:36.085924  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:36.065074  8365 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.079929  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:36.089116  8362 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:36.090042 10098 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:36.090569  9947 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.091090  9947 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:36.091542  9947 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.091583 10098 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.084527 10106 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:36.095185  8367 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:36.092139  9977 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:36.099480  9977 raft_consensus.cc:697] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:36.100507  9935 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.101567  9973 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:36.102622 10138 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.306s	user 0.000s	sys 0.003s
I20260709 13:16:36.079263 10025 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.103446 10025 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.105546 10107 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.106844 10107 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.111137  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:36.077497 10104 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.114161 10023 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:36.114565 10023 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.114882 10023 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.116865 10110 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.113668  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:36.119004 10110 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.119285 10061 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.124157 10137 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:36.124768 10137 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:36.125663 10142 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:16:36.125779 10137 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.128969  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.130095  8924 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:36.131574  9977 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.136765  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.137588  9963 raft_consensus.cc:2764] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:36.137969  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.138319  9963 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.139038  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:36.111901 10149 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.144346 10149 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.144204 10105 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.144837 10149 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.113646 10104 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:36.144901 10146 log.cc:927] Time spent T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.209s	user 0.004s	sys 0.000s
I20260709 13:16:36.142551  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.146929  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.148674  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:36.151286  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.152477  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.153182  8367 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:36.153831  8364 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.154224  8366 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:36.155773  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.156451  8291 raft_consensus.cc:2393] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:36.157096  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.157542  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:36.158293  8928 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:36.158588  9734 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:36.159092  9734 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.160157 10114 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.160539 10114 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:36.160935 10114 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.161217  9734 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.163419 10105 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.164110 10123 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.151067 10104 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.164842 10123 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.165222 10123 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.165575 10123 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.152516  9964 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:16:36.145450 10101 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.145706  9973 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:36.169864 10101 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:36.170279 10101 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.145565  9981 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:36.174088 10106 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.153007 10061 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:36.147594  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:36.204995  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 49115.6us
W20260709 13:16:36.204950  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 57440.2us
W20260709 13:16:36.206328  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.215812  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 64450.8us
I20260709 13:16:36.216610  8363 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:36.217092  8368 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:36.221894  8928 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:16:36.223376  8261 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:36.223050  8186 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:36.204371 10106 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.225356  8369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:36.225948  8369 raft_consensus.cc:606] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:36.226372  8369 raft_consensus.cc:614] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:36.213181  9869 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:36.216614  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:36.215167  9734 consensus_queue.cc:1059] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:16:36.235276  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 84049us
I20260709 13:16:36.228685  9869 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.237041  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:36.239744  8928 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.226151  9963 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:16:36.234755  9981 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:36.220698  9978 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.234755  8924 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.244110  8183 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.248353  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.241057  9981 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.241742  9869 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.239185 10054 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:36.252959  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.253263  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.253684  8369 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.236524  9962 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:16:36.247514  9734 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.242568  9964 consensus_queue.cc:1059] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:16:36.260325  8919 raft_consensus.cc:2368] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:36.280136  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.278422  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.251713  9981 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:36.287959  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 71751.7us
I20260709 13:16:36.286785  8366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:36.289615  8366 raft_consensus.cc:606] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:36.294621  8924 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:36.281032  9977 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:36.294301 10025 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.295862  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.297047  9978 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:36.297286 10025 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.251303 10105 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:16:36.297919  9964 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.300573  9964 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:36.300676  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.301389  9964 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.302532  9964 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.302760 10101 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.303550  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.298596 10174 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.304595  8361 raft_consensus.cc:2410] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:36.304648 10174 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.305199 10174 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.306018  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.306622  8923 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:36.307682  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.308315  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.309552  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.310601  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.310750  9996 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.311162  9996 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:36.262292 10169 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:36.264156 10098 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.301605  8921 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:36.299721  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.311254  8360 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:36.255406  9734 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:36.328853  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.332296 10147 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.333047  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:36.349359  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.333961 10023 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.341495  9962 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:36.352219  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 128900us
I20260709 13:16:36.350545  8360 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:36.357522  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.358103  8362 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:36.358805  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.359233  8362 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.344719  8928 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:36.345304  8369 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:36.359920  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.361394  8363 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:36.362258  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:36.345487  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 55207.9us
I20260709 13:16:36.363194  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:36.364954  8186 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:36.373934  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.380244  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.381002  8360 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:36.315343 10169 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.308359  8922 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:36.380638  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:36.382046  8364 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:16:36.386584  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.387727 10061 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.387914  9962 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.388190 10061 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.388677 10061 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.388711  9962 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:36.384415  9964 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:36.389891  9964 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.390208  9964 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.391568  8365 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:36.394176 10023 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.394637 10101 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:36.315137  9996 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.395990  9996 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.399379 10147 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.384500 10169 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.401589  9964 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.410346 10171 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.410818 10171 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:36.411809 10171 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.403855  9964 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.413084 10171 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.415129 10061 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.400547 10105 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:36.427223 10105 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:36.428236 10105 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.428740  8365 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.429833  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.430058  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.431185  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.432334  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.432016  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.433270  8364 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.433707  8369 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:36.431589  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:36.434461  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 69631.2us
I20260709 13:16:36.441116  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.444959  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:36.445773  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:36.445274  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:36.446193  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.447551  8218 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:36.417176  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.448486  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:36.448555  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:36.448836  8292 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.449066  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.449601  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:36.449872  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.450253  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.450654  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:36.450826  8290 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.451061  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:36.451246  9977 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:36.451758  9977 raft_consensus.cc:697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:36.452311  8217 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.453176  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:36.453550  8294 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.453902  8921 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:36.450847  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:36.454792  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.454943  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.455152  8215 raft_consensus.cc:2410] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:36.455603  8921 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:36.449312  8360 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.450455  8214 raft_consensus.cc:2410] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:36.456892  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.457640  8928 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:36.450009  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.459794  8290 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:36.456199  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.462669  8369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bded28881ef4440a713698e8088bd77"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:36.471052  8369 raft_consensus.cc:606] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:36.471387  8369 raft_consensus.cc:614] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:36.449131  8219 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:36.391829  9869 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.404657  9734 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.430379  8365 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.452677  9977 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:36.473843  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 93269.3us
W20260709 13:16:36.475068  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.449962  8361 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:36.436592 10147 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:36.486991  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:36.445631  9996 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.487804  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:36.479398  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 127807us
I20260709 13:16:36.489130  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:36.479791  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:36.489879  8183 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.490585  8213 raft_consensus.cc:2410] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:36.480967  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:36.431118  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:36.405907 10123 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.463184 10098 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.492426  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:36.512393  8219 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.493180  8218 raft_consensus.cc:2410] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:36.498277  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.513515  8366 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.433837 10114 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.515684 10114 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.510205  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:36.484978  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:36.531132  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:36.534809  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 49932.1us
I20260709 13:16:36.537446  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.537588  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:36.545598  8213 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:36.538364  8292 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:36.509167  9998 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.564713  8218 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:36.568279  8183 leader_election.cc:400] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
I20260709 13:16:36.568662  8183 leader_election.cc:403] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:36.531433 10147 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:36.546819  9734 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.600616  8364 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:36.539094  9935 raft_consensus.cc:2764] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:16:36.616160  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.617408  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:36.617656 10107 consensus_meta.cc:287] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.001s
I20260709 13:16:36.618054  8294 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:36.618995  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.618803 10147 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.620378  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.620945  8289 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.621661  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:36.621740  9981 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:36.622857  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 69998.3us
I20260709 13:16:36.559791 10114 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.512724  9996 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.537679 10181 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.551492 10098 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.609879  8361 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:36.538895  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:36.609776  9991 consensus_queue.cc:1059] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:16:36.553864 10186 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:36.612309  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.612980  9869 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.613116  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:36.615914  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 63642.8us
I20260709 13:16:36.624600  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.623670  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:36.627885  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.628218  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.629467  8215 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:16:36.642328  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.537329 10104 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:36.636850  8360 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:36.631464  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.626746  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.685719  8362 raft_consensus.cc:2410] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:36.732741  8293 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.626742  8926 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:16:36.731262  8287 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:36.733484  8926 pending_rounds.cc:85] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 5
I20260709 13:16:36.735924  8294 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:36.639590  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.630988  8366 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:36.627112  8217 raft_consensus.cc:2410] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:36.665977  8219 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:36.727231  8215 pending_rounds.cc:85] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 1
W20260709 13:16:36.731877  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 259744us
I20260709 13:16:36.624291  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:36.738457  8295 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:36.738979  8367 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:16:36.739568  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.624624 10114 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.624779 10183 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:16:36.627036  9947 consensus_meta.cc:287] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
W20260709 13:16:36.740566  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 116979us
I20260709 13:16:36.743840  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.627877 10101 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.739464  8367 pending_rounds.cc:85] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 5
I20260709 13:16:36.752956  8367 pending_rounds.cc:107] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:16:36.753067  8219 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:36.753243  8367 raft_consensus.cc:2889] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:36.628818 10123 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.630647 10098 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.736181  8926 pending_rounds.cc:107] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:16:36.737810  8215 pending_rounds.cc:107] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:36.624017  9981 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.757114  8926 raft_consensus.cc:2889] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:36.626343  9996 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.758405  8215 raft_consensus.cc:2889] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:36.730331  9964 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:36.644034 10160 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.731529 10171 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:36.627485  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.744272 10110 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:36.742718  8212 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.788028  8892 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:36.803753  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:36.805557 10163 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:36.788846  8287 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:36.740015 10191 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.347s
I20260709 13:16:36.790781 10104 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.766942 10114 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.808632  8219 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:36.809798 10114 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.759856  9947 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:36.812011  9947 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.785526  9964 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.813479  8212 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:36.814375  9964 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.795634 10160 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:36.815150  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:36.815387 10160 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:36.759652 10101 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.815950 10160 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:36.819391  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:36.838222  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.844767 10171 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.768131 10061 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.869206  8366 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:36.871587  8295 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:36.889355  8186 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:36.893237  8293 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:36.787607  9981 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:36.910421 10110 consensus_queue.cc:1059] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:36.909287 10163 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:36.911186  9991 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:36.911806  9991 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.913961  9991 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:36.914043  9963 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:36.914502  9963 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:36.914224  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:36.914711  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:36.915007  9963 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:36.915304  8922 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:36.915340  8286 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
W20260709 13:16:36.917490 10184 log.cc:927] Time spent T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:16:36.918947 10101 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.920382 10171 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:36.922519 10183 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4.
W20260709 13:16:36.922955  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.820154  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:36.927826  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.934262  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.931945  8213 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:36.903806 10061 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.940286  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:36.943905  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:36.926937  9977 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.925369  9991 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.931963 10187 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:36.958268  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:36.939656 10169 consensus_meta.cc:287] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.003s
I20260709 13:16:36.967784  8365 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:36.974246  8213 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:37.020416  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.021688  8360 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:37.035771  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:36.937227  9981 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.036616  8367 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:37.037293  8365 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:36.966570  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:36.951836 10061 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:36.956199 10163 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:16:37.052912  8287 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:36.957532  9977 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:37.018096 10149 consensus_meta.cc:287] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.825s	user 0.011s	sys 0.000s
I20260709 13:16:36.974289  8289 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:36.960855  9991 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.055037  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:37.079744  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.972316 10169 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:37.056650 10174 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.751s	user 0.007s	sys 0.004s
W20260709 13:16:37.090202  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.978968 10187 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.056320  8923 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.061990  9935 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.094396  8183 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.083679  8921 raft_consensus.cc:3055] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:37.105832  8220 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:37.087121 10171 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.052014  9947 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:16:37.057346 10186 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:37.092237  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.086452 10149 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.107864 10104 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.095412 10174 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.110155  8921 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:37.119462  8286 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:37.119817 10100 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:37.156190  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:37.160605 10100 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.161940  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.162626 10100 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.163165  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.163636  8219 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:16:37.170751 10201 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:16:37.173445  8183 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.170377 10101 consensus_queue.cc:1059] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:37.175218 10101 raft_consensus.cc:3055] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.175297  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.175613 10101 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:37.175890  8287 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:37.176194  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:37.176755  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.177014  8368 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:37.113511  9973 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:16:37.177733  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.179610 10169 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.181800 10187 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:37.185037  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.016s	sys 0.053s
W20260709 13:16:37.185415  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.017s	sys 0.054s
W20260709 13:16:37.185734  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 806248us
I20260709 13:16:37.185858 10101 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.187282 10101 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.189252  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:37.189898  8927 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.191834 10061 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.175900  8921 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:37.194352  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.194716  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.196127  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.113770 10171 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.200661 10104 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.206419 10171 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.208009  8216 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:37.208531 10100 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:37.208938 10100 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:37.209296 10100 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:37.210039  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 53983.7us
I20260709 13:16:37.210930  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:37.212227 10137 raft_consensus.cc:2764] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:37.212776  9977 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.146214  9947 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.214097  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:37.213661  8292 consensus_meta.cc:287] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.001s
I20260709 13:16:37.158792  8288 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:37.151120  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.227946  8292 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:37.232295  8293 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:37.228291  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:37.233345  8928 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEARNER]: Advancing to term 6
I20260709 13:16:37.200568  9996 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:37.220499  9734 consensus_meta.cc:287] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.002s
I20260709 13:16:37.253890  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.228883  8921 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.224336 10137 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:37.257622  8183 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.271073  8367 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:37.224779  8920 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:37.225333 10198 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:37.263967  8215 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:37.277408  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.292133  8928 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:37.281291  8927 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
W20260709 13:16:37.261672 10175 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.707s	user 0.003s	sys 0.005s
W20260709 13:16:37.281471  8332 consensus_peers.cc:597] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d3403855d4147a9b056dc8678880fdf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:37.300822  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.301600  8928 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:37.301514  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:37.300885  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 44274.8us
I20260709 13:16:37.303114  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:37.303920  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.257939  9981 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.212031  9963 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.256747 10211 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:37.292457 10204 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.253993  8289 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:37.259861 10174 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.259081  8922 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:37.258678  9991 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.312002  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.281852 10061 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.330420 10061 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.332077  8892 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:37.332834 10163 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.332952 10061 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.249782  9947 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.333560 10163 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:37.334116 10163 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:37.335371  9947 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.276206 10025 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:37.336078 10025 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.336637  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.336913  8892 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:37.338020 10025 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.281057  9977 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:37.338589  9977 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.338975  9977 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.339223 10107 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.340417  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.341444  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.338768 10110 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:37.342751  8923 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:37.343245 10110 raft_consensus.cc:697] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:37.314579  8216 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:37.344282 10110 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.321925 10177 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.346230 10177 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.348393 10177 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.335397  8214 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:37.350687  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.351045  9935 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.338721  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:37.354329  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:37.327582  8291 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:37.322198 10187 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:37.357965 10187 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.358355 10187 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.358568  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.358906  9977 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.335034 10163 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.363533  9963 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.364198 10174 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.364468  8213 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.364712 10174 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.308468  9964 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.329030  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:37.366607 10177 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.361123  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 451) took 1144 ms. Trace:
I20260709 13:16:37.306519  9996 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:37.360457  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.377100  8928 raft_consensus.cc:2410] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:37.378325  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.379113  8928 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:37.357559 10107 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:37.366153  8215 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:37.270220 10100 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:37.386950  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.395917  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.402680  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:37.404573  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 75670.9us
I20260709 13:16:37.410501  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.366716 10174 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.409852 10107 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:37.281073 10186 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:37.449054  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.459064  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:37.459882  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.407899 10025 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.467041  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.470729  9963 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:37.471796  9947 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:37.472879 10061 raft_consensus.cc:2764] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:37.474609  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:37.476982 10023 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:37.477459 10023 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:37.477864 10023 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.471501  9963 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.424947  9977 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.424315  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:37.400910 10177 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.497726  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:37.490038  8921 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:37.366649 10204 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.499301 10137 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:16:37.499362 10023 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.496840  8923 raft_consensus.cc:2376] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4. Re-sending same reply.
I20260709 13:16:37.515529 10137 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:37.526875 10100 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.528244 10023 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.532451  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.534071 10163 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:37.535117 10163 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:37.535962 10163 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.541263 10177 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.541464  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:37.541973 10203 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:16:37.516671  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:37.521440  9998 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 13:16:37.552615  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 53711.2us
I20260709 13:16:37.504963 10211 consensus_queue.cc:1059] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:16:37.555869  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:37.552718  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.514248 10061 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:16:37.559201  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:37.562314  8295 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:37.562777  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.563963  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.552171 10137 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:37.524061 10187 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.557569 10226 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:37.577970 10226 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:37.564208  9734 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.376605  8925 rpcz_store.cc:276] 0709 13:16:36.216833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.217942 (+  1109us) service_pool.cc:224] Handling call
0709 13:16:36.219412 (+  1470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.219797 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.219831 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.220340 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.381127 (+160787us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:36.537484 (+156357us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.559944 (+ 22460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.572358 (+ 12414us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.260454 (+688096us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b1800466240. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa2f22a6 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db
0709 13:16:37.261062 (+   608us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:37.360885 (+ 99823us) raft_consensus.cc:1685] finished
0709 13:16:37.360912 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.361046 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":342758,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":9715,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":44541,"spinlock_wait_cycles":76883712,"thread_start_us":254644,"threads_started":2,"wal-append.queue_time_us":242227}
I20260709 13:16:37.580535  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.588598  8288 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.589723  9977 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:37.524289 10107 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.591969 10137 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.586303 10204 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.551688  8212 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:37.556006 10177 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:37.594940  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:37.571400  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.596844  8294 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.572969  9963 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:37.574396 10216 log.cc:927] Time spent T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:37.574218 10160 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:37.575162 10213 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:16:37.575423 10100 raft_consensus.cc:2764] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:37.600716  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1188) took 1123 ms. Trace:
I20260709 13:16:37.623956  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.604861  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:37.561575 10025 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:37.618655  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:37.623577  8290 rpcz_store.cc:276] 0709 13:16:36.477738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.477885 (+   147us) service_pool.cc:224] Handling call
0709 13:16:36.478285 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:36.560563 (+ 82278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.560608 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:36.639191 (+ 78583us) log.cc:844] Serialized 52 byte log entry
0709 13:16:37.267119 (+627928us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b180031eca0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:16:37.531945 (+264826us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:37.531998 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.532105 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.576555 (+ 44450us) raft_consensus.cc:1685] finished
0709 13:16:37.576584 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.600647 (+ 24063us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15119,"raft.queue_time_us":165659,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":89872,"spinlock_wait_cycles":6694656,"thread_start_us":337949,"threads_started":2,"wal-append.queue_time_us":833386}
I20260709 13:16:37.587538  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.587735 10187 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:37.613241 10177 raft_consensus.cc:697] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:37.632782 10225 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:37.633510 10177 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.633726 10226 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.619544 10110 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.626276 10203 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.635393 10160 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.648730 10225 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:37.649230 10225 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:37.650146 10225 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:37.650743 10180 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.813s	user 0.006s	sys 0.008s
I20260709 13:16:37.653728 10203 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.641346 10025 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:37.656096 10110 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.657954  8293 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:16:37.658347  8293 pending_rounds.cc:85] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 4
I20260709 13:16:37.658692  8293 pending_rounds.cc:107] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:37.658955  8293 raft_consensus.cc:2889] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:37.632378 10163 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:37.667407  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.668390  8290 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:37.670109  8923 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:37.671556  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:37.677120  8923 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.677361  9991 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:37.678141  9991 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.680776  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1168) took 1143 ms. Trace:
I20260709 13:16:37.681226  8220 rpcz_store.cc:276] 0709 13:16:36.537028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.541578 (+  4550us) service_pool.cc:224] Handling call
0709 13:16:36.562928 (+ 21350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.108219 (+545291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.680444 (+572225us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54001d4f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:37.680699 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248117504}
W20260709 13:16:37.683300 10196 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.822s	user 0.004s	sys 0.010s
I20260709 13:16:37.685099  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1768) took 1342 ms. Trace:
I20260709 13:16:37.685647  8363 rpcz_store.cc:276] 0709 13:16:36.342646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.363271 (+ 20625us) service_pool.cc:224] Handling call
0709 13:16:36.363673 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.417979 (+ 54306us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:16:36.418026 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.464959 (+ 46933us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.732422 (+267463us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:36.732462 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.737530 (+  5068us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.682548 (+945018us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:37.684803 (+  2255us) raft_consensus.cc:1685] finished
0709 13:16:37.684823 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.685020 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22054,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":76,"spinlock_wait_cycles":103582976,"thread_start_us":227768,"threads_started":1,"wal-append.queue_time_us":373868}
I20260709 13:16:37.686944  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1181) took 1254 ms. Trace:
I20260709 13:16:37.687400  8291 rpcz_store.cc:276] 0709 13:16:36.432399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.433100 (+   701us) service_pool.cc:224] Handling call
0709 13:16:37.686768 (+1253668us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54001004d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:37.686888 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874482048}
I20260709 13:16:37.685070  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.688724  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.689354  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.690102  8927 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
W20260709 13:16:37.690907  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.691790  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:37.689421  8919 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:37.696624  8365 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:37.697167 10208 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.697587 10208 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:37.697759  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.698457 10208 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.699635 10208 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.701221  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.681248  9991 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.702106  8928 raft_consensus.cc:2410] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:37.703490  8928 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:37.703428  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.664364 10203 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:37.704159  8922 raft_consensus.cc:2376] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5. Re-sending same reply.
I20260709 13:16:37.704406  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:37.645666  8286 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.705013  8368 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.698980  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.709424  8927 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:37.647244 10226 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.716801 10230 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.724936  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 494) took 1589 ms. Trace:
I20260709 13:16:37.714239 10163 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:37.726868  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.657538 10025 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.734066  8364 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:37.735280  8367 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:37.735932  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:37.736020  8928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:37.744290  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.751371  8928 raft_consensus.cc:606] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:37.751776  8928 raft_consensus.cc:614] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:37.746965  8368 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:37.727355 10193 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.755072  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:37.746469  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.759850  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:37.762780  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:37.763728  8216 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:37.774807  8366 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:37.782191  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:37.786288  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:37.787071  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.789959  8219 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:37.790396  8213 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:37.791199  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:37.791647  8217 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:37.789287  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:37.794528  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.798591  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.799232  8287 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
W20260709 13:16:37.768930  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.802898  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:37.803663  8368 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.804456  8216 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:37.757575  9734 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:37.767771  9963 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.787556 10174 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.789186 10110 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:37.823432  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.809324  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:37.817862  9964 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.873374  8218 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:37.842222  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:37.749876 10230 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:37.822640  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.744174  8920 rpcz_store.cc:276] 0709 13:16:36.135168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.138620 (+  3452us) service_pool.cc:224] Handling call
0709 13:16:36.138930 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.298649 (+1159719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.724731 (+426082us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540065f4d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:37.724886 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342317824}
I20260709 13:16:37.846151  8219 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:37.846573  8295 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:37.847159  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.790099  8923 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:37.825918  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:37.876091  8287 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:37.850085  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:37.854426  9991 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:37.857401  8220 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:37.860430  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.888902  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:37.861644  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1151) took 1430 ms. Trace:
I20260709 13:16:37.866756  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:37.868538 10233 log.cc:927] Time spent T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:16:37.869346  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:37.869593  8215 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:37.820935  9963 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.862097  8368 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:37.788403 10193 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.886678  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:37.847168 10149 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:37.860891 10163 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:37.870991  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:37.906913  8218 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:37.889268  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.901719  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:37.897176  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:37.906950  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:37.912535  8220 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:37.832458 10174 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.906967  8214 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:37.916159  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.922611  8295 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.902223  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:37.886467  8289 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:37.926508  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:37.927201  8218 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:37.913095  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:37.895171 10181 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:37.915722  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:37.933032  8215 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:37.920646  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.921972  8216 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:37.925149  8291 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:37.906219 10061 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:37.917011  8212 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:37.911228  9978 raft_consensus.cc:3055] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.877915  9964 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:37.942989  8295 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:37.949405  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:37.904796 10186 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:16:37.911435 10198 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:16:37.963963  9963 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.965974 10101 raft_consensus.cc:3055] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:37.966411 10101 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:37.960320  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.911124  9962 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:37.893914  8211 rpcz_store.cc:276] 0709 13:16:36.431689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.436353 (+  4664us) service_pool.cc:224] Handling call
0709 13:16:37.861426 (+1425073us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400199e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:37.861584 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046910208}
I20260709 13:16:37.932618 10181 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:37.944710  9947 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:37.929523  8288 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:37.969580  8217 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:37.981271  8291 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:37.972949  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:37.993310  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.995008  9964 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:37.950744  9978 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:37.996431  8219 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:37.973493  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:37.944484 10061 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.014031 10061 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.016196  9978 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.017481  9978 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.007126  8294 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:38.022248 10061 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.023587  8287 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:37.990695  9977 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:37.990608  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:38.008564 10181 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:38.033943  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 429162us
I20260709 13:16:37.972559 10106 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:38.034801  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:37.967303 10101 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:38.042728  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:38.043810  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:38.027719  9947 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:38.029956  9977 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.063313  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:38.044898 10225 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:38.049595  8289 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:38.047719 10226 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:38.048928  9977 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.068852 10101 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.070986 10100 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.082410  9947 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.075037 10230 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:38.077716 10225 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:38.079643 10211 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.112480  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:38.078887 10105 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.076282 10226 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:38.122181  8366 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:38.122965  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.126602  8365 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:38.129336  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.132237  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.133533  8367 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:38.141144  8365 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:38.127830  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:38.090411 10100 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:38.092487 10193 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.090480 10107 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:38.125777 10226 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.148849  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.116873 10174 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.133893  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:38.153821  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 364783us
I20260709 13:16:38.146298  8364 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:38.142472 10211 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:38.171320  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 279188us
I20260709 13:16:38.166162 10230 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.126857 10105 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:38.209738  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 312624us
I20260709 13:16:38.169392 10174 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:38.205122  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.214838  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 300915us
I20260709 13:16:38.176165  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:38.162282 10107 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.227523  8294 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:38.235437  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 59377.9us
I20260709 13:16:38.185959 10061 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:38.202339 10203 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:38.216320 10230 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:38.223243 10183 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.334131 10240 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:16:38.336247  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.307942 10208 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:38.312757  9935 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.317126 10187 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:38.329849 10137 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.307166 10174 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.211922 10225 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.392087 10251 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.338152 10183 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:38.402864  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.409272  8889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.858s (SENT) [suppressed 13 similar messages]
W20260709 13:16:38.419057  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 285228us
I20260709 13:16:38.318491 10100 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.383823 10249 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:16:38.390240  9935 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.412074  8288 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:38.409065 10242 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:38.443252  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:38.443580  9935 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.335479 10211 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.406032 10123 consensus_queue.cc:1059] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:38.406665 10187 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.437193 10137 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.464399  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 242416us
I20260709 13:16:38.464996  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:38.465711  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 74584.9us
W20260709 13:16:38.454758 10238 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
W20260709 13:16:38.452893 10237 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:16:38.454066  8923 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:38.459676  9935 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.468238  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:38.423507 10251 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.478137  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:38.480934  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.482688  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:38.483575  8292 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:38.483958  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:38.469655 10239 log.cc:927] Time spent T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:16:38.484643  8291 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:38.468573 10105 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.435367 10230 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.467782 10258 raft_consensus.cc:2764] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:38.482257  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:38.516954  8293 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:38.463563 10208 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:38.492378  8927 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:38.492071  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.484666 10257 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.527391  8368 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:38.528398  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:38.529109  8211 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:38.489683 10251 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.532610 10107 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.533730  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:38.476403 10174 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:38.536089  8289 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:38.517896 10105 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.515594 10260 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:38.489267 10244 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:16:38.492527 10245 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:16:38.488847 10248 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:38.487586  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:38.524381  8364 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:38.524847  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:38.525900  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.486088 10123 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.538661 10260 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.543716  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:38.538391 10105 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.465224 10242 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.464728 10137 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.546339  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:38.482831  9935 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:38.550510  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 325176us
W20260709 13:16:38.575634  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.576838  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 89313.6us
I20260709 13:16:38.541702 10256 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:38.561533 10260 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:38.614768  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 65808.7us
W20260709 13:16:38.615091  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 71453.8us
W20260709 13:16:38.618786  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 209546us
I20260709 13:16:38.619029  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:38.616132  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:38.621088  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:38.569644 10258 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.545409 10226 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.592206 10225 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.632781  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:38.561273 10123 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.658035  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:38.662410  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:38.600775  9734 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:16:38.622188 10106 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:38.632512  8186 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:38.745321  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 112886us
W20260709 13:16:38.738436  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 81338.5us
I20260709 13:16:38.627791 10101 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:38.655750 10183 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.756215  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.759135  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.648126 10186 raft_consensus.cc:3055] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:38.677908 10257 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:38.661481  9991 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.653474 10261 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:38.676999  8211 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:38.798656  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.763922  8365 raft_consensus.cc:2410] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:38.756803  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:38.739315  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 77064.6us
I20260709 13:16:38.800145  8183 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:38.755662  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.769431  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.791676  8364 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:38.805719  8360 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:38.784255 10186 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:38.606482 10256 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:38.816923  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.818746  8365 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:38.736078 10230 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:16:38.821610  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:38.812242  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.742266 10249 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:38.762539 10225 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:38.814602  8183 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:38.743646 10163 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:16:38.795480 10174 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:38.837288  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:38.798946 10106 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.649050 10258 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.794040 10261 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.841564  8183 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:38.800094 10107 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:38.837343  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 216882us
I20260709 13:16:38.630497 10208 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.827953  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:38.844717  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1700) took 1096 ms. Trace:
I20260709 13:16:38.851589 10186 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:38.852602  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.838433 10242 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.800707  9991 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.848173 10183 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:38.866024  8290 rpcz_store.cc:276] 0709 13:16:37.747897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.748128 (+   231us) service_pool.cc:224] Handling call
0709 13:16:37.781090 (+ 32962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.782421 (+  1331us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:37.810144 (+ 27723us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.173125 (+362981us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.203113 (+ 29988us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.208159 (+  5046us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:38.210426 (+  2267us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.216702 (+  6276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.216818 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.821134 (+604316us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b18001a7b20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa324522 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:16:38.844421 (+ 23287us) raft_consensus.cc:1685] finished
0709 13:16:38.844462 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.844636 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94852,"prepare.queue_time_us":30157,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":1861,"raft.queue_time_us":12706,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":27921,"spinlock_wait_cycles":159624064,"thread_start_us":289474,"threads_started":1,"wal-append.queue_time_us":502273}
W20260709 13:16:38.897660  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 140968us
I20260709 13:16:38.848134 10225 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:38.910449  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:38.855111 10261 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.865453  8921 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:38.855597 10106 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:38.914259 10181 consensus_meta.cc:287] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.000s
I20260709 13:16:38.865459 10107 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:38.956816  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46446us
I20260709 13:16:38.975538  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:38.978677  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 320695us
I20260709 13:16:38.945380  9964 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:38.948798 10105 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:38.962155 10263 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.922418 10274 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:38.954831  9963 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:39.006379  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.979708  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:39.013399 10183 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:38.972180 10181 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:38.990993 10226 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:39.026500 10283 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:39.027309  9991 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:39.015218 10279 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:39.028716 10272 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:16:39.029387 10262 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:39.029616  9977 consensus_meta.cc:287] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.000s
I20260709 13:16:39.030100  9977 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:39.031286 10107 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:39.009261 10204 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:39.032516 10290 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:39.035323 10226 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:39.003099 10253 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:39.036120 10271 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:16:39.037242 10106 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:39.040380  8216 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:39.035898 10253 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.041039 10025 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.993871 10123 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:39.003659 10061 consensus_queue.cc:1059] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:16:39.021531 10225 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:39.014585 10183 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:39.012409  9963 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:39.406802  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.243801  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:39.337440  9947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.002s	sys 0.007s
I20260709 13:16:39.035887 10226 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:39.478497  9947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.004s	sys 0.008s
W20260709 13:16:39.438663  8368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.022s	sys 0.062s
I20260709 13:16:39.241464  8219 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:39.240972  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:39.479969  8368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.022s	sys 0.066s
I20260709 13:16:39.243470  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:39.435010  8261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.001s	sys 0.013s
W20260709 13:16:39.229451  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 249821us
I20260709 13:16:39.208693  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:39.493502  8261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.001s	sys 0.018s
I20260709 13:16:39.478664  8215 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:16:39.264144  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44102.8us
I20260709 13:16:39.358039 10249 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.482021  8334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.015s	sys 0.043s
W20260709 13:16:39.157348  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.494292  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 583963us
W20260709 13:16:39.496505  8334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.016s	sys 0.043s
W20260709 13:16:39.302902  8892 leader_election.cc:336] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.842s (SENT)
W20260709 13:16:39.337594  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.009s
W20260709 13:16:39.255769  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.241366  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:39.497987  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.000s	sys 0.013s
I20260709 13:16:39.498268  8186 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:39.206595  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:39.324793 10260 consensus_meta.cc:287] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
W20260709 13:16:39.155484  8286 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.450s	user 0.012s	sys 0.003s
I20260709 13:16:39.023294 10263 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:39.494637  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.012s
W20260709 13:16:39.376560  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.504653  8220 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
W20260709 13:16:39.152879 10281 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:16:39.479074 10230 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:39.150978  8923 consensus_meta.cc:287] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.000s
I20260709 13:16:39.502185  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:39.326244  8214 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:39.195883 10270 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.400s	user 0.003s	sys 0.000s
W20260709 13:16:39.505002  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.004s	sys 0.012s
W20260709 13:16:39.496794  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.007s
I20260709 13:16:39.157677  9996 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.041548 10253 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.432716 10107 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:39.248194 10256 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:39.505985  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:39.521800  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.522585  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 219723us
I20260709 13:16:39.250079 10186 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.191030  9935 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:39.497663  8212 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.004s	sys 0.012s
I20260709 13:16:39.246814  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:39.048786 10258 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:39.158107 10262 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:39.222736  9977 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:39.406234 10294 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:39.328573 10181 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:39.512403  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:39.512696  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.191675 10137 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:39.368227 10163 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:39.515506  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.004s	sys 0.007s
I20260709 13:16:39.192131 10187 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:39.517477 10287 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:39.373594 10174 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:39.504515 10303 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.515913  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 661976us
I20260709 13:16:39.570205  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:39.571382  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:39.394001 10261 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:39.524278 10312 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.501504 10123 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:39.524458 10250 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:39.524564 10301 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.525027  9962 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:39.525278  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 241) took 1002 ms. Trace:
I20260709 13:16:39.607746  8217 rpcz_store.cc:276] 0709 13:16:38.522560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.522965 (+   405us) service_pool.cc:224] Handling call
0709 13:16:38.523318 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.545054 (+ 21736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.545113 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.559904 (+ 14791us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.789548 (+229644us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:38.789602 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.789688 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.525049 (+735361us) raft_consensus.cc:1685] finished
0709 13:16:39.525077 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.525214 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44802,"raft.queue_time_us":22653,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":10449,"thread_start_us":174118,"threads_started":1,"wal-append.queue_time_us":382153}
I20260709 13:16:39.524940 10298 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:39.503096 10260 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:39.524297 10106 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:16:39.526324 10256 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.504153  8286 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:39.156198 10025 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:39.501927 10211 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:39.514446  8923 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:39.528226 10288 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:39.519953 10274 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.504361 10249 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:39.566151  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 590677us
I20260709 13:16:39.521155 10230 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:39.567034  8367 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:39.574119 10303 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:39.527964 10107 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:39.540634  9935 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.554224  8211 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:39.521942  9996 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:39.540052  8212 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.004s	sys 0.012s
I20260709 13:16:39.584955  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 230) took 1455 ms. Trace:
I20260709 13:16:39.581290  9977 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:39.569576 10174 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.634521 10303 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:39.545650 10226 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:39.617976 10301 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:39.624680  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 477) took 1319 ms. Trace:
W20260709 13:16:39.660678 10299 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:16:39.616767 10256 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:39.617055  8286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 257) took 2047 ms (client timeout 2148 ms). Trace:
I20260709 13:16:39.545845  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 245) took 1019 ms. Trace:
I20260709 13:16:39.618042 10300 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.624958 10288 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:39.613458 10250 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:39.567824 10163 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:39.564889 10294 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:39.923918  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.663249  8369 rpcz_store.cc:276] 0709 13:16:38.129672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.130509 (+   837us) service_pool.cc:224] Handling call
0709 13:16:38.147082 (+ 16573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.385396 (+238314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.385905 (+   509us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:38.390308 (+  4403us) log.cc:844] Serialized 26 byte log entry
0709 13:16:38.605092 (+214784us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:38.605133 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.605200 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.195242 (+590042us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:39.584579 (+389337us) raft_consensus.cc:1685] finished
0709 13:16:39.584611 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.584875 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59933,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7046,"spinlock_wait_cycles":241219328,"thread_start_us":397780,"threads_started":2,"wal-append.queue_time_us":250646}
I20260709 13:16:40.214187 10301 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:39.797688  9963 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:40.196353  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 694194us
I20260709 13:16:40.216079  9977 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.216708  9977 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.797067 10262 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.220979 10294 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:40.221544 10294 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.895328  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 244) took 1369 ms. Trace:
I20260709 13:16:40.222146  8214 rpcz_store.cc:276] 0709 13:16:38.526566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.544999 (+ 18433us) service_pool.cc:224] Handling call
0709 13:16:39.325717 (+780718us) spinlock_profiling.cc:243] Waited 7.98 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:39.326016 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:39.519847 (+193831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.543860 (+ 24013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18349952}
I20260709 13:16:39.662374 10282 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.796383 10261 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.224128 10282 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:39.913635  9996 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.225672 10300 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.226505 10282 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:39.635463  9935 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:40.215059  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.619719  9962 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:40.222623  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 501553us
W20260709 13:16:39.863020  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 237072us
I20260709 13:16:40.224637 10319 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.611359 10309 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:39.596575 10312 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.195729  8292 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:40.231289  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.254297  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 58536us
I20260709 13:16:39.863597 10274 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:40.281843  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 710485us
I20260709 13:16:40.231738 10177 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.577124 10263 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:40.284758  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.294035  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:40.283831  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 52954.7us
W20260709 13:16:40.256281 10314 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.711s	user 0.001s	sys 0.000s
W20260709 13:16:39.663069 10239 log.cc:927] Time spent T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:16:40.277668  8890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.020s	sys 0.049s
I20260709 13:16:40.313040 10312 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.324594 10308 consensus_queue.cc:1059] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.328285 10324 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:40.328914 10282 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:40.231895  9962 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:39.616498 10106 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:40.332022  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 49220.9us
I20260709 13:16:39.879608  9734 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.227969 10300 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:39.934607 10249 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:40.339984  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 123180us
I20260709 13:16:40.229743 10320 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:40.235347 10250 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.233664 10309 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:40.235670  8286 rpcz_store.cc:269] 0709 13:16:37.569938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.570461 (+   523us) service_pool.cc:224] Handling call
0709 13:16:39.616986 (+2046525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:40.339504  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1323) took 1132 ms. Trace:
I20260709 13:16:40.018214  8211 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:40.282789 10288 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.321760 10177 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.344914  8183 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:40.232949  9947 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 13:16:40.346171 10107 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:40.333467  8890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.020s	sys 0.049s
I20260709 13:16:40.334913 10123 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.359030  8220 rpcz_store.cc:276] 0709 13:16:39.207498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.208407 (+   909us) service_pool.cc:224] Handling call
0709 13:16:40.339368 (+1130961us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b54004425d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:40.339455 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21946112}
I20260709 13:16:40.340976 10324 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.360033  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:40.345894 10312 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:40.373234 10226 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:16:40.373755  8114 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 4, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 4 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:39.242086  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:40.404031 10226 raft_consensus.cc:3055] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:40.232594 10319 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.404433 10226 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:40.356745  9734 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.404955  8925 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:40.405815 10123 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.236109  8923 rpcz_store.cc:276] 0709 13:16:38.304967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.308249 (+  3282us) service_pool.cc:224] Handling call
0709 13:16:38.443135 (+134886us) spinlock_profiling.cc:243] Waited 8.55 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:39.624551 (+1181416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19656064}
I20260709 13:16:40.406077 10319 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.405951 10312 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.353137 10106 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:40.358491 10309 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.404481  8289 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.405468 10226 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.282413 10260 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:40.404309  8293 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:40.407459 10253 consensus_meta.cc:287] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.875s	user 0.006s	sys 0.005s
I20260709 13:16:40.421404 10253 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.422806  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:40.424155 10253 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.424495  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.425343  8219 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:40.425617  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.426496  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.427101  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:40.427250  8219 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:40.428953  8213 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:40.427791  8218 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:40.400298  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 55477.4us
I20260709 13:16:40.406324 10123 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.412817  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:40.439798  8218 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:40.441582  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:39.617838 10025 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:40.408180  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:40.389369 10177 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:40.409024  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 87189.2us
I20260709 13:16:40.449379  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:40.450160  8217 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:40.450570  8217 pending_rounds.cc:85] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 2
I20260709 13:16:40.450840  8217 pending_rounds.cc:107] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:40.451130  8217 raft_consensus.cc:2889] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.452319  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.386066  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1799) took 1624 ms. Trace:
I20260709 13:16:40.410914  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.377099  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1321) took 1165 ms. Trace:
I20260709 13:16:40.412726  8290 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:40.455471  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:40.417219  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:40.445601  8287 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:40.381285 10250 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:40.446043  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:40.446200  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:40.382799 10241 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.982s	user 0.022s	sys 0.025s
I20260709 13:16:40.456483  8294 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.461741  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:40.458564  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:40.459636  8332 connection.cc:256] RPC call timeout handler was delayed by -2.2233612549998725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
I20260709 13:16:40.454550 10260 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.447932 10319 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.360095 10320 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.457160  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.477962  8287 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:40.478981  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.479625  8294 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:40.448433 10249 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.469703  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:40.471851  8332 connection.cc:256] RPC call timeout handler was delayed by -1.7342980500000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:16:40.484072  8332 connection.cc:256] RPC call timeout handler was delayed by -1.7216980499999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:16:40.406901 10322 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.472247  8290 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
W20260709 13:16:40.484481  8332 connection.cc:256] RPC call timeout handler was delayed by -1.6451980499998626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 13:16:40.484802  8332 connection.cc:256] RPC call timeout handler was delayed by -1.4687980500000322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 13:16:40.463811 10241 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.068s	user 0.033s	sys 0.032s
W20260709 13:16:40.485210  8332 connection.cc:256] RPC call timeout handler was delayed by -1.3553980499998488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260709 13:16:40.454231  8220 raft_consensus.cc:2376] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5. Re-sending same reply.
I20260709 13:16:40.455034  8211 rpcz_store.cc:276] 0709 13:16:39.204138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.221565 (+ 17427us) service_pool.cc:224] Handling call
0709 13:16:40.369778 (+1148213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:40.485594  8332 connection.cc:256] RPC call timeout handler was delayed by -1.3202980500000194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 13:16:40.481032  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:40.487880  8332 connection.cc:256] RPC call timeout handler was delayed by -1.2536980499999117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 13:16:40.459256 10250 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.489114  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:40.447328 10107 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:16:40.459420 10298 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:40.458158 10226 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.469398 10177 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:40.448228 10203 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:16:40.457100 10327 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.463531 10303 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:40.505005  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:40.488929 10256 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:40.472422 10310 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:40.480557 10260 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.476939  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:40.499017  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.485512 10300 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:40.500959  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 57048.3us
I20260709 13:16:40.503454  8214 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:40.460323 10308 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:40.515870  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.492749  9962 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.504034 10319 raft_consensus.cc:2764] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:40.509295  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:40.496351  8286 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:40.509693  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:40.511539 10310 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.496656  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.513540 10322 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:40.500727 10225 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:40.494297 10250 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:40.512045 10186 consensus_meta.cc:287] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.980s	user 0.011s	sys 0.000s
I20260709 13:16:40.455091  8361 rpcz_store.cc:276] 0709 13:16:38.759673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.816627 (+ 56954us) service_pool.cc:224] Handling call
0709 13:16:38.906218 (+ 89591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.977526 (+ 71308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.987420 (+  9894us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.055446 (+ 68026us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.477910 (+422464us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:39.477969 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.478054 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.378804 (+900750us) raft_consensus.cc:1685] finished
0709 13:16:40.379958 (+  1154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.383886 (+  3928us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3720,"raft.queue_time_us":82213,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":253291,"threads_started":1,"wal-append.queue_time_us":314617}
I20260709 13:16:40.223263  8212 rpcz_store.cc:276] 0709 13:16:38.525523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.539151 (+ 13628us) service_pool.cc:224] Handling call
0709 13:16:38.571699 (+ 32548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:38.606353 (+ 34654us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:38.750954 (+144601us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.619326 (+868372us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b18001aff20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa324522 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:16:39.856723 (+237397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:39.863227 (+  6504us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:39.880901 (+ 17674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.888464 (+  7563us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.894703 (+  6239us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114556,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":107864,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":11256,"spinlock_wait_cycles":10960256,"thread_start_us":855324,"threads_started":2,"wal-append.queue_time_us":209519,"wal-append.run_cpu_time_us":1413,"wal-append.run_wall_time_us":1111827}
I20260709 13:16:40.510452  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:40.530974  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:40.514154  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 68190.8us
I20260709 13:16:40.526341  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:40.516644  8214 pending_rounds.cc:85] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 2
I20260709 13:16:40.491879 10106 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.514233  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.515311 10288 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.500397 10298 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.510550 10303 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.571578  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:40.655205  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.600672  8213 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:40.651810  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:40.661938  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.658016  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.567807 10177 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.525643  8925 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.648518  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.526898  8287 raft_consensus.cc:2410] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:40.610576  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:40.525354 10300 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:40.621639  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1320) took 1418 ms (client timeout 1844 ms). Trace:
I20260709 13:16:40.756645  8926 raft_consensus.cc:2410] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:16:40.800231  8216 rpcz_store.cc:269] 0709 13:16:39.203764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.206251 (+  2487us) service_pool.cc:224] Handling call
0709 13:16:40.621431 (+1415180us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54001d4f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:40.621576 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273775488}
I20260709 13:16:40.801591  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.714704  8214 pending_rounds.cc:107] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 3.3
W20260709 13:16:40.757030  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.721189  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 210752us
I20260709 13:16:40.537221  9734 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.756688  8217 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:40.795679  8291 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:40.620489  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:40.767367 10253 consensus_queue.cc:1175] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" responder_term: 4 status { last_received { term: 4 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 4 index: 4 } }
I20260709 13:16:40.766026  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.766883  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.560618 10123 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.652417 10257 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:40.618882 10183 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.647238  9935 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:40.553057 10304 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.984s	user 0.001s	sys 0.008s
I20260709 13:16:40.588205 10312 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.621102 10260 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:40.799567  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 333856us
I20260709 13:16:40.528815  9962 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.659751 10306 raft_consensus.cc:3055] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:40.802516  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.548828  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:40.803332  8215 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 2.
I20260709 13:16:40.531539 10310 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:40.643692 10276 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.786s	user 0.002s	sys 0.017s
I20260709 13:16:40.755861 10225 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.700085 10252 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.649889 10174 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.588006  8921 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:16:40.533324  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:40.806871  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:40.795466  8928 raft_consensus.cc:2410] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:40.639874 10320 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.533763 10322 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:40.643303  9947 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.553490  8919 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:40.588380  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:40.545644 10163 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.767449  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:40.848693  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 81379.8us
I20260709 13:16:40.766438 10106 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.620246 10324 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.582414  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:40.805251  8214 raft_consensus.cc:2889] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:40.851053  8922 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:40.850962  9935 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:40.815506  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.816357  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:40.822274  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:40.852522  8291 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.853941 10174 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.846413 10225 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.823918  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.856704 10319 consensus_queue.cc:1059] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:40.857161  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.857767 10319 raft_consensus.cc:3055] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:40.857810  8295 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:40.858273 10319 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:40.858860  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:40.800980 10177 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.861382 10177 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.823402 10257 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:40.862411 10257 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.863427 10257 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:40.865738 10289 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.296s	user 0.006s	sys 0.001s
I20260709 13:16:40.828680  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.867313  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.867585  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 271) took 2244 ms. Trace:
I20260709 13:16:40.573495  9977 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.830852 10230 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.833923  8293 raft_consensus.cc:2410] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:40.833847  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 285115us
I20260709 13:16:40.873834  8293 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:40.873957  8286 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:40.873994 10288 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.875095  8293 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:40.875341  8286 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:40.876806  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:40.877316  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:40.877570  9977 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.877838  8927 raft_consensus.cc:2410] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:40.850466  9947 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.834334 10306 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:40.880276  8218 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:40.880762 10306 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.882148 10306 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.833613  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:40.836496 10123 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.884232 10123 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.884618 10123 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.885933  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.886343 10274 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.811506  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.887794  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.888599  8214 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:40.889920  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:40.845569  9734 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.895606  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 272) took 2139 ms. Trace:
I20260709 13:16:40.837841  9962 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.826241  8920 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:40.895977  8292 rpcz_store.cc:276] 0709 13:16:38.756390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.756881 (+   491us) service_pool.cc:224] Handling call
0709 13:16:40.195322 (+1438441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.244060 (+ 48738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.895429 (+651369us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54002e54d0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:40.895551 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891342592}
I20260709 13:16:40.856181 10262 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:40.896906 10163 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:40.897285  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:40.897452 10163 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.897871  8292 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.897979 10163 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:40.900771  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:40.901316  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.902889  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:40.868067  8288 rpcz_store.cc:276] 0709 13:16:38.623460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.623648 (+   188us) service_pool.cc:224] Handling call
0709 13:16:38.651892 (+ 28244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.652307 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:38.737198 (+ 84891us) log.cc:844] Serialized 14 byte log entry
0709 13:16:39.052185 (+314987us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.120086 (+ 67901us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.135689 (+ 15603us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:39.135727 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.135791 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.865142 (+1729351us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:40.867112 (+  1970us) raft_consensus.cc:1685] finished
0709 13:16:40.867381 (+   269us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.867511 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57740,"prepare.queue_time_us":88193,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":303036,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":16748,"spinlock_wait_cycles":8148864,"thread_start_us":195563,"threads_started":1,"wal-append.queue_time_us":753763}
I20260709 13:16:40.894747  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.870949  8291 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:40.859222 10319 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:40.870406 10342 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.915202  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:40.916388  8360 raft_consensus.cc:2410] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:40.844144  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:40.840167  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 222439us
W20260709 13:16:40.892750  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 59226us
I20260709 13:16:40.918265  8258 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:40.918653  8365 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:40.894435  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:40.894701 10198 raft_consensus.cc:3055] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:40.895244 10303 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:40.903211 10230 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:40.905494  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:40.908515  8292 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:40.914179  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.927510  8288 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:40.897786 10262 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.915119 10342 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.917083  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:40.894101 10300 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:40.832197 10100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.910s	user 0.025s	sys 0.077s
I20260709 13:16:40.846683 10322 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.923125  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:40.834419 10183 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:40.924728  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 80678.3us
I20260709 13:16:40.997509  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:40.924968  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:41.001305  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 78257us
I20260709 13:16:41.002316  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:40.868412 10320 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:40.850919  8924 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.929352  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:40.914570  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:40.933175  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:40.936368  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:40.937017  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.895738  9734 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.937558  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:40.912019 10335 raft_consensus.cc:2764] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:40.912876 10226 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.919344 10174 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:16:40.961525  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:40.961982  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:40.962383  8214 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:40.962684 10275 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 2.111s	user 0.029s	sys 0.032s
I20260709 13:16:40.964262 10242 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:40.965327  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1795) took 2206 ms. Trace:
I20260709 13:16:40.941008  9977 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:16:41.011757 10287 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:40.967686  8363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1802) took 2205 ms (client timeout 1870 ms). Trace:
W20260709 13:16:41.053143  8363 rpcz_store.cc:269] 0709 13:16:38.762378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.799791 (+ 37413us) service_pool.cc:224] Handling call
0709 13:16:40.967407 (+2167616us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540010de54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:40.967576 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3794817408}
I20260709 13:16:40.938148 10257 raft_consensus.cc:2764] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:16:40.976176 10339 ts_tablet_manager.cc:933] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:41.057188  9947 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:40.976195 10342 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:40.981633  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.985256  8294 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:41.047287 10226 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:41.068456  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:40.940474  8369 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:41.069991 10226 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:41.012138 10260 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:16:41.043267 10336 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:16:41.071379 10250 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:40.982518  8114 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added, no longer has a pending config: VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1), VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2), VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3), NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:40.925261 10282 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:40.926297 10198 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:40.929924  8923 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:40.872268 10309 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.011639  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:41.086189  8288 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:41.038300  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 100800us
I20260709 13:16:41.040239  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.040421  8364 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:40.940734 10262 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.995887 10225 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.095666 10225 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:41.098362 10225 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:41.039176  8293 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
W20260709 13:16:40.997635 10100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.071s	user 0.025s	sys 0.077s
I20260709 13:16:41.035815  8117 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46474 (request call id 259) took 10908 ms. Trace:
I20260709 13:16:41.045938  8360 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:41.048786  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.100363  8362 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:41.101315  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.102469  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.103097  8362 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:41.009377  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:41.104503  8922 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 2: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:40.966300 10298 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:41.011574 10208 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:41.050101  8368 rpcz_store.cc:276] 0709 13:16:38.758416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.758537 (+   121us) service_pool.cc:224] Handling call
0709 13:16:38.793720 (+ 35183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.480616 (+686896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.480653 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.493809 (+ 13156us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.541004 (+ 47195us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:39.541065 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.964926 (+1423861us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b5400405954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:40.964974 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.965022 (+    48us) raft_consensus.cc:1685] finished
0709 13:16:40.965037 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.965246 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141923,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":225130368,"thread_start_us":616575,"threads_started":2,"wal-append.queue_time_us":152471}
I20260709 13:16:41.106900  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:40.938817 10230 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:41.036655 10025 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:41.005412 10319 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.109664 10230 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:41.110862  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.111968  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.112480  8360 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:41.050048 10242 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:41.113266  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:41.113766  8360 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.113462 10242 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:41.114670 10242 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:41.114576 10163 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:41.117169  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:41.117794  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.103893  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.118412  8218 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:41.119338  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:41.060789  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 127820us
I20260709 13:16:41.057731 10318 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:41.047739  8286 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:41.073470 10183 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:40.843552 10252 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:41.076833 10339 tablet_copy_client.cc:323] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
W20260709 13:16:41.081471  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.092226  8889 leader_election.cc:336] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.858s (SENT)
I20260709 13:16:41.144731  8889 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:41.094849  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.016582  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:41.146478  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 129979us
I20260709 13:16:41.147758  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:41.120955  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:41.122470  8186 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:41.122682  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:41.118427  8362 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:41.124192  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.124765  8360 raft_consensus.cc:2410] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:41.085060  8114 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.129535  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.131255  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:41.134963  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:41.135073  8219 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:41.135936  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:41.152498  8288 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:41.154080  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.154652  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:41.155187  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.085636 10257 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:41.168316  8293 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:41.156379  8186 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.150506  8363 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:41.148811  8294 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:41.160148  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:41.161732  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:41.170583  8368 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 2.
I20260709 13:16:41.171774  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.172561  8368 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:41.173792  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:41.174340  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.175247  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:41.174780  8114 catalog_manager.cc:5697] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.176587  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.177767  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.177027  8114 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 4, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.181016  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.182873  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:41.185142  8186 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.160987 10336 raft_consensus.cc:2764] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:41.186540  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.186617 10198 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.187513  8362 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:41.187716 10198 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.187901 10226 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:41.188354 10226 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:41.188462  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.188766 10226 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:41.189643  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.190433  8362 raft_consensus.cc:2410] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:41.174440 10282 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:41.192234  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.186714 10225 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:41.192152 10287 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:41.193729 10287 raft_consensus.cc:3055] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:41.194062 10287 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:41.194813 10287 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.187381  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.197973  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.198248  9947 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:41.199043 10101 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:41.199108  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:41.201318  8114 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.204761  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.205864  8216 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:41.206817  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.210021  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.210633  8368 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 2.
I20260709 13:16:41.099558  8117 rpcz_store.cc:276] 0709 13:16:30.100780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.101112 (+   332us) service_pool.cc:224] Handling call
0709 13:16:41.009108 (+10907996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:36.246106 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:36.337026 (+ 90920us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:36.337076 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:16:36.337093 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:36.337818 (+   725us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:36.337937 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:36.337962 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:16:36.338588 (+   626us) tablet.cc:701] Row locks acquired
0709 13:16:36.338669 (+    81us) write_op.cc:260] PREPARE: finished
0709 13:16:36.338818 (+   149us) write_op.cc:270] Start()
0709 13:16:36.338961 (+   143us) write_op.cc:276] Timestamp: P: 1783602996338761 usec, L: 0
0709 13:16:36.339006 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:16:36.339743 (+   737us) log.cc:844] Serialized 2297 byte log entry
0709 13:16:36.608410 (+268667us) op_driver.cc:464] REPLICATION: finished
0709 13:16:36.976520 (+368110us) write_op.cc:301] APPLY: starting
0709 13:16:37.038201 (+ 61681us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:37.088532 (+ 50331us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:37.129658 (+ 41126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:37.166694 (+ 37036us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:37.166978 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:16:37.167042 (+    64us) write_op.cc:312] APPLY: finished
0709 13:16:37.167368 (+   326us) log.cc:844] Serialized 47 byte log entry
0709 13:16:37.167570 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:37.167681 (+   111us) write_op.cc:454] Released schema lock
0709 13:16:37.167740 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:37.168168 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:37.168202 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":138028,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":328575,"apply.run_cpu_time_us":3637,"apply.run_wall_time_us":211704,"num_ops":5,"prepare.queue_time_us":282250,"prepare.run_cpu_time_us":14761,"prepare.run_wall_time_us":180291,"raft.queue_time_us":127387,"raft.run_cpu_time_us":95515,"raft.run_wall_time_us":273629,"replication_time_us":229274,"thread_start_us":478445,"threads_started":4,"wal-append.queue_time_us":69372,"wal-append.run_cpu_time_us":6880,"wal-append.run_wall_time_us":1760796}]]}
I20260709 13:16:41.207809  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.128729 10320 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:16:41.218101  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.261778  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:41.219907  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.219244  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.221323  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:41.221462  8114 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.161640  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:41.265095  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.199826 10268 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:41.173866 10288 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:41.175101 10208 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:41.263262  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.186581 10100 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:41.263918  8114 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.176349  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.265489  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.265964  8364 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:41.266966  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.204411 10342 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:41.205695 10186 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:41.202025 10318 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:41.204670 10287 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:41.202373 10025 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:41.210659 10330 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:41.275336  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 54123us
I20260709 13:16:41.210538  9962 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:41.283006  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 190801us
I20260709 13:16:41.182806 10257 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.218720  8925 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:41.293680  8363 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:41.295701  8364 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:41.215291 10303 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:16:41.269723 10268 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:41.273646 10324 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:41.273980 10204 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.216111 10260 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:16:41.332140  8220 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:41.297060  8211 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:16:41.332661  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 201483us
I20260709 13:16:41.285771 10163 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:41.333369  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:41.290134 10100 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:41.293574 10101 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:41.354473  8892 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:41.354786  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.351815  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.297014 10186 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.289033 10336 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:16:41.334256 10230 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:41.367065 10100 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:41.374179  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:41.358284  8214 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:41.374974  8288 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
W20260709 13:16:41.381695  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.343403  9734 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:41.342307 10025 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:41.352298 10330 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:41.356084 10318 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:41.359669  9962 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:41.414755 10123 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.437985 10101 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:41.443323  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.443513  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1182) took 1022 ms. Trace:
I20260709 13:16:41.443869  8213 rpcz_store.cc:276] 0709 13:16:40.421391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.430095 (+  8704us) service_pool.cc:224] Handling call
0709 13:16:40.430456 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.794768 (+364312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.442797 (+648029us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54000238a0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd414a02 00007f31fd410dd6 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:16:41.443279 (+   482us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001b3d54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:41.443459 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421430400}
I20260709 13:16:41.445335  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.448010  8217 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:41.448184  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.449348  8217 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:41.453466  8289 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.455272  8362 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:41.456797 10356 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:41.457108 10320 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:41.457656 10320 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:41.458123 10320 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.458149 10268 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.465372 10226 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.470679 10322 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:41.472764 10322 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:41.476486  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:41.477085  8365 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
W20260709 13:16:41.479236 10354 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:41.480322  8360 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:41.368307 10183 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:41.419075 10347 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:16:41.417603  8364 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:16:41.363620 10204 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.430655  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.431645 10257 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:41.373991 10186 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:41.481509  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47753.3us
W20260709 13:16:41.416759  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 65044us
I20260709 13:16:41.438009  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:41.426229 10330 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:41.649468  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 290077us
I20260709 13:16:41.649909  8218 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:41.506048 10250 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:41.427086 10318 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:41.652653  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:41.657104  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:41.658179  8288 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:16:41.594635  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.531865  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.662177  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:41.667268  8289 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:41.669750  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:41.671991  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:41.419440  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.673327  8364 pending_rounds.cc:85] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 5
I20260709 13:16:41.674852  8364 pending_rounds.cc:107] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:16:41.675143  8364 raft_consensus.cc:2889] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:41.375453 10230 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.676545  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:41.677320  8293 raft_consensus.cc:2376] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:16:41.679313  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:41.680197  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1181) took 1259 ms. Trace:
I20260709 13:16:41.680613  8219 rpcz_store.cc:276] 0709 13:16:40.421072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.428112 (+  7040us) service_pool.cc:224] Handling call
0709 13:16:40.428585 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.151861 (+723276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.679938 (+528077us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b540019ad54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:41.680141 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624132864}
I20260709 13:16:41.682296  8219 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:41.683614  8219 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:41.688594  8927 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:41.690937  8183 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.691955  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:41.458211 10351 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:16:41.423898 10106 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:41.706956  8889 leader_election.cc:336] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.148s (SENT)
W20260709 13:16:41.481945 10348 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:16:41.488116 10226 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:41.423282 10025 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:41.481779  9962 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:41.695448  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 340997us
W20260709 13:16:41.723937  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.012s	sys 0.038s
W20260709 13:16:41.724836  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.012s	sys 0.038s
W20260709 13:16:41.726094  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 526994us
I20260709 13:16:41.688498 10309 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:41.694936 10230 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:41.728693  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:41.702464  9964 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:41.696152 10174 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:41.700057 10250 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:41.703999 10106 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.738305  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:41.738817 10359 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:41.740306 10322 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:41.755395  9964 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:41.762179 10353 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:16:41.762727  9964 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.724061  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:41.744786 10257 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:16:41.749228  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.689103 10100 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.755111 10230 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:41.728557 10251 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:41.776572 10251 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.777011 10251 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.777189 10230 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:41.750015 10163 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.719055 10336 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:41.735816  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:41.773494 10322 consensus_queue.cc:1243] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:16:41.751277 10310 consensus_meta.cc:287] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.907s	user 0.010s	sys 0.000s
I20260709 13:16:41.789141 10310 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:41.790557 10306 consensus_meta.cc:287] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.908s	user 0.006s	sys 0.003s
I20260709 13:16:41.791119  8290 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:41.753875  8214 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:16:41.778656  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.755746 10106 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:41.785317  8921 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:41.788295  8923 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:41.756347 10298 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:41.851231 10186 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:41.974149  8366 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:41.795874 10163 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.073531 10322 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.074801 10226 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:42.046412  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.829097  8924 consensus_meta.cc:287] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.000s
I20260709 13:16:41.851470 10303 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:41.808990 10257 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:42.066339  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 288348us
W20260709 13:16:42.076144  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 384230us
W20260709 13:16:41.951841 10242 consensus_meta.cc:287] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.000s
W20260709 13:16:41.812611 10349 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.469s	user 0.003s	sys 0.000s
I20260709 13:16:41.818941 10320 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.109493  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:42.085263  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.096370  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.084828  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:42.088253  8290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1726) took 1591 ms (client timeout 1655 ms). Trace:
I20260709 13:16:42.128125 10303 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:41.814316  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1723) took 1331 ms. Trace:
I20260709 13:16:42.133950  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:42.134888  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:42.101238 10252 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:42.145274  8289 rpcz_store.cc:276] 0709 13:16:40.483160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.501004 (+ 17844us) service_pool.cc:224] Handling call
0709 13:16:41.814132 (+1313128us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540005df54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:41.814248 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696341376}
I20260709 13:16:42.136364  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1729) took 1631 ms. Trace:
I20260709 13:16:41.791782  8363 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:41.931871 10208 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.641s	user 0.002s	sys 0.009s
I20260709 13:16:42.081918  8924 raft_consensus.cc:2410] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:16:42.098754 10287 consensus_meta.cc:287] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.755s	user 0.004s	sys 0.004s
I20260709 13:16:42.076916 10322 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.068454 10310 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:41.973017  8361 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:42.141701  8288 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
W20260709 13:16:42.142076  8290 rpcz_store.cc:269] 0709 13:16:40.497183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.497827 (+   644us) service_pool.cc:224] Handling call
0709 13:16:42.088063 (+1590236us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400389854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:42.088197 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2907232512}
I20260709 13:16:42.119781  8366 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:42.142550  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.143090  8291 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:42.096933  9962 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.105581 10186 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:41.837818 10123 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.149401  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:42.209687  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60351.2us
I20260709 13:16:42.146406  8292 rpcz_store.cc:276] 0709 13:16:40.505119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.928752 (+423633us) service_pool.cc:224] Handling call
0709 13:16:41.440218 (+511466us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:41.440409 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.440611 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:41.697935 (+257324us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.123212 (+425277us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.136005 (+ 12793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.136094 (+    89us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:42.136138 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.136204 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.136313 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2241,"prepare.queue_time_us":34398,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":1830,"raft.queue_time_us":13947,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":3273,"spinlock_wait_cycles":162696320,"thread_start_us":640044,"threads_started":2,"wal-append.queue_time_us":373330}
I20260709 13:16:42.149983  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:42.148023 10369 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:42.133193 10257 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:42.204252 10252 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:16:42.222123  9962 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.084427  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.223171  8286 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
W20260709 13:16:42.173768  8892 leader_election.cc:336] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.528s (SENT)
I20260709 13:16:42.224654  8218 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:42.225142  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:42.225862 10368 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:42.162736  9935 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.148802  9964 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:42.151829 10230 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:16:42.227210  9964 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.224743  8286 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:42.201282  8294 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:42.101716 10251 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:42.204466  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 47568.9us
I20260709 13:16:42.238915  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:42.151717 10208 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:41.792634 10358 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.356s
I20260709 13:16:42.213193 10163 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:42.213629  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.203577 10100 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:42.214938 10320 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.215134 10025 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:42.209218  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 519) took 1659 ms (client timeout 1763 ms). Trace:
I20260709 13:16:42.223448  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 246) took 1110 ms. Trace:
W20260709 13:16:42.225956  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 52249.8us
I20260709 13:16:42.139731 10298 consensus_queue.cc:1243] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:42.150665 10183 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:42.240607  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:42.207818  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.139452 10318 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.253824  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.139158 10330 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.256778  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 245) took 1144 ms. Trace:
I20260709 13:16:42.256556  8366 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:42.260063  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 110107us
I20260709 13:16:42.150844 10336 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.261621 10061 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:42.262245 10381 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:42.332274  8365 rpcz_store.cc:276] 0709 13:16:41.112577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.477633 (+365056us) service_pool.cc:224] Handling call
0709 13:16:41.477894 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.478092 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:41.951505 (+473413us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.256438 (+304933us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.256484 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:42.256525 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.256591 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.256717 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192868,"prepare.queue_time_us":259752,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":70358,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":81,"thread_start_us":570911,"threads_started":2}
W20260709 13:16:42.259677  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 48808.4us
I20260709 13:16:42.256410 10263 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:42.286029  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.292027  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 260) took 1357 ms. Trace:
W20260709 13:16:42.259491 10342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.008s	sys 0.009s
I20260709 13:16:42.267490  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1325) took 1046 ms. Trace:
W20260709 13:16:42.309219 10262 consensus_meta.cc:287] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.175s	user 0.009s	sys 0.003s
I20260709 13:16:42.307670 10025 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.303349  8364 rpcz_store.cc:276] 0709 13:16:41.112841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.698159 (+585318us) service_pool.cc:224] Handling call
0709 13:16:41.698666 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.709727 (+ 11061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.709773 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.726126 (+ 16353us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.149106 (+422980us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.149147 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.149211 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.223202 (+ 73991us) raft_consensus.cc:1685] finished
0709 13:16:42.223224 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.223382 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2508,"raft.queue_time_us":16375,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":15998,"thread_start_us":384568,"threads_started":1,"wal-append.queue_time_us":462264}
I20260709 13:16:42.351713  8219 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:42.330014  8289 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.308426  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:42.331807  8288 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:42.312426  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1402) took 1247 ms. Trace:
I20260709 13:16:42.327145 10251 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:42.303114  8924 rpcz_store.cc:269] 0709 13:16:40.546851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.561195 (+ 14344us) service_pool.cc:224] Handling call
0709 13:16:42.206563 (+1645368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.256726 10230 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:16:42.346500 10183 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:42.344782  8213 rpcz_store.cc:276] 0709 13:16:41.220985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.446373 (+225388us) service_pool.cc:224] Handling call
0709 13:16:41.446775 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:41.447763 (+   988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.447804 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:41.448532 (+   728us) log.cc:844] Serialized 52 byte log entry
0709 13:16:41.679384 (+230852us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:42.121758 (+442374us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.266278 (+144520us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.266782 (+   504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.267009 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.267082 (+    73us) raft_consensus.cc:1685] finished
0709 13:16:42.267124 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.267401 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20427,"prepare.queue_time_us":457604,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":3939,"raft.queue_time_us":22735,"raft.run_cpu_time_us":496,"raft.run_wall_time_us":31053,"thread_start_us":723684,"threads_started":3,"wal-append.queue_time_us":324843}
I20260709 13:16:42.351265 10123 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:42.298702  8186 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:42.378181  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 79572.5us
W20260709 13:16:42.316515 10377 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:42.339872  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:42.347234  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 106697us
I20260709 13:16:42.379755  8186 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:42.349874  8928 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:42.320405  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1330) took 1098 ms. Trace:
I20260709 13:16:42.340452 10106 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.310662  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:42.347671 10100 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:16:42.347510 10342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.009s	sys 0.009s
I20260709 13:16:42.347669 10389 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:42.317404 10322 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:42.314258  9964 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:42.357863  8368 rpcz_store.cc:276] 0709 13:16:41.064609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.327740 (+263131us) service_pool.cc:224] Handling call
0709 13:16:41.351423 (+ 23683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.366555 (+ 15132us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:41.425789 (+ 59234us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.074000 (+648211us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.074434 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.074580 (+   146us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:42.074616 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.074693 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.312145 (+237452us) raft_consensus.cc:1685] finished
0709 13:16:42.312174 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.312351 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140986,"prepare.queue_time_us":50220,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":221910,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":245081,"threads_started":1,"wal-append.queue_time_us":503583}
I20260709 13:16:42.383299 10251 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:42.342317 10263 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.351150 10252 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.355962  9935 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.318013 10374 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.246s	user 0.003s	sys 0.000s
I20260709 13:16:42.350916 10225 raft_consensus.cc:2764] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:42.356413 10336 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.382359  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:42.348905  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:42.342757  8215 rpcz_store.cc:276] 0709 13:16:40.934354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.934535 (+   181us) service_pool.cc:224] Handling call
0709 13:16:40.960224 (+ 25689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.981287 (+ 21063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.981318 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:40.981742 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:16:41.085985 (+104243us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:41.086023 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.086083 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.812023 (+725940us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:42.291713 (+479690us) raft_consensus.cc:1685] finished
0709 13:16:42.291733 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.291957 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26917,"raft.queue_time_us":35141,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":3366,"spinlock_wait_cycles":14696192,"thread_start_us":103620,"threads_started":1,"wal-append.queue_time_us":298764}
W20260709 13:16:42.413614  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 64775.7us
I20260709 13:16:42.413715  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:42.414497  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:42.415689  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:42.344748 10298 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:42.383436  8218 rpcz_store.cc:276] 0709 13:16:41.222134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.666020 (+443886us) service_pool.cc:224] Handling call
0709 13:16:41.666329 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.225190 (+558861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.320136 (+ 94946us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b5400035cd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:42.320331 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283579776}
I20260709 13:16:42.347193 10208 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:16:42.385704  8186 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:42.386021  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:42.388556  8289 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
W20260709 13:16:42.386480  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 46691.8us
I20260709 13:16:42.397686 10385 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:42.407595 10251 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:42.376359 10025 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.353188 10262 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.268800 10288 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:42.391458 10342 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:42.386014 10186 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:42.386756 10123 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:42.467861 10282 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.467660 10123 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.468420 10282 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.386004  8211 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:42.419345  8292 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:42.470590 10282 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:42.471356  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.471997  8292 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:42.472796  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.473131 10106 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.473770  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.474321  8292 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:42.475052  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.476033 10262 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.476617 10262 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.477206 10186 raft_consensus.cc:697] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:42.477309 10282 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:42.477839 10282 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.478166 10186 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.480324 10230 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:42.420136  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.481191  8286 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:42.433398 10376 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:42.482537  8213 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 3: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:42.482802  8286 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:42.483002 10257 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.409339 10263 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.485396 10257 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.486570  8293 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:42.411391  8212 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:42.485419  8927 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:42.489307  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.489392  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1194) took 1351 ms. Trace:
I20260709 13:16:42.489965  8212 rpcz_store.cc:276] 0709 13:16:41.137932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.445747 (+307815us) service_pool.cc:224] Handling call
0709 13:16:41.446048 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.488307 (+1042259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.489105 (+   798us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54001d4a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:42.489315 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208469760}
W20260709 13:16:42.421599 10386 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:42.424171  9964 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:42.491883  9964 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:42.493079  9964 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.424582  8892 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:42.411355  9935 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.497582  9947 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:42.498329  9935 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:42.499027  9935 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.500635 10368 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.425243 10320 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:42.386190  9962 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:16:42.426653 10319 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:42.428143  8925 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:42.408121 10322 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.393450  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:42.455207  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 244) took 1343 ms. Trace:
I20260709 13:16:42.515244  8926 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:42.464643  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.456298 10251 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.466156 10330 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.466094 10342 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.468133  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1411) took 1401 ms. Trace:
I20260709 13:16:42.515184  8362 rpcz_store.cc:276] 0709 13:16:41.112249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.455987 (+343738us) service_pool.cc:224] Handling call
0709 13:16:41.470112 (+ 14125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.470452 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:42.138192 (+667740us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.428973 (+290781us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:42.429407 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.430128 (+   721us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:42.430164 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.430238 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.455001 (+ 24763us) raft_consensus.cc:1685] finished
0709 13:16:42.455019 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.455147 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201276,"prepare.queue_time_us":267594,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":21013,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":187,"spinlock_wait_cycles":39168,"thread_start_us":711649,"threads_started":3,"wal-append.queue_time_us":242658}
I20260709 13:16:42.480389 10282 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:42.520943  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.419761  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.502338 10230 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:42.501554  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 77054.3us
I20260709 13:16:42.435566  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:42.519042  8367 rpcz_store.cc:276] 0709 13:16:41.066849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.452197 (+385348us) service_pool.cc:224] Handling call
0709 13:16:41.452653 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:41.453181 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:41.649215 (+196034us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.139168 (+489953us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:42.203676 (+ 64508us) log.cc:844] Serialized 574 byte log entry
0709 13:16:42.204437 (+   761us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.204485 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.204558 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.467885 (+263327us) raft_consensus.cc:1685] finished
0709 13:16:42.467905 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.468076 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8543,"prepare.queue_time_us":248525,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":6720,"raft.queue_time_us":8250,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":3743,"thread_start_us":421487,"threads_started":1,"wal-append.queue_time_us":474817}
I20260709 13:16:42.433899 10336 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.504094  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:42.530911 10263 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.462697 10025 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.533816 10025 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.534423 10204 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.519177 10322 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.535303 10368 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.536891 10322 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:42.537199  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.537474 10373 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.462s	user 0.002s	sys 0.000s
I20260709 13:16:42.525620 10230 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.538730  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 275) took 1242 ms. Trace:
I20260709 13:16:42.539057  8295 rpcz_store.cc:276] 0709 13:16:41.296514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.296625 (+   111us) service_pool.cc:224] Handling call
0709 13:16:41.335155 (+ 38530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:41.500347 (+165192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.500390 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:41.500956 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:16:42.075561 (+574605us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.075603 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.075696 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.536886 (+461190us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:42.538470 (+  1584us) raft_consensus.cc:1685] finished
0709 13:16:42.538489 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.538674 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1211,"raft.queue_time_us":38400,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":45511,"spinlock_wait_cycles":84767104,"thread_start_us":565331,"threads_started":2,"wal-append.queue_time_us":431366}
I20260709 13:16:42.542593 10226 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:42.543098 10226 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.550166  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1406) took 1484 ms. Trace:
I20260709 13:16:42.550629  8361 rpcz_store.cc:276] 0709 13:16:41.065592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.432944 (+367352us) service_pool.cc:224] Handling call
0709 13:16:41.864890 (+431946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.206728 (+341838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.549907 (+343179us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400354650. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:42.550098 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971429760}
I20260709 13:16:42.552438 10268 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:42.553016 10241 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:42.553512 10241 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:42.554327 10241 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.554982 10336 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.555536 10241 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.453819  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.499521  9947 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:42.434880 10287 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:42.410754 10252 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.508704 10319 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:42.581701  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 196053us
W20260709 13:16:42.512748  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 82637.9us
I20260709 13:16:42.423776 10163 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:42.499612  9935 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.417866  8288 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:42.507604 10101 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:42.504436 10320 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:42.524510  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 89029.4us
I20260709 13:16:42.524451  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:42.611119  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 86810.3us
I20260709 13:16:42.611163  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:42.611523  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:42.503808  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1403) took 1439 ms. Trace:
I20260709 13:16:42.612337  8367 raft_consensus.cc:2410] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:42.612406  8363 rpcz_store.cc:276] 0709 13:16:41.064870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.355856 (+290986us) service_pool.cc:224] Handling call
0709 13:16:41.371964 (+ 16108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.146567 (+774603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.503606 (+357039us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400355f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:42.503756 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965035776}
I20260709 13:16:42.424203 10183 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.506937  8292 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:42.562259  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:42.561466  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:42.587646  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.618265  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:42.618558  8293 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.618290  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.619660  8295 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.619777  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:42.598716  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.438001 10385 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.608546  8186 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:42.609550  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:42.616330  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:42.621399  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:42.622207  8367 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:42.621573  8291 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.622045  8219 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:42.620405  8216 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:42.636408  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:42.636639  8290 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:16:42.635725  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:42.606704 10398 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.641319  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.642156  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:42.643249  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.643797  8289 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.645395  8291 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:42.614151 10320 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.609196 10262 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.653839 10262 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:42.665165 10252 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.669786  9935 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:42.636919 10163 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:42.651167  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:42.653258  8293 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:42.617115 10368 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:42.677317  8295 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:42.626008 10330 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:42.680234  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.667289 10226 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.621878 10385 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.676862  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:42.689625 10396 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:16:42.659832 10251 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.617945 10364 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:16:42.681871 10330 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.614007 10101 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.679528 10368 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.699554  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.768235  8290 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.716430 10262 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:42.715736 10371 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.639s	user 0.001s	sys 0.003s
I20260709 13:16:42.755005 10163 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.716100 10204 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:42.680743 10252 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.716410  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:42.792318  8362 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:42.723407  8289 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
W20260709 13:16:42.735821  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.764689 10330 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.676786 10398 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.678442  8212 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:42.760540  8295 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.770968 10368 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.812739 10263 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:42.847362 10230 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.849586 10230 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:42.752264 10335 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:42.850708 10335 raft_consensus.cc:3055] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:42.851089 10335 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:42.851296  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:42.851884 10335 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:42.854389 10251 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:42.850730  8213 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:42.857694  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 273) took 1575 ms. Trace:
I20260709 13:16:42.859040  8295 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
W20260709 13:16:42.763459  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 127842us
I20260709 13:16:42.763780  8368 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:42.765247  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 154898us
W20260709 13:16:42.708590  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.682315 10280 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:16:42.750864  8261 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:42.764890  8922 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:16:42.794884 10401 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
I20260709 13:16:42.789387 10204 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:42.796530  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:42.758311  8286 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:42.755553 10402 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:42.879760  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:42.806988 10407 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:16:42.812798  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 200488us
I20260709 13:16:42.880676 10187 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:42.881089 10187 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.881168 10226 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:42.881269  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:42.881654 10402 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.882375 10407 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:42.882862 10407 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.883356  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 480) took 1229 ms. Trace:
W20260709 13:16:42.761297  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 152844us
I20260709 13:16:42.818943 10398 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:42.892498 10412 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.893023 10412 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:42.894475  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 533) took 1133 ms. Trace:
I20260709 13:16:42.821067 10101 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:42.862620  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:16:42.863124 10242 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:42.853101 10335 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:42.875823  8290 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
W20260709 13:16:42.873838  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 123054us
I20260709 13:16:42.917840  8220 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:42.883775  8922 rpcz_store.cc:276] 0709 13:16:41.653984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.661609 (+  7625us) service_pool.cc:224] Handling call
0709 13:16:42.640960 (+979351us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:42.677337 (+ 36377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.877400 (+200063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.883297 (+  5897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30426496}
I20260709 13:16:42.889164 10402 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:42.891631 10187 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.895027  8928 rpcz_store.cc:276] 0709 13:16:41.760686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.760808 (+   122us) service_pool.cc:224] Handling call
0709 13:16:41.761129 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.383125 (+621996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.894211 (+511086us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54003df754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:42.894409 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353203072}
W20260709 13:16:42.889055 10404 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:16:42.858099  8287 rpcz_store.cc:276] 0709 13:16:41.281874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.453745 (+171871us) service_pool.cc:224] Handling call
0709 13:16:41.454031 (+   286us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:41.613027 (+158996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:41.613069 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:41.656414 (+ 43345us) log.cc:844] Serialized 52 byte log entry
0709 13:16:41.835577 (+179163us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:41.838516 (+  2939us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.838721 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.838798 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:42.695550 (+856752us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:42.797006 (+101456us) raft_consensus.cc:1685] finished
0709 13:16:42.797103 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.847103 (+ 50000us) spinlock_profiling.cc:243] Waited 896 us on lock 0x7b180031b0a0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa324522 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:16:42.857639 (+ 10536us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179324,"prepare.queue_time_us":9378,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":182881,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":13639,"spinlock_wait_cycles":132312704,"thread_start_us":155052,"threads_started":1,"wal-append.queue_time_us":396632}
I20260709 13:16:42.911731  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.069012  8216 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
W20260709 13:16:42.932291  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.993144  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 71023.1us
I20260709 13:16:42.998728  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:42.998963  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 114480us
I20260709 13:16:43.071031  8286 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:43.071127  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:43.071262  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:43.003414  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 88451.7us
I20260709 13:16:43.072119  8921 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:43.072404  8183 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.004992  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:43.073673  8213 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:43.022408  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:42.907243 10412 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:43.074501  8926 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:43.075910  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:43.076771  8287 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:43.077875  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:43.078823  8287 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:43.027205  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.063586 10204 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.024968  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:43.082496  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.023811  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:43.093056  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.071650 10407 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:43.104794  9962 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:43.106228  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:43.107424  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:42.891412 10303 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:43.117127  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 235904us
W20260709 13:16:43.069546 10396 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:16:43.000295 10251 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.125765  8889 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:43.115743  9962 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:43.144615  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.113247 10356 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:43.163998  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.117267 10252 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:43.117031  9964 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:43.111011 10402 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:42.999987 10242 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.171171  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:43.181187  8364 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:43.182356  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.074163 10376 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:16:43.123360  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:43.065017 10280 consensus_queue.cc:1059] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:16:43.231743  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:43.183665  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:43.190867  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 65197.4us
I20260709 13:16:43.191061 10412 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:43.123306 10260 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:43.120585  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:43.151273 10257 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:43.163161 10298 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.206449 10303 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.168483 10226 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.178275 10225 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:43.207054  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.120141 10230 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:43.115836 10101 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:43.163357  9962 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.117394 10399 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:16:43.209498 10204 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.306125  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.226320 10356 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:43.328648  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 464684us
I20260709 13:16:43.229417  9964 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:43.226044 10402 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.334228  8213 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 5. Ops: []
I20260709 13:16:43.334295  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:43.249611 10412 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.378398 10412 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.302632 10327 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:43.379159 10327 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:43.379948 10327 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.380872 10327 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.337209  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.383208  8219 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:43.332597 10226 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.385429  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:43.385639 10226 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:43.386049  8362 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:43.386890  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:43.387095  8368 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:43.387465  8368 pending_rounds.cc:85] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:16:43.387406  8362 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:43.387811  8368 pending_rounds.cc:107] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:43.388149  8368 raft_consensus.cc:2889] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:43.337801 10225 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.391458 10225 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:43.339754  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 198066us
I20260709 13:16:43.339334  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.342073  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.335479 10262 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:43.345260  8364 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.225752 10252 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:43.344666  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 8d3403855d4147a9b056dc8678880fdf from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:16:43.349282  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.335645 10263 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:43.349104  9964 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.350466 10356 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:43.348407  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.352178 10251 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:16:43.353104  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:43.354532 10187 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.402931 10262 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.422751 10208 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.423213 10208 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.423578 10187 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:43.355191 10320 consensus_meta.cc:287] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.001s
I20260709 13:16:43.316519 10298 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.357547 10242 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.304750 10260 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:43.358278 10163 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.001s
I20260709 13:16:43.338783 10230 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.345223 10101 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:43.365437 10330 consensus_meta.cc:287] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.000s
I20260709 13:16:43.316697 10257 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.367095 10287 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:43.441447 10287 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.442953  8360 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:16:43.443303  8360 pending_rounds.cc:85] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 1
I20260709 13:16:43.443509  8360 pending_rounds.cc:107] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:16:43.443718  8360 raft_consensus.cc:2889] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:43.444674 10402 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:43.367594 10241 consensus_meta.cc:287] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.812s	user 0.011s	sys 0.000s
I20260709 13:16:43.368963 10318 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:43.370887 10368 consensus_meta.cc:287] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.000s
I20260709 13:16:43.446148 10368 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.446589  8214 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:43.373466  8920 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:43.447696  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 482) took 1793 ms. Trace:
I20260709 13:16:43.448060  8920 rpcz_store.cc:276] 0709 13:16:41.654539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.661557 (+  7018us) service_pool.cc:224] Handling call
0709 13:16:43.372785 (+1711228us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:43.373015 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.447440 (+ 74425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.447640 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23752960}
I20260709 13:16:43.336551 10100 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.449178  8926 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:43.450567  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.451054 10230 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.392470  8220 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
W20260709 13:16:43.393151  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 161513us
I20260709 13:16:43.456267  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:43.457118 10389 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:43.457440  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:43.458460  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:43.399396  9962 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.399887  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:43.402010  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:43.459834  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:43.487408  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.460125  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:43.506577  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 46810.6us
I20260709 13:16:43.416770  8364 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:43.255779 10385 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.420411  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 8d3403855d4147a9b056dc8678880fdf from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-8d3403855d4147a9b056dc8678880fdf
I20260709 13:16:43.517673 10409 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:43.518134 10409 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.518498 10409 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.421764  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.520149 10306 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.520308  8367 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.417714 10263 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.520617 10306 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:43.521090 10306 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.522306 10263 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:43.522800  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.524112 10208 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.524410  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:43.449180 10100 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.514272 10226 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:43.425444  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:43.426318  8258 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:43.527199  8293 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:43.426971  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:43.527902  8216 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.427623  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:43.529136  8291 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:43.424018 10262 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:43.529501 10257 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.429960 10416 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.529989 10282 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:43.530443 10282 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.530285 10416 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.530846 10282 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:43.527722  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 101469us
I20260709 13:16:43.428632 10025 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:43.539258  8216 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:43.533250  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:43.514847  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 112930us
W20260709 13:16:43.541668  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.542501  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.537074  8367 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:43.537520  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:43.516482  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 116647us
I20260709 13:16:43.543128  8218 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:43.544155  8892 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:43.544239  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:43.545068  8219 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.545305  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:43.546159  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:43.547022  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:43.548151  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.549249  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:43.553773 10257 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.556632  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:43.557206  8220 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:43.557716  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:43.558182  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.459759 10225 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:43.458470 10389 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.463084 10422 raft_consensus.cc:3055] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:43.567026  8291 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:43.504623 10123 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.468466 10101 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.504874 10330 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.566479  8290 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:16:43.438611 10163 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.561966  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.583032  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.586328  8288 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:43.586915  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:43.566628  8186 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.461601 10298 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.570286  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:43.561821 10025 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.581676 10123 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.602573  8286 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:43.603251 10025 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.603601 10123 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.580276 10402 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.604003  8378 tablet_copy_source_session.cc:215] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:43.604305 10402 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:43.604727 10402 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.564910 10225 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:43.565450 10208 raft_consensus.cc:2764] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:43.568790 10263 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.556380 10242 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:43.610333 10225 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.610894 10163 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:43.611366 10163 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.611686 10163 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:43.612525  9962 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.586761 10389 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:43.614158 10389 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:43.614500 10389 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:43.614789  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.608268 10376 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:43.615213 10389 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.615608 10376 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:43.572029  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:43.514163 10230 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:43.575548  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:43.627187  8294 raft_consensus.cc:2393] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:16:43.594910 10369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.333s	user 0.018s	sys 0.008s
I20260709 13:16:43.429880 10320 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:43.582513  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.431072 10280 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:16:43.570286  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.566184 10407 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.567198 10257 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:43.606309  9977 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:43.616720 10204 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:43.556173 10187 consensus_queue.cc:1059] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:43.567413 10422 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:43.625090  8295 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:43.576234  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.677546  8220 raft_consensus.cc:2368] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
I20260709 13:16:43.628744  8219 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:43.571491  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:43.634904  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.581939  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:43.594834  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:43.668107  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.637205  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:43.617944 10100 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:43.562227 10252 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.668241  8920 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 LEARNER]: Advancing to term 5
I20260709 13:16:43.609539 10025 consensus_queue.cc:1059] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
W20260709 13:16:43.683985  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 112591us
W20260709 13:16:43.686226  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 91486.9us
I20260709 13:16:43.705180  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.706705  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:43.666692 10369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.019s	sys 0.008s
I20260709 13:16:43.668053 10260 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.668206 10407 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:43.670230 10389 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.625676 10123 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.607926  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.608392 10424 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.704440  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.708659  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:43.677588 10416 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:43.680899  8925 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:16:43.636822 10364 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:16:43.682224  9977 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:43.685442 10257 consensus_queue.cc:1243] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:43.718575  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:43.753966  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:43.755417  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:43.693585 10230 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:43.636399 10287 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.703855 10187 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:43.703976 10263 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.714924 10407 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.712440  9962 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:43.713997 10300 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.747376  8183 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.758080  8217 raft_consensus.cc:606] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:43.711180 10369 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:43.717222 10123 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.759419  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.763734  8367 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:43.769104  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.773100  8213 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:43.751735 10106 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.757412 10061 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:43.761423 10335 consensus_meta.cc:287] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.001s
I20260709 13:16:43.761147 10187 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:43.776198 10287 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.780754 10320 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:43.743168 10260 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:43.790535  8332 leader_election.cc:400] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
I20260709 13:16:43.807624  8332 leader_election.cc:403] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:16:43.807924  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60635.2us
I20260709 13:16:43.797494  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.752329 10429 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:43.761554  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 196083us
W20260709 13:16:43.877000  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 310430us
I20260709 13:16:43.877787  8186 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:43.777760 10300 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.776968 10298 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:43.790316 10123 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:43.882166  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 73358.8us
I20260709 13:16:43.778919 10416 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:43.790418 10230 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:43.792203  8211 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:43.878178  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:43.809535 10429 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.886039  8186 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:43.809306 10287 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:16:43.875514 10183 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:43.884773 10300 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.893110 10298 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.894212 10106 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:43.898164 10411 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:43.895757 10320 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:43.896960 10327 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:16:43.901257  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:43.804811 10385 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:43.904451 10330 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:43.904452  9964 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:43.906577  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1748) took 1315 ms. Trace:
I20260709 13:16:43.973434  8289 rpcz_store.cc:276] 0709 13:16:42.591375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.877336 (+285961us) service_pool.cc:224] Handling call
0709 13:16:42.877747 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.894794 (+ 17047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:42.894824 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.391897 (+497073us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b2c00010988. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fbd0aa11 00007f31fbd1a372 00007f31fd44ca01 00007f31fd41143a 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:16:43.401540 (+  9643us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.711607 (+310067us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:43.711643 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.711710 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.906285 (+194575us) raft_consensus.cc:1685] finished
0709 13:16:43.906303 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.906517 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1209,"raft.queue_time_us":1381,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":8074,"spinlock_wait_cycles":8126336,"thread_start_us":279541,"threads_started":1,"wal-append.queue_time_us":486503}
I20260709 13:16:43.907346  8921 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:43.799903 10412 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.907979 10439 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:43.880692 10402 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.810009 10257 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
I20260709 13:16:43.876093 10335 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:43.878688 10260 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.795979 10306 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.801965  9962 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:43.927119  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 358356us
W20260709 13:16:43.920652  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 375376us
W20260709 13:16:43.930374  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44436.4us
I20260709 13:16:43.788937 10061 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:43.937237  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:43.920120 10303 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.801589 10163 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.042140  8367 raft_consensus.cc:2393] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:43.921445 10230 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.041627  8364 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:43.778652 10423 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.141s
I20260709 13:16:43.714322 10376 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.896713 10409 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:43.964692  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.967700  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:43.969269  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 68070.5us
I20260709 13:16:44.086784  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:43.783937 10425 consensus_queue.cc:1059] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.167s
I20260709 13:16:43.789901 10369 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.993256 10424 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:43.932991 10186 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:43.800448  9977 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:43.931490 10429 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.912179 10263 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:16:43.798236 10187 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:43.938980 10183 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:44.014446 10260 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:44.014875 10335 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.130641 10187 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.132014 10335 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:44.132536 10183 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.010275  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:44.133708  8361 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.981869 10251 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:44.019798  8258 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:44.029600  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:43.929009 10416 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:44.018509  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 209885us
I20260709 13:16:44.006455 10226 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.088248  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:44.093465  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:44.136929  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:44.094247 10385 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.137351  8220 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:44.105242  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.008846 10439 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.051868 10061 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:44.104125 10434 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:44.052794 10230 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:44.145668  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:44.102917 10424 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:44.148145  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 128439us
I20260709 13:16:44.153991  8258 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:44.095605 10442 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:44.154601  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:44.158491  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.163476  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:44.168671  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.137693 10389 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:44.188537 10409 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:44.148801 10260 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:44.143962 10251 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:44.194478  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 159427us
I20260709 13:16:44.196257  8186 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:44.157371 10335 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:44.136250 10327 consensus_queue.cc:1175] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e95b04d03d241329435b6d08dd1f236" responder_term: 6 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:16:44.202337  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 257014us
I20260709 13:16:44.157210 10424 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.157570 10423 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:44.180892 10061 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:44.162281 10425 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:44.208573  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 51376.8us
I20260709 13:16:44.147528 10226 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.250519 10226 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:44.147605 10385 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.159297  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:44.236749 10105 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:44.253176  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:44.212776  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 183265us
I20260709 13:16:44.192414 10208 raft_consensus.cc:3055] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:44.146518  9962 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.200850 10101 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:16:44.172187 10442 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.208125 10260 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:16:44.425877  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 379) took 1276 ms. Trace:
W20260709 13:16:44.326052 10282 consensus_meta.cc:287] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.795s	user 0.010s	sys 0.000s
I20260709 13:16:44.643035 10282 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:44.591724  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.323196 10407 consensus_meta.cc:287] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 13:16:44.299813 10440 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.476s
I20260709 13:16:44.200192 10251 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:44.650025 10440 raft_consensus.cc:3055] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:44.650475 10440 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:44.593832 10455 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:44.650854 10230 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:44.550989  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 385680us
I20260709 13:16:44.651729 10455 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.653231  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:44.578608 10123 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.671s	user 0.010s	sys 0.000s
I20260709 13:16:44.654057 10455 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:44.613947 10463 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:44.624271  8361 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:44.654819  8258 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:44.655273  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1849) took 1084 ms. Trace:
I20260709 13:16:44.265189  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:44.379635  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 543) took 1274 ms. Trace:
I20260709 13:16:44.656850  8218 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:44.657608  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1761) took 1091 ms. Trace:
I20260709 13:16:44.385643 10462 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.658952 10462 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.659497 10462 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:44.626686 10300 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.003s
I20260709 13:16:44.658783  8287 rpcz_store.cc:276] 0709 13:16:43.566165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.566309 (+   144us) service_pool.cc:224] Handling call
0709 13:16:43.568196 (+  1887us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.768463 (+200267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.768509 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.796338 (+ 27829us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.962131 (+165793us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:43.962175 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.962255 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.657392 (+695137us) raft_consensus.cc:1685] finished
0709 13:16:44.657424 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.657551 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35345,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":365168,"threads_started":2,"wal-append.queue_time_us":489536}
I20260709 13:16:44.660770 10300 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.201570 10320 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:44.531706 10399 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.322497 10402 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:44.206925 10389 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.474681  8922 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:44.266830 10298 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:44.379051  8920 consensus_meta.cc:287] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.000s
I20260709 13:16:44.673062  8920 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:44.673291 10320 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:44.655647 10465 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:44.323372 10436 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:16:44.675386 10298 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.377031 10460 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:44.376611 10450 consensus_queue.cc:1059] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.280s
I20260709 13:16:44.682348 10465 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.657066  8926 rpcz_store.cc:276] 0709 13:16:43.105482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.105619 (+   137us) service_pool.cc:224] Handling call
0709 13:16:43.105947 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.449570 (+343623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.379312 (+929742us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54006720d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:44.379539 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788929920}
I20260709 13:16:44.683055 10465 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.654132 10123 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.648401 10407 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.667631 10282 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:44.668511 10385 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.355558 10306 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:44.543588  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.706513  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.669883 10442 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.670148 10208 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:44.670828  8216 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:44.671180 10389 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:44.254184 10425 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:44.671676 10473 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:44.255787  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:44.614840 10458 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:44.673791  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 382) took 1138 ms. Trace:
W20260709 13:16:44.663571 10410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.008s	sys 0.009s
I20260709 13:16:44.673899  8923 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEARNER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:44.674480 10320 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.301211 10412 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.677421  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:44.328891 10424 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.679122 10464 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:44.679497 10474 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:44.679759  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 483546us
I20260709 13:16:44.651297 10440 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.642663  8921 rpcz_store.cc:276] 0709 13:16:43.105814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.105958 (+   144us) service_pool.cc:224] Handling call
0709 13:16:44.381637 (+1275679us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b540024e354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:44.381760 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119983872}
I20260709 13:16:44.682412 10460 raft_consensus.cc:3055] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:44.571826 10429 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.543159  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1434) took 1149 ms. Trace:
I20260709 13:16:44.662896 10300 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.687147  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:44.690313  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:44.694633  8294 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:44.689749  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:44.650913 10163 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.703457 10123 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.703749  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.820634  8926 raft_consensus.cc:2410] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:44.703485 10407 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:44.454351  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:44.322108 10447 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:16:44.653430 10230 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:44.705555  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:44.672713 10399 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.681774 10298 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.708309  8288 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:44.803676 10369 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:44.684216  8361 rpcz_store.cc:276] 0709 13:16:43.570424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.973530 (+403106us) service_pool.cc:224] Handling call
0709 13:16:44.655201 (+681671us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:44.800640  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 123327us
I20260709 13:16:44.823592 10412 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:44.684654 10061 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.804920  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:44.748588  8292 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:44.819058  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 129381us
W20260709 13:16:44.854226  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 49431.7us
W20260709 13:16:44.855551  8258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.728s (SENT) [suppressed 15 similar messages]
I20260709 13:16:44.815150 10474 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.856429 10282 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:44.856994 10282 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:44.857726 10298 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:44.857894 10282 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.858943  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.860699  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.807933  8364 rpcz_store.cc:276] 0709 13:16:43.394119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.032483 (+638364us) service_pool.cc:224] Handling call
0709 13:16:44.032839 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.033097 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:44.077809 (+ 44712us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.542494 (+464685us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.542720 (+   226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.542780 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:44.542838 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.542924 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.543082 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8796,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":8621,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":3214720,"thread_start_us":463565,"threads_started":1,"wal-append.queue_time_us":586598}
I20260709 13:16:44.823069  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:44.808841 10410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.012s	sys 0.015s
I20260709 13:16:44.694288 10455 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.792699  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:44.825014  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.872193  8294 raft_consensus.cc:2368] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
I20260709 13:16:44.801570  8920 rpcz_store.cc:276] 0709 13:16:43.535750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.539021 (+  3271us) service_pool.cc:224] Handling call
0709 13:16:43.636254 (+ 97233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.673528 (+1037274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.673736 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.709028 10385 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:44.800420  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:44.830327  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.807590 10460 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:44.828500 10306 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.804883 10458 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.832820 10100 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:44.808434 10473 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.834969  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:44.859898 10451 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:16:44.818506 10464 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.837229 10320 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.828400 10204 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.837294 10429 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:44.815582  9977 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:44.839193 10399 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.840616 10424 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:44.804302 10425 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.845669  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:44.798897 10467 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:16:44.846606  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1832) took 3632 ms. Trace:
I20260709 13:16:44.847484  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.850210  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:44.801757  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1852) took 1230 ms. Trace:
I20260709 13:16:44.862476  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:44.867098  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.870198  8293 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:44.807957 10462 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.846561 10123 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:44.860265  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:44.826651  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:44.873040  8186 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:44.874257  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:44.854477 10412 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.854334  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:44.878464  8216 raft_consensus.cc:2393] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:44.857913 10474 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:44.927663  8369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1433) took 2277 ms (client timeout 1960 ms). Trace:
W20260709 13:16:44.918553 10479 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:16:44.975493  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 125402us
I20260709 13:16:44.872915 10407 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:44.976574  8364 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:44.976603  8288 raft_consensus.cc:2410] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:44.931777  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:45.011479  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:44.926401 10416 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:44.991055  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:45.017067  8293 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:44.919210  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:44.998194  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:45.017678  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:44.998446  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:44.997845  8369 rpcz_store.cc:269] 0709 13:16:42.650783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.650946 (+   163us) service_pool.cc:224] Handling call
0709 13:16:44.927400 (+2276454us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b54003651d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:44.927573 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4877472640}
I20260709 13:16:44.992060 10412 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.021427  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:44.991122  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 118162us
I20260709 13:16:45.022516  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:45.023546  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:44.990676 10100 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:44.988102  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 132560us
I20260709 13:16:44.976015  8367 rpcz_store.cc:276] 0709 13:16:43.571106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.797259 (+226153us) service_pool.cc:224] Handling call
0709 13:16:44.801532 (+1004273us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400157054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:44.801688 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534846208}
I20260709 13:16:44.923621  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:45.013098  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:44.988584  8360 rpcz_store.cc:276] 0709 13:16:41.214501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.853088 (+638587us) service_pool.cc:224] Handling call
0709 13:16:41.853512 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.444279 (+1590767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.846366 (+1402087us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540018fe54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:44.846546 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3654430080}
I20260709 13:16:44.977856 10369 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.975181 10473 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.929668  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:45.018931  8926 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:45.019460  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:44.863116 10208 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:44.999055  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 124908us
I20260709 13:16:44.990600 10204 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.020721  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:45.001935 10399 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:45.001227  8286 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.017752  8294 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:44.864501 10061 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.027773  8364 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:45.010257 10424 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:45.028687  8186 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:45.020951  8924 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:44.930217 10251 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.031657  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:44.990353 10306 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.988416  9977 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.035084  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:45.027864  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:44.913020 10385 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:44.879251 10455 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.001629 10123 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.028358  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:44.930889 10422 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.918568 10460 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.018661 10407 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:44.923806  9947 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Committing config change with OpId 4.6: config changed from index 2 to 6, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:45.466674  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 493) took 1257 ms. Trace:
I20260709 13:16:45.370380  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1435) took 1975 ms. Trace:
I20260709 13:16:45.074205  8332 leader_election.cc:400] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
W20260709 13:16:45.490396  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 416329us
I20260709 13:16:45.482739  8927 rpcz_store.cc:276] 0709 13:16:44.209654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.209775 (+   121us) service_pool.cc:224] Handling call
0709 13:16:45.465750 (+1255975us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:45.465999 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.466245 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.466281 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.466336 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:45.466380 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.466453 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.466597 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79136512}
I20260709 13:16:45.491149  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:45.491698  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:45.159780  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:45.460489  8365 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:45.493079  8360 rpcz_store.cc:276] 0709 13:16:43.395416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.035783 (+1640367us) service_pool.cc:224] Handling call
0709 13:16:45.038159 (+  2376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.038326 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:45.038358 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:45.038399 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:45.038417 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.038451 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.370303 (+331852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:45.318403  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1835) took 2175 ms. Trace:
I20260709 13:16:45.494774  8368 rpcz_store.cc:276] 0709 13:16:43.143458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.146463 (+  3005us) service_pool.cc:224] Handling call
0709 13:16:43.178790 (+ 32327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.388549 (+209759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.318093 (+1929544us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540010e854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:45.318321 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478280960}
I20260709 13:16:45.496279 10225 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:45.500588  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 492) took 1291 ms. Trace:
I20260709 13:16:45.501132  8924 rpcz_store.cc:276] 0709 13:16:44.209331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.237388 (+ 28057us) service_pool.cc:224] Handling call
0709 13:16:44.845501 (+608113us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:45.500515 (+655014us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50111872}
I20260709 13:16:45.501838 10369 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.502388 10369 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.502624  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:45.503165 10303 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:45.503638  8924 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:45.496979  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 261) took 2265 ms. Trace:
I20260709 13:16:45.497351 10306 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.497536  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:45.033757 10474 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:45.145655 10468 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.073992 10208 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.083653 10298 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:45.384516 10356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.858s	user 0.012s	sys 0.022s
I20260709 13:16:45.527192  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:45.364454 10462 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:45.407210 10465 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.724s	user 0.000s	sys 0.010s
W20260709 13:16:45.103442 10484 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:16:45.437722 10485 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.460s	user 0.001s	sys 0.002s
I20260709 13:16:45.497766 10424 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:45.119294 10339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d3403855d4147a9b056dc8678880fdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:45.103574 10482 log.cc:927] Time spent T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:45.085750 10389 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.040850 10429 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:45.145023 10467 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.141047 10458 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.154976 10204 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.151157 10464 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:45.528188 10319 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.576638 10319 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.577135 10455 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:45.577680 10407 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.534657 10474 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.578992 10251 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.506251 10412 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.422824 10362 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:45.580206 10362 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:16:45.580544 10473 consensus_meta.cc:287] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.002s
I20260709 13:16:45.084646 10399 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:45.580966 10412 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:45.581034 10362 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.581597 10399 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.527644 10422 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.582297 10385 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.575271 10429 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:45.537137 10356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.009s	user 0.024s	sys 0.032s
I20260709 13:16:45.584816 10429 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:45.575448 10389 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.586175 10439 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.568230 10369 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:45.587097 10389 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:45.587518 10467 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.537050 10225 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:45.695394 10204 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:45.696527 10204 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.696630  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:45.697198 10204 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.696714 10225 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.698055  8369 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:45.701571  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 534) took 2698 ms. Trace:
I20260709 13:16:45.701890 10204 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.702216  8925 rpcz_store.cc:276] 0709 13:16:43.003134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.067629 (+ 64495us) service_pool.cc:224] Handling call
0709 13:16:43.208631 (+141002us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.757678 (+549047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.700717 (+1943039us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400214b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:45.701338 (+   621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948142848}
I20260709 13:16:45.541617 10123 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:45.630074  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 601262us
W20260709 13:16:45.630970  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 595777us
I20260709 13:16:45.713269  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 495) took 1502 ms. Trace:
I20260709 13:16:45.713922  8923 rpcz_store.cc:276] 0709 13:16:44.210380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.215244 (+  4864us) service_pool.cc:224] Handling call
0709 13:16:44.673713 (+458469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.802661 (+128948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.712720 (+910059us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54004f6350. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:45.713027 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053370112}
I20260709 13:16:45.587981 10257 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:45.717087 10257 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:45.718575  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.720376 10260 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:45.721726 10260 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.631950  8216 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.392341 10330 raft_consensus.cc:3055] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:45.633072  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1224) took 1274 ms. Trace:
I20260709 13:16:45.539193 10298 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.725660 10330 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:45.725625  8215 rpcz_store.cc:276] 0709 13:16:44.358812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.802127 (+443315us) service_pool.cc:224] Handling call
0709 13:16:44.805972 (+  3845us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:44.820005 (+ 14033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.820025 (+    20us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:44.827551 (+  7526us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.894903 (+ 67352us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:44.894963 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.895067 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.632348 (+737281us) raft_consensus.cc:1685] finished
0709 13:16:45.632408 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.632812 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13614,"raft.queue_time_us":13737,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":3773,"thread_start_us":26393,"threads_started":1,"wal-append.queue_time_us":136814}
W20260709 13:16:45.630074  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.727613 10330 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.102849  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:45.729429 10330 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.730592  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:45.719084 10257 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.635301  8289 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:45.582139 10362 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.732540 10257 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.370406  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:45.733999 10368 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:45.209811  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.596455 10467 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.645961  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:45.647051  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:45.154129  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1754) took 2533 ms. Trace:
I20260709 13:16:45.648290  8363 raft_consensus.cc:2410] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:45.524219  8365 rpcz_store.cc:276] 0709 13:16:43.231359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.996719 (+765360us) service_pool.cc:224] Handling call
0709 13:16:45.459943 (+1463224us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:45.460237 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.496748 (+ 36511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.496926 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4236672}
I20260709 13:16:45.397265  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1839) took 2252 ms. Trace:
W20260709 13:16:45.649858  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.591331 10424 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.650182  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:45.661067  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 161106us
I20260709 13:16:45.041220  8919 raft_consensus.cc:2393] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:45.119791  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:45.101711  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:45.666800  8922 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:45.327440  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:45.506289  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:45.667927  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 491) took 1459 ms. Trace:
I20260709 13:16:45.668591  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:45.677048  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1202) took 3116 ms. Trace:
I20260709 13:16:45.678802  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1214) took 2130 ms. Trace:
I20260709 13:16:45.682235  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:45.084848 10100 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.685196  8286 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:45.690157 10106 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.692296  9977 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.693974 10163 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.694078 10061 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:45.637420  8214 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:16:45.644693  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 145374us
I20260709 13:16:45.086669 10423 raft_consensus.cc:476] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:16:45.412165 10425 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:45.595866 10444 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.479s	user 0.001s	sys 0.001s
I20260709 13:16:45.101441  8361 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 2: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:45.532104 10460 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.699819  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:45.540971 10465 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.534019 10468 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:45.589869 10473 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:45.580490 10474 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:45.091001 10402 consensus_queue.cc:1059] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.447s
I20260709 13:16:45.734810  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:45.992213  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.715989  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:46.002077  8923 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.990922 10440 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.004681 10473 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:45.914562  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.810461  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:45.797160  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:45.999861  8114 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 187) took 10892 ms. Trace:
I20260709 13:16:45.821434  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1241) took 1089 ms. Trace:
I20260709 13:16:45.805758  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 257) took 2575 ms. Trace:
I20260709 13:16:45.723693 10123 consensus_queue.cc:1059] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.237s
I20260709 13:16:45.996416  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1237) took 1283 ms. Trace:
I20260709 13:16:46.020081  8289 rpcz_store.cc:276] 0709 13:16:44.731555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.821067 (+ 89512us) service_pool.cc:224] Handling call
0709 13:16:45.821187 (+1000120us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b5400388e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:45.821367 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739816320}
I20260709 13:16:46.014047  8213 rpcz_store.cc:276] 0709 13:16:43.548012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.548172 (+   160us) service_pool.cc:224] Handling call
0709 13:16:43.772926 (+224754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.786960 (+ 14034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.678354 (+1891394us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54004425d0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:45.678604 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516029312}
I20260709 13:16:46.033921  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.035377  8289 raft_consensus.cc:2410] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:46.035434 10425 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:46.036229  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1261) took 1006 ms. Trace:
W20260709 13:16:46.036465  8361 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1863) took 1212 ms (client timeout 1521 ms). Trace:
I20260709 13:16:46.036736  8289 rpcz_store.cc:276] 0709 13:16:45.030271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.033460 (+1003189us) service_pool.cc:224] Handling call
0709 13:16:46.036125 (+  2665us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.037269 10303 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.038317  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.038054 10303 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.038921 10262 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.039556 10262 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.040562  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.041046  8367 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:45.729454 10298 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:45.995307  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.046591  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1232) took 1020 ms. Trace:
I20260709 13:16:45.994014 10260 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:46.046896  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1248) took 1219 ms. Trace:
I20260709 13:16:45.814610  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:45.741462 10415 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.037144  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.050661  8293 rpcz_store.cc:276] 0709 13:16:44.822359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.734292 (+911933us) service_pool.cc:224] Handling call
0709 13:16:46.041635 (+307343us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.045254  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1356) took 1212 ms. Trace:
I20260709 13:16:46.054859  8289 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:45.741350 10389 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.047068  8218 rpcz_store.cc:276] 0709 13:16:45.026014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.731748 (+705734us) service_pool.cc:224] Handling call
0709 13:16:46.046528 (+314780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.054848 10402 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:46.055019  8220 rpcz_store.cc:276] 0709 13:16:44.819518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.681576 (+862058us) service_pool.cc:224] Handling call
0709 13:16:46.031792 (+350216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.023682  8362 rpcz_store.cc:276] 0709 13:16:43.230218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.506216 (+275998us) service_pool.cc:224] Handling call
0709 13:16:43.566112 (+ 59896us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.577095 (+ 10983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.577130 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:43.577797 (+   667us) log.cc:844] Serialized 52 byte log entry
0709 13:16:45.148438 (+1570641us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b18003a7140. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:16:45.646736 (+498298us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:45.646882 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.805177 (+158295us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5400356e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:45.805228 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.805294 (+    66us) raft_consensus.cc:1685] finished
0709 13:16:45.805307 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.805543 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10908,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":14420,"spinlock_wait_cycles":26721408,"thread_start_us":259786,"threads_started":1,"wal-append.queue_time_us":1981332}
I20260709 13:16:45.742259 10494 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.014071  8928 rpcz_store.cc:276] 0709 13:16:44.208824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.209012 (+   188us) service_pool.cc:224] Handling call
0709 13:16:44.675693 (+466681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.684469 (+  8776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.684502 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.693901 (+  9399us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.850994 (+157093us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.851037 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.851139 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.667338 (+816199us) raft_consensus.cc:1685] finished
0709 13:16:45.667381 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.667694 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12517,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"spinlock_wait_cycles":146176,"thread_start_us":59850,"threads_started":1,"wal-append.queue_time_us":246829}
W20260709 13:16:46.064311  8363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1841) took 2918 ms (client timeout 2189 ms). Trace:
W20260709 13:16:46.036993  8361 rpcz_store.cc:269] 0709 13:16:44.823811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.876677 (+ 52866us) service_pool.cc:224] Handling call
0709 13:16:46.036245 (+1159568us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:46.065788  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 267) took 1979 ms (client timeout 1535 ms). Trace:
I20260709 13:16:46.066457  8365 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:46.067205  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.067324  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.054318  8212 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.068431  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.068508  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.069537  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:46.070201 10163 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:46.070950  8320 heartbeater.cc:646] Failed to heartbeat to 127.6.233.62:38939 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.233.62:38939 timed out after 15.000s (SENT)
W20260709 13:16:46.071363  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.071919 10230 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:46.026574  8291 rpcz_store.cc:276] 0709 13:16:44.712712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.712865 (+   153us) service_pool.cc:224] Handling call
0709 13:16:44.713247 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.860701 (+147454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.860729 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.861113 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.988757 (+127644us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:44.988813 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.436935 (+448122us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:45.995785 (+558850us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002e8bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:45.995872 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.995951 (+    79us) raft_consensus.cc:1685] finished
0709 13:16:45.995965 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.996196 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":71,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":7210,"spinlock_wait_cycles":341546624,"thread_start_us":111607,"threads_started":1,"wal-append.queue_time_us":104192}
I20260709 13:16:46.072644  8294 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.073103  8360 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.073784 10303 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:46.076332 10262 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:46.076404  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.098265 10100 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.098623  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.077085  8369 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:46.099588  8361 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:46.071476  8290 rpcz_store.cc:276] 0709 13:16:42.620317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.917377 (+297060us) service_pool.cc:224] Handling call
0709 13:16:42.917816 (+   439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.584577 (+666761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.153744 (+1569167us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400427054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:45.154042 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491091328}
W20260709 13:16:46.100215  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.100329  9947 consensus_meta.cc:287] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.002s
W20260709 13:16:46.089545  8214 rpcz_store.cc:269] 0709 13:16:44.086057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.093107 (+  7050us) service_pool.cc:224] Handling call
0709 13:16:46.065486 (+1972379us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400198554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.065681 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236841856}
I20260709 13:16:46.101380  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 390) took 1227 ms. Trace:
W20260709 13:16:46.101629  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.060874 10402 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:46.061511  8215 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:46.103329  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1347) took 1290 ms. Trace:
I20260709 13:16:46.103847  8215 rpcz_store.cc:276] 0709 13:16:44.812708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.728662 (+915954us) service_pool.cc:224] Handling call
0709 13:16:46.103257 (+374595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.081900  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1259) took 1060 ms. Trace:
I20260709 13:16:46.085305  8216 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:46.019619  8114 rpcz_store.cc:276] 0709 13:16:35.107427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.112359 (+  4932us) service_pool.cc:224] Handling call
0709 13:16:45.999586 (+10887227us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:42.024146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:42.099667 (+ 75521us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b54003ed6a8. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32037cd9e1 00007f32037cc64c 00007f3200e5bd5d 00007f3200e470a6 00007f3200e46d58 00007f3200e4b9f1 00007f3200e4b9a9 00007f3200e4b939 00007f3200e4b901 00007f3200e4ab2d 000000000038f354
0709 13:16:42.099770 (+   103us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:42.099812 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:16:42.099837 (+    25us) tablet.cc:662] Decoding operations
0709 13:16:42.100967 (+  1130us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:42.101041 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:42.101086 (+    45us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:16:42.106544 (+  5458us) tablet.cc:701] Row locks acquired
0709 13:16:42.106572 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:16:42.106768 (+   196us) write_op.cc:270] Start()
0709 13:16:42.107024 (+   256us) write_op.cc:276] Timestamp: P: 1783603002106709 usec, L: 0
0709 13:16:42.107057 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:16:42.228201 (+121144us) log.cc:844] Serialized 3292 byte log entry
0709 13:16:42.545269 (+317068us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b18001048c0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:16:43.104388 (+559119us) op_driver.cc:464] REPLICATION: finished
0709 13:16:43.439508 (+335120us) write_op.cc:301] APPLY: starting
0709 13:16:43.439599 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:43.439799 (+   200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:43.439822 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:43.440827 (+  1005us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:43.441037 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:16:43.441079 (+    42us) write_op.cc:312] APPLY: finished
0709 13:16:43.441363 (+   284us) log.cc:844] Serialized 65 byte log entry
0709 13:16:43.441533 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:43.441656 (+   123us) write_op.cc:454] Released schema lock
0709 13:16:43.441700 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:43.442051 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:43.442077 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2600871,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":326747,"apply.run_cpu_time_us":2628,"apply.run_wall_time_us":3414,"num_ops":8,"prepare.queue_time_us":523612,"prepare.run_cpu_time_us":45521,"prepare.run_wall_time_us":458495,"raft.queue_time_us":331682,"raft.run_cpu_time_us":38105,"raft.run_wall_time_us":442982,"replication_time_us":892474,"spinlock_wait_cycles":49074688,"thread_start_us":822978,"threads_started":4,"wal-append.queue_time_us":195445,"wal-append.run_cpu_time_us":45417,"wal-append.run_wall_time_us":1907556}]]}
W20260709 13:16:46.086745  8363 rpcz_store.cc:269] 0709 13:16:43.145433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.397305 (+251872us) service_pool.cc:224] Handling call
0709 13:16:45.159566 (+1762261us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:46.060256 (+900690us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540010e354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.064223 (+  3967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391426048}
I20260709 13:16:46.108438  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 497) took 1084 ms. Trace:
I20260709 13:16:46.111011  8369 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.080502  8926 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:46.102061  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.106534  8293 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.107462  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.107829  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:46.099099  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.015640  8211 rpcz_store.cc:276] 0709 13:16:42.560685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.570190 (+  9505us) service_pool.cc:224] Handling call
0709 13:16:43.370765 (+800575us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:43.370985 (+   220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.932259 (+561274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.676310 (+1744051us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b5400093b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:45.676826 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908207872}
I20260709 13:16:46.095808  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:46.112365  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.096827  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.105264  8287 rpcz_store.cc:276] 0709 13:16:45.021687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.813953 (+792266us) service_pool.cc:224] Handling call
0709 13:16:46.081827 (+267874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.101305 10468 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:46.108337  8362 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:46.080956  8286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1251) took 1227 ms (client timeout 1593 ms). Trace:
I20260709 13:16:46.101194  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.081240  8924 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:46.117856  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1437) took 2720 ms. Trace:
I20260709 13:16:46.108639  8219 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:46.101634 10262 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.101843  8919 rpcz_store.cc:276] 0709 13:16:44.862994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.931508 (+ 68514us) service_pool.cc:224] Handling call
0709 13:16:46.087671 (+1156163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.122748  8218 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:46.113065  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.147531  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.146430  8369 rpcz_store.cc:276] 0709 13:16:43.396261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.099949 (+2703688us) service_pool.cc:224] Handling call
0709 13:16:46.102343 (+  2394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.116392 (+ 14049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.116588 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.152525  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1231) took 1128 ms. Trace:
I20260709 13:16:46.061144 10415 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.145489  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1229) took 1126 ms. Trace:
I20260709 13:16:46.152959  8219 rpcz_store.cc:276] 0709 13:16:45.024356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.067030 (+1042674us) service_pool.cc:224] Handling call
0709 13:16:46.152439 (+ 85409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.154170  8216 rpcz_store.cc:276] 0709 13:16:45.018909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.031447 (+ 12538us) service_pool.cc:224] Handling call
0709 13:16:46.120710 (+1089263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.160413  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 502) took 1124 ms. Trace:
W20260709 13:16:46.162628  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.160854  8926 rpcz_store.cc:276] 0709 13:16:45.036367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.177898 (+141531us) service_pool.cc:224] Handling call
0709 13:16:46.154880 (+976982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.161182  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.164196  8220 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:46.119760 10465 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.164698  8363 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.169028  8290 raft_consensus.cc:2368] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:46.111048  8920 rpcz_store.cc:276] 0709 13:16:45.023487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.119442 (+ 95955us) service_pool.cc:224] Handling call
0709 13:16:46.108196 (+988754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.175040  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:46.173091  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48574 (request call id 11) took 3260 ms. Trace:
I20260709 13:16:46.162416 10474 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.181006  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1769) took 1990 ms. Trace:
I20260709 13:16:46.182343  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1438) took 2775 ms. Trace:
I20260709 13:16:46.182628  8368 rpcz_store.cc:276] 0709 13:16:43.402775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.114869 (+2712094us) service_pool.cc:224] Handling call
0709 13:16:46.163908 (+ 49039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.173525 (+  9617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.173554 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.178128 (+  4574us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.178174 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.178236 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.178348 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:46.150739  8286 rpcz_store.cc:269] 0709 13:16:44.833178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.860015 (+ 26837us) service_pool.cc:224] Handling call
0709 13:16:46.055656 (+1195641us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.177790  8217 rpcz_store.cc:276] 0709 13:16:42.815403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.815934 (+   531us) service_pool.cc:224] Handling call
0709 13:16:46.034636 (+3218702us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b54001f6ba0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd38e520 00007f31fd40b652 00007f32023d960a 00007f31fb95f7d4 00007f31fb95f762 00007f31fb95f691 00007f31fb95f60c 00007f31fb95e8c2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:46.042518 (+  7882us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400092754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd40b853 00007f32023d960a 00007f31fb95f7d4 00007f31fb95f762 00007f31fb95f691 00007f31fb95f60c 00007f31fb95e8c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.054487 (+ 11969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1965713536}
I20260709 13:16:46.183655  8215 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:46.150297 10389 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:46.187453  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 179124us
I20260709 13:16:46.157040 10262 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:46.190443  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.160481  9977 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.190982  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.177842  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:46.157660 10230 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.123202  8366 rpcz_store.cc:276] 0709 13:16:43.144848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.145204 (+   356us) service_pool.cc:224] Handling call
0709 13:16:43.145560 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.469119 (+323559us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:43.779308 (+310189us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.008706 (+229398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.008758 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:44.008805 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.380473 (+371668us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b180036ed40. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:16:45.154879 (+774406us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400405954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:45.387939 (+233060us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.397176 (+  9237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8889,"prepare.queue_time_us":317953,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":84,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":17523,"spinlock_wait_cycles":786543232,"thread_start_us":512031,"threads_started":2,"wal-append.queue_time_us":597791,"wal-append.run_cpu_time_us":1207,"wal-append.run_wall_time_us":1001234}
I20260709 13:16:46.198943 10376 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.199307 10318 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:46.201007  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1441) took 2658 ms. Trace:
I20260709 13:16:46.193670  8922 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:16:46.202494  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.204363  8365 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.161500 10494 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.206940  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.200309 10402 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.206823  8369 rpcz_store.cc:276] 0709 13:16:43.542520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.153714 (+2611194us) service_pool.cc:224] Handling call
0709 13:16:46.195325 (+ 41611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.200537 (+  5212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.200574 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.200658 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.200705 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.200793 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.200934 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.191699 10225 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:46.209415  8291 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:16:46.214666  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.208343  8287 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:46.208297  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1353) took 1389 ms. Trace:
I20260709 13:16:46.211686  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1440) took 2669 ms. Trace:
I20260709 13:16:46.226347  8213 rpcz_store.cc:276] 0709 13:16:44.814598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.203060 (+1388462us) service_pool.cc:224] Handling call
0709 13:16:46.203535 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.203896 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.203932 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.204032 (+   100us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:46.204089 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.204154 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.204292 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.215381  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:46.226683  8365 rpcz_store.cc:276] 0709 13:16:43.542266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.154145 (+2611879us) service_pool.cc:224] Handling call
0709 13:16:46.182052 (+ 27907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.211435 (+ 29383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.211629 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.229743  8928 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.216672  8291 pending_rounds.cc:85] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 3
I20260709 13:16:46.196210  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.181834  8295 rpcz_store.cc:276] 0709 13:16:44.090441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.090906 (+   465us) service_pool.cc:224] Handling call
0709 13:16:44.106634 (+ 15728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.643991 (+537357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.644023 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.644534 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.684496 (+ 39962us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:44.684556 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.801180 (+1116624us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54002e7cd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:45.801251 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:46.016168 (+214917us) raft_consensus.cc:1685] finished
0709 13:16:46.016196 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.080858 (+ 64662us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1134,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":1234932608,"thread_start_us":39400,"threads_started":1,"wal-append.queue_time_us":59376,"wal-append.run_cpu_time_us":1995,"wal-append.run_wall_time_us":1093172}
W20260709 13:16:46.231534  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.232908  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1238) took 1496 ms. Trace:
I20260709 13:16:46.234620  8289 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:46.234172  8287 rpcz_store.cc:276] 0709 13:16:44.730587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.148123 (+1417536us) service_pool.cc:224] Handling call
0709 13:16:46.184320 (+ 36197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.226319 (+ 41999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.226514 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.224083 10303 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.242515  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.230325  8291 pending_rounds.cc:107] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:16:46.239501  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1239) took 1508 ms. Trace:
I20260709 13:16:46.235472  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 1865) took 1395 ms. Trace:
I20260709 13:16:46.246078  8291 raft_consensus.cc:2889] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.240338  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 545) took 1550 ms. Trace:
I20260709 13:16:46.246217  8289 rpcz_store.cc:276] 0709 13:16:44.730961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.171807 (+1440846us) service_pool.cc:224] Handling call
0709 13:16:46.204724 (+ 32917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.239209 (+ 34485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.239426 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.246812  8928 rpcz_store.cc:276] 0709 13:16:44.685935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.155915 (+1469980us) service_pool.cc:224] Handling call
0709 13:16:46.185589 (+ 29674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.235938 (+ 50349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.236140 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.241331  8925 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.223714  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 500) took 1119 ms. Trace:
I20260709 13:16:46.246279  8367 rpcz_store.cc:276] 0709 13:16:44.839830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.027643 (+187813us) service_pool.cc:224] Handling call
0709 13:16:46.220898 (+1193255us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54000f23d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.235422 (+ 14524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284411648}
I20260709 13:16:46.228575  8217 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:46.257907  8286 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:16:46.248711  8927 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:46.210238 10474 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.263422  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1256) took 1254 ms. Trace:
I20260709 13:16:46.265050  8286 rpcz_store.cc:276] 0709 13:16:45.004725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.214045 (+1209320us) service_pool.cc:224] Handling call
0709 13:16:46.248432 (+ 34387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.258506 (+ 10074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.258800 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.262177  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1240) took 1531 ms. Trace:
I20260709 13:16:46.260795  8290 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.266455  8291 rpcz_store.cc:276] 0709 13:16:44.731258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.189917 (+1458659us) service_pool.cc:224] Handling call
0709 13:16:46.208883 (+ 18966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.261814 (+ 52931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.262107 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.258726  8361 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 3: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:46.269685  8220 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:46.270520  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1246) took 1465 ms. Trace:
W20260709 13:16:46.272276  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.274274  8215 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:46.269305  8369 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:46.281394  8295 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:46.281605  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1226) took 1601 ms. Trace:
I20260709 13:16:46.276659  8369 pending_rounds.cc:85] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:16:46.266851  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:46.283986  8369 pending_rounds.cc:107] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.3
I20260709 13:16:46.284365  8369 raft_consensus.cc:2917] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Aborting config change with OpId 3.3: Aborted: Op aborted by new leader
I20260709 13:16:46.284569  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1257) took 1274 ms. Trace:
I20260709 13:16:46.282047  8215 rpcz_store.cc:276] 0709 13:16:44.673825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.204412 (+1530587us) service_pool.cc:224] Handling call
0709 13:16:46.237418 (+ 33006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.274648 (+ 37230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.274821 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.277151  8290 rpcz_store.cc:276] 0709 13:16:44.805554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.196340 (+1390786us) service_pool.cc:224] Handling call
0709 13:16:46.236416 (+ 40076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.270328 (+ 33912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.270477 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.285038  8295 rpcz_store.cc:276] 0709 13:16:45.009826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.231782 (+1221956us) service_pool.cc:224] Handling call
0709 13:16:46.255735 (+ 23953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.284312 (+ 28577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.284517 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.287202  8211 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.287973  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1228) took 1277 ms. Trace:
I20260709 13:16:46.288318  8211 rpcz_store.cc:276] 0709 13:16:45.010900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.275172 (+1264272us) service_pool.cc:224] Handling call
0709 13:16:46.286948 (+ 11776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.287669 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.287889 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:46.290304 10208 consensus_meta.cc:287] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.754s	user 0.004s	sys 0.011s
I20260709 13:16:46.282454  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1355) took 1456 ms. Trace:
I20260709 13:16:46.294468  8220 rpcz_store.cc:276] 0709 13:16:44.819320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.226019 (+1406699us) service_pool.cc:224] Handling call
0709 13:16:46.260156 (+ 34137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.271371 (+ 11215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.271625 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.241710  9977 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:46.311144  8261 connection.cc:256] RPC call timeout handler was delayed by -1.4906456980002076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:16:46.311692  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.312485  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:46.313004  9977 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.313184  8361 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.313315  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1439) took 2910 ms. Trace:
I20260709 13:16:46.313874  8363 rpcz_store.cc:276] 0709 13:16:43.403087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.110827 (+2707740us) service_pool.cc:224] Handling call
0709 13:16:46.117834 (+  7007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.170411 (+ 52577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.312979 (+142568us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b5400354154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:46.313224 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107224320}
I20260709 13:16:46.314934  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:46.297187  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 100562us
I20260709 13:16:46.298249 10342 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.298631  8211 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.298700 10260 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:46.299754  8286 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:46.328578  8287 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.267896 10462 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:46.290863 10123 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:46.304836 10402 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.305138 10106 raft_consensus.cc:3055] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:46.311059  8216 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:46.307960  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 549) took 1600 ms. Trace:
W20260709 13:16:46.294167  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 58397.3us
I20260709 13:16:46.271971  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 547) took 1578 ms. Trace:
I20260709 13:16:46.253196  8921 rpcz_store.cc:276] 0709 13:16:45.030080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.037860 (+  7780us) service_pool.cc:224] Handling call
0709 13:16:46.121404 (+1083544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.320027  8360 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:46.319993  8289 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.321414  8294 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:46.280679  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.327030 10262 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:46.325876 10230 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:46.300765 10257 consensus_meta.cc:287] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.007s
I20260709 13:16:46.326310  8919 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:46.331369  8369 raft_consensus.cc:2889] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.364928  8367 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:46.260381 10225 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.287211  8214 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:16:46.333895  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.333961  8920 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.327175 10163 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.334421 10473 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.334952  8115 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.329843 10342 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.340312  8218 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:46.344466  8926 rpcz_store.cc:276] 0709 13:16:44.707347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.306971 (+1599624us) service_pool.cc:224] Handling call
0709 13:16:46.307346 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.307660 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.307683 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.307718 (+    35us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.307745 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.307792 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.307892 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:46.347553 10362 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.597s	user 0.014s	sys 0.000s
I20260709 13:16:46.347725 10208 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:46.348014  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 46609.7us
I20260709 13:16:46.354236  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1243) took 1613 ms. Trace:
I20260709 13:16:46.266422 10303 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.360980  8220 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:46.397040  8213 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:16:46.375000  8366 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:46.398182  8366 pending_rounds.cc:85] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:16:46.343696 10106 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:46.385598  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:46.396998 10467 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.396945  8294 rpcz_store.cc:276] 0709 13:16:44.746306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.645132 (+898826us) service_pool.cc:224] Handling call
0709 13:16:46.354182 (+709050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.345796  8925 rpcz_store.cc:276] 0709 13:16:44.694171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.179742 (+1485571us) service_pool.cc:224] Handling call
0709 13:16:46.233322 (+ 53580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.255072 (+ 21750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.268624 (+ 13552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.365666  8215 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.377033  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1856) took 2787 ms. Trace:
W20260709 13:16:46.418614  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.399349  8366 pending_rounds.cc:107] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:46.409669  8362 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:46.414081  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 550) took 1664 ms. Trace:
I20260709 13:16:46.414342 10303 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:46.418882  8367 rpcz_store.cc:276] 0709 13:16:43.578474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.263752 (+2685278us) service_pool.cc:224] Handling call
0709 13:16:46.362575 (+ 98823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.365472 (+  2897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.365738 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.423293  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59406 (request call id 9) took 11244 ms. Trace:
I20260709 13:16:46.415668 10106 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.424489 10106 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.424969  8926 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.425639  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 393) took 1551 ms. Trace:
I20260709 13:16:46.425938  8926 rpcz_store.cc:276] 0709 13:16:44.873884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.403217 (+1529333us) service_pool.cc:224] Handling call
0709 13:16:46.424715 (+ 21498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.425375 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.425546 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.427204  8926 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.416733 10208 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.428364  8292 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:46.429280 10225 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:46.398108  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:46.423241  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.419251  8366 raft_consensus.cc:2889] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.414565  8922 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:46.436161  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.429755  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1230) took 1397 ms. Trace:
W20260709 13:16:46.437896  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 73995.7us
I20260709 13:16:46.440737  8360 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:46.384688 10460 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:46.441771  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:46.444923  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.450723  8293 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:46.451406  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1260) took 1423 ms. Trace:
I20260709 13:16:46.451787  8293 rpcz_store.cc:276] 0709 13:16:45.028138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.062832 (+1034694us) service_pool.cc:224] Handling call
0709 13:16:46.451335 (+388503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.419059  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 385) took 1614 ms. Trace:
W20260709 13:16:46.456626  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 71665.5us
I20260709 13:16:46.429549 10208 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.437419  8214 rpcz_store.cc:276] 0709 13:16:45.020929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.275945 (+1255016us) service_pool.cc:224] Handling call
0709 13:16:46.286817 (+ 10872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.384227 (+ 97410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.405782 (+ 21555us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:46.463375  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 198628us
I20260709 13:16:46.463414  8362 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:46.463714  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.466238  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.435635  8115 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.464243  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1853) took 2892 ms. Trace:
I20260709 13:16:46.466907  8366 rpcz_store.cc:276] 0709 13:16:43.571339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.232818 (+2661479us) service_pool.cc:224] Handling call
0709 13:16:46.270024 (+ 37206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.463925 (+193901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.464172 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.468479  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.470206  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.471032  8367 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 2.
I20260709 13:16:46.393265 10473 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.475742  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:46.481417  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.419183 10123 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:16:46.483724  8363 raft_consensus.cc:2410] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:46.465413 10460 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.486929 10460 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.487506 10425 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.488087 10425 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.459532  8919 rpcz_store.cc:276] 0709 13:16:44.804712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.325556 (+1520844us) service_pool.cc:224] Handling call
0709 13:16:46.325995 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.374064 (+ 48069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.403719 (+ 29655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.492986  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.493608  8366 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:46.494524  8366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:46.495185  8366 raft_consensus.cc:606] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:46.495532  8366 raft_consensus.cc:614] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:46.496788  8926 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:46.496997 10330 consensus_meta.cc:287] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.767s	user 0.012s	sys 0.004s
I20260709 13:16:46.435436 10467 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.497596  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 505) took 1013 ms. Trace:
I20260709 13:16:46.497972  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:46.498087  8926 rpcz_store.cc:276] 0709 13:16:45.484276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.430380 (+946104us) service_pool.cc:224] Handling call
0709 13:16:46.477375 (+ 46995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.497256 (+ 19881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.497505 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:46.499320  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.499397 10467 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.423735  8369 rpcz_store.cc:276] 0709 13:16:35.179425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.179606 (+   181us) service_pool.cc:224] Handling call
0709 13:16:35.326899 (+147293us) log.cc:844] Serialized 492 byte log entry
0709 13:16:35.507066 (+180167us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b540026bc20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd38a142 00007f31fd36aeaa 00007f31fd371d53 00007f31fd371cd9 00007f31fd371c69 00007f31fd371c31 00007f31fd370dfd 000000000038f354 000000000038f199 00007f31fa324475
0709 13:16:35.521613 (+ 14547us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b540026bc20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd38a142 00007f31fd36aeaa 00007f31fd371d53 00007f31fd371cd9 00007f31fd371c69 00007f31fd371c31 00007f31fd370dfd 000000000038f354 000000000038f199 00007f31fa324475
0709 13:16:46.423188 (+10901575us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16058,"raft.queue_time_us":81007,"raft.run_cpu_time_us":4113,"raft.run_wall_time_us":92675,"spinlock_wait_cycles":15262464,"thread_start_us":109213,"threads_started":1,"wal-append.queue_time_us":193329,"wal-append.run_cpu_time_us":1899,"wal-append.run_wall_time_us":1001940}
I20260709 13:16:46.422323  8920 rpcz_store.cc:276] 0709 13:16:44.749788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.197293 (+1447505us) service_pool.cc:224] Handling call
0709 13:16:46.293779 (+ 96486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.384256 (+ 90477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.414003 (+ 29747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.469390 10303 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:46.509385  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.515257  8294 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:46.509850  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.393574 10462 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.513661  8361 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:46.514010  8288 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:46.519874 10474 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.520670  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 265) took 3609 ms. Trace:
I20260709 13:16:46.521122  8212 rpcz_store.cc:276] 0709 13:16:42.910895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.916182 (+  5287us) service_pool.cc:224] Handling call
0709 13:16:43.118584 (+202402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.107023 (+2988439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.520347 (+413324us) spinlock_profiling.cc:243] Waited 2.92 s on lock 0x7b5400092754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:46.520601 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6712925440}
I20260709 13:16:46.522152 10415 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:46.522248  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.522843  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1850) took 2952 ms. Trace:
I20260709 13:16:46.523195  8369 rpcz_store.cc:276] 0709 13:16:43.570662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.216899 (+2646237us) service_pool.cc:224] Handling call
0709 13:16:46.257324 (+ 40425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.522602 (+265278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.522769 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.507860 10467 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.524534  8369 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.524430 10467 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:46.525700  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1859) took 1719 ms. Trace:
I20260709 13:16:46.526093  8362 rpcz_store.cc:276] 0709 13:16:44.806372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.501258 (+1694886us) service_pool.cc:224] Handling call
0709 13:16:46.525188 (+ 23930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.525367 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.525398 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.525435 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:46.525488 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.525543 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.525647 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:46.526755  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 8d3403855d4147a9b056dc8678880fdf: Aborted: Op aborted by new leader
I20260709 13:16:46.476487 10494 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:46.477087  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 501) took 1436 ms. Trace:
W20260709 13:16:46.527784  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 50218.1us
I20260709 13:16:46.527755  8362 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [2.5-3.6]
I20260709 13:16:46.532141  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.529395  8367 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:46.537900  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1851) took 2944 ms. Trace:
I20260709 13:16:46.533486  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1357) took 1713 ms. Trace:
I20260709 13:16:46.538625  8213 rpcz_store.cc:276] 0709 13:16:44.819670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.227415 (+1407745us) service_pool.cc:224] Handling call
0709 13:16:46.396782 (+169367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.419292 (+ 22510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.533288 (+113996us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000357d0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.533408 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357470080}
I20260709 13:16:46.529471  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1860) took 1718 ms. Trace:
I20260709 13:16:46.540827  8369 rpcz_store.cc:276] 0709 13:16:44.806529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.523989 (+1717460us) service_pool.cc:224] Handling call
0709 13:16:46.524361 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.524941 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.525093 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.536804  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.528868  8115 catalog_manager.cc:5697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.510605 10208 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.545929  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1861) took 1731 ms. Trace:
I20260709 13:16:46.514216 10465 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:46.547693  8926 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:46.550323  8290 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.551182  8928 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:16:46.548995  8362 rpcz_store.cc:276] 0709 13:16:44.806672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.527085 (+1720413us) service_pool.cc:224] Handling call
0709 13:16:46.527481 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.537631 (+ 10150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.537832 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.538563  8368 rpcz_store.cc:276] 0709 13:16:43.570873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.225561 (+2654688us) service_pool.cc:224] Handling call
0709 13:16:46.250304 (+ 24743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.280353 (+ 30049us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:46.375776 (+ 95423us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.514671 (+138895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.514732 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.514778 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.514846 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.514954 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4955,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":12077,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1287,"thread_start_us":106588,"threads_started":2}
I20260709 13:16:46.529807  8925 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:46.547608  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.536377  8922 rpcz_store.cc:276] 0709 13:16:45.032833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.413677 (+1380844us) service_pool.cc:224] Handling call
0709 13:16:46.414155 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.441675 (+ 27520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.465342 (+ 23667us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:46.559147  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47246.6us
I20260709 13:16:46.564309  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:46.565068  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.565811  8924 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:46.566077  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:46.568343  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 499) took 1538 ms. Trace:
I20260709 13:16:46.560674 10208 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.573786  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:46.574258 10208 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.574834 10100 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:46.575582 10342 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:46.576457  8292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1252) took 1743 ms (client timeout 1663 ms). Trace:
I20260709 13:16:46.570111  8927 rpcz_store.cc:276] 0709 13:16:45.029799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.505963 (+476164us) service_pool.cc:224] Handling call
0709 13:16:46.557536 (+1051573us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540062eb54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.568283 (+ 10747us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300546432}
W20260709 13:16:46.567886  8923 consensus_meta.cc:287] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.000s
I20260709 13:16:46.566610  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 506) took 1071 ms. Trace:
W20260709 13:16:46.578653  8292 rpcz_store.cc:269] 0709 13:16:44.833477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.860495 (+ 27018us) service_pool.cc:224] Handling call
0709 13:16:46.576190 (+1715695us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540005da54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.576362 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3603461504}
I20260709 13:16:46.599453  8366 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.600348  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 264) took 1107 ms. Trace:
I20260709 13:16:46.600728  8366 rpcz_store.cc:276] 0709 13:16:45.493009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.548543 (+1055534us) service_pool.cc:224] Handling call
0709 13:16:46.585400 (+ 36857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.600037 (+ 14637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.600279 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.602331  8363 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:46.588222  8925 rpcz_store.cc:276] 0709 13:16:45.494962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.440215 (+945253us) service_pool.cc:224] Handling call
0709 13:16:46.529600 (+ 89385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.562610 (+ 33010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.566528 (+  3918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:46.605762  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 387) took 1790 ms. Trace:
I20260709 13:16:46.606176  8921 rpcz_store.cc:276] 0709 13:16:44.815440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.351205 (+1535765us) service_pool.cc:224] Handling call
0709 13:16:46.351710 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.358509 (+  6799us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:46.477237 (+118728us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.604784 (+127547us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b180027ef80. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287 00007f31fd42c208
0709 13:16:46.605204 (+   420us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.605376 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.605431 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.605492 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.605566 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.605702 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3918,"prepare.queue_time_us":107885,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":98,"spinlock_wait_cycles":17209088,"thread_start_us":79152,"threads_started":2}
I20260709 13:16:46.608858  8927 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:46.610162 10473 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.611128  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.612412  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1436) took 3216 ms. Trace:
I20260709 13:16:46.612809  8364 rpcz_store.cc:276] 0709 13:16:43.395801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.505935 (+2110134us) service_pool.cc:224] Handling call
0709 13:16:45.506241 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:45.726511 (+220270us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:46.191377 (+464866us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.417635 (+226258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.417680 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.417721 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.577109 (+159388us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54000a3a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:46.577202 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.612214 (+ 35012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":446,"prepare.queue_time_us":544168,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":17540,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":161,"spinlock_wait_cycles":505309568,"thread_start_us":646672,"threads_started":2,"wal-append.queue_time_us":234375}
I20260709 13:16:46.575623 10494 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:16:46.615696 10494 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:46.616024 10494 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:46.616943 10494 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.618196 10494 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.620345  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.621116  8926 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:46.584105  8115 catalog_manager.cc:5697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 2, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.625486  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1443) took 3046 ms. Trace:
I20260709 13:16:46.578255 10474 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:46.637445  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 64141.4us
W20260709 13:16:46.638867  8288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1255) took 1635 ms (client timeout 1659 ms). Trace:
W20260709 13:16:46.643488  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 56587.7us
W20260709 13:16:46.643539  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 87065.3us
W20260709 13:16:46.639293  8288 rpcz_store.cc:269] 0709 13:16:45.003938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.017350 (+ 13412us) service_pool.cc:224] Handling call
0709 13:16:46.633908 (+1616558us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400024754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.638809 (+  4901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2726738304}
W20260709 13:16:46.647167  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.587249  8923 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:46.652793 10318 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:46.654039  9977 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:46.654526  9977 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.654897  9977 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.657263  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.658159  8213 raft_consensus.cc:2410] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:46.659256  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.659869  8212 raft_consensus.cc:2376] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5. Re-sending same reply.
W20260709 13:16:46.660142  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 70429.1us
I20260709 13:16:46.661412  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.633471 10402 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:46.661439  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:46.669644  8261 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:46.672034  8926 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:46.674063  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1354) took 1859 ms. Trace:
I20260709 13:16:46.674414  8217 rpcz_store.cc:276] 0709 13:16:44.814873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.222444 (+1407571us) service_pool.cc:224] Handling call
0709 13:16:46.222951 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.228270 (+  5319us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:46.413161 (+184891us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.669529 (+256368us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.673770 (+  4241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.673821 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:46.673866 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.673930 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.674022 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13102,"prepare.queue_time_us":36811,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":1740,"raft.queue_time_us":42522,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":9153,"thread_start_us":187740,"threads_started":2,"wal-append.queue_time_us":157283}
I20260709 13:16:46.676702 10262 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:46.683030 10262 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:46.684221 10262 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.687449 10262 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.688273  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.691108  8288 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.691712  8290 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:46.686023  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.687697  8115 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 3, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 3 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.678503 10473 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:46.697163  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.694500 10342 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:46.706590 10342 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.706972 10342 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:46.698184  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:46.704445 10505 consensus_queue.cc:1059] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:16:46.711129  8922 raft_consensus.cc:2376] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5. Re-sending same reply.
I20260709 13:16:46.711359 10389 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:46.711643 10505 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:46.712199 10507 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:46.712469 10106 raft_consensus.cc:3055] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:46.712920 10106 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:46.713295 10505 raft_consensus.cc:3055] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:46.713742 10505 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:46.713828  8294 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:46.713925 10106 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.714692 10505 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.715670 10462 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:46.711686 10422 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:16:46.650254 10474 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.697716  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.723204  8293 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:46.705853 10473 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.724002 10473 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:46.725163  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.725044  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 552) took 1933 ms. Trace:
I20260709 13:16:46.727281 10424 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:46.727241  8924 rpcz_store.cc:276] 0709 13:16:44.792215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.301170 (+1508955us) service_pool.cc:224] Handling call
0709 13:16:46.565306 (+264136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.569825 (+  4519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.724749 (+154924us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540062eb50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:46.724938 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600321792}
I20260709 13:16:46.715622 10106 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.738497 10402 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:46.739004 10402 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.731746 10163 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:46.739862  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:46.732232  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet a15d60ee93c04debb4b2f6a595555fbb: Illegal state: Replica 8ff54842a32a414d8cbb4a3f32527f4a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:16:46.740773  8218 raft_consensus.cc:2410] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:46.740654  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.741863  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.742273  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:46.742714  8214 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:46.743409  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.744160  8215 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:46.744812  8287 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:46.745294  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.745911  8213 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:46.746141 10462 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:46.746501 10462 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.625998  8360 rpcz_store.cc:276] 0709 13:16:43.582338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.479651 (+2897313us) service_pool.cc:224] Handling call
0709 13:16:46.523588 (+ 43937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.523932 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:46.524308 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.624631 (+100323us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.624980 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.625155 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.625203 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:46.625246 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.625309 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.625424 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12056,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":3662,"thread_start_us":99749,"threads_started":1}
I20260709 13:16:46.746814  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.747407  8293 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.747543 10424 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:46.748308  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.749490 10339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56040 (request call id 367) took 6346 ms. Trace:
I20260709 13:16:46.749580 10424 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:46.751101  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.751869  8295 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:46.750602 10424 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.753376  8367 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:46.753748  8367 pending_rounds.cc:85] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:16:46.753993  8367 pending_rounds.cc:107] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:46.754261  8367 raft_consensus.cc:2889] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.754905  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.756390  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:46.756249  8115 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.733458 10506 consensus_queue.cc:1059] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:46.736128 10318 consensus_queue.cc:1059] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:46.757244  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 551) took 1981 ms. Trace:
I20260709 13:16:46.757645  8928 rpcz_store.cc:276] 0709 13:16:44.776196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.249881 (+1473685us) service_pool.cc:224] Handling call
0709 13:16:46.297728 (+ 47847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.551702 (+253974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.757001 (+205299us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54003df754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:46.757187 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568398208}
I20260709 13:16:46.758339  8115 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.768879  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1854) took 3197 ms. Trace:
I20260709 13:16:46.769105  8115 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 3, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 3 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.769404  8365 rpcz_store.cc:276] 0709 13:16:43.571581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.243341 (+2671760us) service_pool.cc:224] Handling call
0709 13:16:46.271649 (+ 28308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.438458 (+166809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.438488 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.445230 (+  6742us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:46.445275 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.768671 (+323396us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54003656d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:46.768710 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.768807 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314308352}
I20260709 13:16:46.771097  8365 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:46.772358  8368 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:46.772699  8368 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:46.772941  8364 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:46.773336  8364 pending_rounds.cc:85] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 3
I20260709 13:16:46.773559  8364 pending_rounds.cc:107] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:46.773999  8364 raft_consensus.cc:2889] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.773516  8368 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.774497 10422 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:46.774709  8368 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.775225 10422 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:46.736387  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:46.777176 10123 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:46.777601 10123 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:46.778697 10422 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.778553 10123 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.780238  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.780444  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.781024  8214 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.779752 10415 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:46.782274 10415 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:46.782544  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.783218  8220 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 1.
I20260709 13:16:46.759785  8369 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.783685  8367 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:46.784461  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.762210  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.785241  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:46.756933  8363 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:46.764250 10467 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.759351 10425 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:46.747520  8287 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:46.776369 10506 raft_consensus.cc:3055] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:46.776530  8360 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:46.781571  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.782711 10415 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.779757 10123 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.768940  8362 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:46.749815  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.801182  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.801623  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.760660  8294 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:46.801992  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.733626  8919 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:46.761543 10474 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:46.749922 10339 rpcz_store.cc:276] 0709 13:16:40.408381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.413105 (+  4724us) service_pool.cc:224] Handling call
0709 13:16:41.056931 (+643826us) ts_tablet_manager.cc:934] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
0709 13:16:45.071401 (+4014470us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:46.429789 (+1358388us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:46.437242 (+  7453us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:46.748466 (+311224us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:46.748849 (+   383us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:46.749168 (+   319us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:46.749273 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":270,"tablet-copy.queue_time_us":385527,"thread_start_us":341636,"threads_started":2}
I20260709 13:16:46.763358  9977 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.813547  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.793435  8365 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:46.814740  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.815752 10339 tablet_copy_client.cc:806] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:46.796523  8293 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:46.794899  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:46.718014 10505 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:46.821924  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:46.804126  8367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:46.794153 10506 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:46.808641  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.808856  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.746834 10462 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.809614  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.822110  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.810227  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.815886  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.826355  8216 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:46.767738 10473 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:46.817312  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.839003  8215 raft_consensus.cc:2368] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
I20260709 13:16:46.818215  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.841392  8213 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:46.819614  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.836395  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.845122  8293 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
W20260709 13:16:46.853705  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.856647  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.858703  8212 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:46.859644  8292 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:46.859406  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 130715us
I20260709 13:16:46.863902  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.864763  8286 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:46.855630  8367 raft_consensus.cc:606] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:16:46.866331  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.867076  8220 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:46.871455  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.872323  8216 raft_consensus.cc:2393] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:46.872378  8288 raft_consensus.cc:2368] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
I20260709 13:16:46.823945 10339 tablet_copy_client.cc:670] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:46.880672  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.882452  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.876883  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:46.883533  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.878625  8287 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:46.884721  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.885427  8213 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 1.
I20260709 13:16:46.881753  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:46.885809  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.882242  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.888171  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:46.889186  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 67358.8us
I20260709 13:16:46.864414 10474 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:46.890413  8215 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:46.890744  8220 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:46.881369 10230 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:46.900259  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.900192  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 105362us
I20260709 13:16:46.902099 10424 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.904902 10402 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.907354  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.912621 10506 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:46.913829  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:46.914820 10473 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:46.876211 10330 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:46.929102  8219 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.932935  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.932929  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:46.932307  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 71124.7us
I20260709 13:16:46.940557  8215 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:46.943508  8286 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:46.948684  8892 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:46.952337  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:46.931620 10330 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:46.955593  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.958916  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:46.955354  8368 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:46.960371  8368 pending_rounds.cc:85] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:16:46.960752  8368 pending_rounds.cc:107] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:46.960445  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:46.961453  8368 raft_consensus.cc:2889] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:46.941679 10425 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.964599  8367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:46.965340  8367 raft_consensus.cc:606] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:46.965782  8367 raft_consensus.cc:614] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:46.967617  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.968860  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:46.951388 10519 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:46.948192 10376 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:46.975822  8220 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:46.962642 10330 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:46.980901  8295 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:46.981544  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 95024.5us
I20260709 13:16:46.982021  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.986377  8216 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
W20260709 13:16:46.990927  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.973412 10506 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:46.948311 10507 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:16:46.978807 10519 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.981635 10106 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.004307  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 57964.7us
I20260709 13:16:47.007189  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:46.972194 10230 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.013445  9977 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.014498  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:47.016196 10106 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.024181  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:47.024547  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.031150 10402 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:47.031234  8290 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:47.032330  8291 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:47.042397  8217 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:47.032164  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:47.032938  8292 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:46.990000 10473 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.036245  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:47.043901  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:47.044864  8286 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:47.040449  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:47.045725  8367 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.043293  8287 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
W20260709 13:16:47.044025  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 75284.2us
W20260709 13:16:47.041553  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.032229 10520 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:46.981834 10425 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.048792  8220 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:16:47.050056  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:47.054392  8220 pending_rounds.cc:85] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 5
I20260709 13:16:47.054674  8220 pending_rounds.cc:107] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:16:47.054894  8220 raft_consensus.cc:2889] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:47.048538 10163 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.009037 10519 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.055739 10163 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.019845 10415 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.062681  8288 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
W20260709 13:16:47.058385  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 63254.9us
I20260709 13:16:47.063073 10462 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.070809 10163 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.072819  8294 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:47.074914  8892 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:47.079802  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.092566 10521 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:16:47.050879 10520 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:47.103929  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:47.105728  8295 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:47.104388  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:47.109189  8288 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:47.114652  8216 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:47.116453 10230 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:47.120512 10507 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.053566 10474 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.121043 10507 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.124338  8218 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:47.132543  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:47.138746  8367 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:47.143128 10342 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.144680  8289 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 3: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:47.043480 10376 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:47.183004  8294 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:47.184903  8219 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
W20260709 13:16:47.185067  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 115874us
I20260709 13:16:47.105113 10163 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.133826 10520 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.190044  8367 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:47.190959  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.193127  8367 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:47.192871  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:47.199090  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 146707us
I20260709 13:16:47.202986  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.203790  8363 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:47.207765  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:47.208227  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.209080  8360 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:47.217355 10532 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.219794  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.220198  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:47.220687  8362 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:47.221824  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:47.246601 10527 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:16:47.244889 10465 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.247699 10465 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.249749 10465 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:47.250367 10415 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.251219 10425 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:47.257812  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.257920  8927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:47.258665  8927 raft_consensus.cc:606] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:47.262181 10534 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:47.262585 10106 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.263567  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:47.252249  8367 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.254086 10462 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.192780 10342 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:47.267715  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.256400 10519 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:47.261251  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 69428.1us
I20260709 13:16:47.252942 10520 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.268386  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.251876 10507 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:47.273934  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 80788us
I20260709 13:16:47.268678  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:47.275159  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:47.278178 10415 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:47.278861 10415 raft_consensus.cc:697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:47.280069 10415 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.201333 10123 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 13:16:47.284997  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.287812  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.288352  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.289412  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:16:47.290179  8364 raft_consensus.cc:606] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:47.290599  8364 raft_consensus.cc:614] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:47.291867 10520 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.293553  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:47.294337  8362 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.266342 10467 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:47.299429  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.300715  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:47.303885  8367 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.286345  8214 raft_consensus.cc:2410] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:47.309321  8920 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:47.275731 10473 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.309860  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:47.310449 10230 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.311048  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:47.311650  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:47.312400  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:47.312755  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:47.313236  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:47.313903 10342 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:47.315348  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.315619 10519 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:47.341567  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:47.341915  8261 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:47.319614  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:47.345990  8216 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:47.306659  8363 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
W20260709 13:16:47.347681  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.349164  8367 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:47.349493  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.348349  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:47.358297  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.364079  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:47.364879  8219 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:47.323472 10230 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.323287 10422 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.370801  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.381680  8365 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
W20260709 13:16:47.373590  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.387795  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.375478  8362 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
W20260709 13:16:47.376139  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 104705us
I20260709 13:16:47.345094 10494 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:47.377446  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.378166  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:47.300906 10465 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 13:16:47.375281 10537 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:16:47.401253  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:47.403393  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 92416.5us
I20260709 13:16:47.324373 10473 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.379681 10230 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:47.407393  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 97635.8us
I20260709 13:16:47.318637 10376 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.413246  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:47.406766 10474 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:47.408949 10494 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:47.398913 10318 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:47.398403 10467 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:47.411383 10462 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:47.395046 10422 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.430758  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:47.425505  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:47.430346 10462 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:47.433410 10462 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.434907 10262 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:47.422284 10399 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:47.438884 10467 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.406507 10330 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.427958 10106 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:47.419709 10474 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:47.471385  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 45923.7us
I20260709 13:16:47.415493 10534 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:47.412593  9977 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:16:47.414079 10505 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:16:47.441653 10540 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.417346 10542 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:47.442329  8332 leader_election.cc:400] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
W20260709 13:16:47.537791  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 60550.1us
I20260709 13:16:47.446394 10494 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.536755  8186 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:47.424232 10342 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:47.570286 10519 consensus_queue.cc:1059] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:47.570768 10342 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:47.572005 10399 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:47.571770 10342 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.535223 10548 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:47.429957 10415 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.116s
W20260709 13:16:47.560636  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 147453us
I20260709 13:16:47.541687 10163 consensus_queue.cc:1059] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:47.542254 10506 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 13:16:47.565022  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.566730  8332 leader_election.cc:403] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:47.572484 10399 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:47.552997  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 211121us
I20260709 13:16:47.561663 10474 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.571592  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:47.578564 10548 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.578436 10473 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.583976 10548 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.586140 10415 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:47.586284  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:47.586717 10415 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.587185 10415 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.576565 10549 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:47.582608 10506 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:47.588265 10549 consensus_queue.cc:1243] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:47.588392 10506 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:47.589624 10549 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:47.566519 10542 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.589654 10540 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:47.590312 10399 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.579742 10262 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:47.592319 10230 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.590548 10542 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.594390 10230 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:47.596179 10123 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:47.590312 10506 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.597700  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:47.598069 10506 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.598521  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:47.598526  8923 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:47.599270  8926 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:47.599783  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:47.600063  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 182453us
I20260709 13:16:47.600498  8928 raft_consensus.cc:2368] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5.
I20260709 13:16:47.602181 10402 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:47.603106 10425 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:47.604032 10318 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:47.604384  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:47.605561  8924 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:47.607224  8922 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:47.607820 10540 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.607963  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:47.608932 10541 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.268s	user 0.017s	sys 0.018s
I20260709 13:16:47.608484 10540 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.565837 10534 consensus_queue.cc:1243] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:47.571674 10519 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:47.610265  8261 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:47.616035  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 45678.5us
I20260709 13:16:47.618398  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:47.619405  8889 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:47.620249  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46163.9us
I20260709 13:16:47.617641  8186 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:47.626765  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:47.627889  8216 raft_consensus.cc:2376] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6. Re-sending same reply.
I20260709 13:16:47.579089 10342 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.628944  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:47.631299  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 50356us
I20260709 13:16:47.610164 10330 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.631695  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:47.633821  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:47.633896  8261 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:47.634516  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:47.620088 10535 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:47.637543  8926 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:47.633217 10262 consensus_queue.cc:1059] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:16:47.616202 10520 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:47.639485  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:47.620673 10519 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:47.645488  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:47.627912 10549 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:16:47.604552 10425 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:47.627122 10424 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:47.647500  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.656025  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.642637 10535 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.640728  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:47.635461 10550 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:47.663072  9977 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.682096 10415 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.643939 10547 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:47.688557  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:47.696358  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 69167.8us
I20260709 13:16:47.654650 10520 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:47.654224 10424 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:47.706489  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:47.654011  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:47.714232  8288 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:47.733691  8293 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:47.663096 10106 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:47.752478  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:47.708583  9977 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.764086 10402 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:47.768821  9977 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.769258 10402 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:47.761195  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 121778us
I20260709 13:16:47.703331 10535 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.774818  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:47.716094  8214 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.733811 10547 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.707687 10550 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.735736 10425 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:47.771474 10474 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.736207 10424 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.772034 10402 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:47.796908 10550 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.796795 10547 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.799945  8923 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:47.799394 10376 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:47.803397 10402 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:47.817008  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 50178.7us
I20260709 13:16:47.820988 10549 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.802361 10106 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:47.796731 10465 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:16:47.824507 10318 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:47.829770 10554 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:16:47.866022 10549 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.762503 10519 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.832226 10547 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.832175 10520 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.870716 10547 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.811729 10425 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:47.872455 10425 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.833520 10548 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.836313 10399 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.878131 10399 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:47.883617 10399 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.837317 10422 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:47.847396  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.839107 10376 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:47.848412  8261 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:47.900729  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 52401us
I20260709 13:16:47.902182  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:47.848706 10415 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:47.849176 10540 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:47.851406 10555 raft_consensus.cc:3055] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:47.853199 10163 raft_consensus.cc:3055] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:47.857144  8214 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:16:47.868738 10519 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.885550  8213 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:16:47.899485  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.841950 10402 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:47.911085 10163 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:47.918002  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:47.960681  8364 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:47.918718  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.919304  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:47.962690  8362 raft_consensus.cc:2410] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:47.919490  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:47.963335  8360 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:47.920171  8365 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:47.906039 10376 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:47.932690  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:47.955996  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 157870us
I20260709 13:16:47.920280  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:47.911062 10342 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:47.909612 10547 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:47.967475  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 52202.3us
I20260709 13:16:47.969023  8363 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:47.969101  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:47.961536  8367 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:47.910277 10555 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:47.874298 10542 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.986056 10163 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:47.987356 10163 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.909191 10465 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:16:47.963429 10402 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:47.900336 10399 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:47.999449  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:48.001044  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:48.001763  8220 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:48.003314  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:48.004871  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:48.005291  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:47.983740 10547 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:48.029556  8369 pending_rounds.cc:85] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:16:47.992125 10548 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:48.038245  8369 pending_rounds.cc:107] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:47.992550 10342 raft_consensus.cc:697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:48.038563  8369 raft_consensus.cc:2889] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:48.000828 10422 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.042697  8360 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:48.000566 10549 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:48.056524  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:48.036967 10494 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.028656 10467 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.026679  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:48.067915  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:48.061044  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 66981us
I20260709 13:16:48.066951  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:48.041174 10547 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.069039  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:48.070514  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 75838.3us
I20260709 13:16:48.069321  8360 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.071543  8183 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:48.049674 10422 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.049010 10520 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:47.986380 10555 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.073241 10474 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:48.080802 10569 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.080933 10555 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.081364 10569 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.082450 10474 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:48.082952 10474 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:48.075389 10549 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.085505 10549 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:48.085878 10549 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.075186 10506 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:16:48.090734  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 338341us
I20260709 13:16:48.091259 10424 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.091670 10564 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:48.115687  8892 leader_election.cc:336] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.595s (SENT)
I20260709 13:16:48.130318  8364 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:48.071199  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:48.078928  8214 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:48.079363 10559 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:48.091586  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:48.092694  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:48.068307 10467 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.131847  8363 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:48.083509 10569 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:48.077567  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:48.137459  8892 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:48.067967 10494 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.159580  8364 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:48.077880 10422 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.169234  8366 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:48.169359  8360 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
W20260709 13:16:48.171444  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.099601 10534 raft_consensus.cc:3055] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:48.175535  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 98055.1us
I20260709 13:16:48.097111 10542 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:48.177345  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 85857.4us
I20260709 13:16:48.093771 10399 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:48.168355  8364 pending_rounds.cc:85] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:16:48.137698 10106 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:48.167199 10532 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:48.164301 10467 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.182330  8364 pending_rounds.cc:107] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:48.184321  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:48.194093  8364 raft_consensus.cc:2889] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:48.188488  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 117319us
I20260709 13:16:48.195796  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:48.177074 10465 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:48.200393  8366 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:16:48.200089  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 84409.8us
I20260709 13:16:48.100284 10520 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.207121  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:48.200718  8186 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:48.208413  8360 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:48.203123  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:48.178753 10564 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:48.178100 10534 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:48.182792 10506 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:48.182078  8924 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:48.106241 10549 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:48.208976  8186 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:48.204546  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:48.212965  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:48.219820  8366 raft_consensus.cc:2410] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:48.205992  8218 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:16:48.077530 10535 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.206436  8214 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:48.209549  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:48.097079 10550 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:48.210284 10581 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.092216 10566 consensus_queue.cc:1059] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.229s
I20260709 13:16:48.210459  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:48.273309  8217 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:48.212829 10494 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:48.211443  8920 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:48.274739  8926 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
W20260709 13:16:48.271927  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 67464.3us
W20260709 13:16:48.252442  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.277683  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:48.285790  8217 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
W20260709 13:16:48.288295  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 79394.7us
I20260709 13:16:48.198012 10577 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 13:16:48.289974  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 105724us
I20260709 13:16:48.216310 10506 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.216243 10465 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:48.290401  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 94656.8us
I20260709 13:16:48.295668  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:48.212005 10520 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:48.216792 10505 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:48.212183 10563 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.179224 10342 consensus_queue.cc:237] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:48.181777 10474 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:48.492093  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:48.310320  8332 leader_election.cc:400] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
I20260709 13:16:48.519084  8332 leader_election.cc:403] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:16:48.330709  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 274268us
W20260709 13:16:48.405664  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 211456us
W20260709 13:16:48.313621  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.214178 10564 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:48.216620 10551 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.199s
W20260709 13:16:48.523319  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.293862 10318 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.407754  8220 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 3.
I20260709 13:16:48.490204 10559 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.402288  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.293920 10532 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:48.484323  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.216836 10580 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:48.295018 10549 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:48.214804 10534 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.425436  8919 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:48.539934  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:48.472726 10568 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:48.540606  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:48.540601  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 48632us
I20260709 13:16:48.541572 10318 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.581187  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:48.581772  8289 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:48.547035 10566 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.323421 10494 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:48.310231 10415 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:48.309198 10506 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.563680  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:48.591591  8293 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
W20260709 13:16:48.557801  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 247597us
I20260709 13:16:48.568826  8291 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:48.570173  8290 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:48.571311  8261 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:48.461009 10547 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.577055  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:48.425573  9977 consensus_meta.cc:287] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.003s
W20260709 13:16:48.426544  8892 leader_election.cc:336] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.594s (SENT)
I20260709 13:16:48.587163  8294 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:48.587550  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:48.587006  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:48.403935 10402 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:48.568164 10548 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.574415 10424 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:48.291319 10581 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:48.666429  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:48.666909  8288 raft_consensus.cc:2368] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:48.588127 10318 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.576530 10568 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:48.593273 10494 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:48.608467 10534 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:48.518023 10563 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:48.565237 10579 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:48.717823  8287 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:48.578044 10532 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:48.712407 10549 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.579627 10580 raft_consensus.cc:697] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:48.731182  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.609396 10577 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:48.749575  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.562875 10559 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.074652 10601 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:48.911517  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 298) took 1298 ms. Trace:
I20260709 13:16:49.124964  8213 rpcz_store.cc:276] 0709 13:16:47.613431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.613550 (+   119us) service_pool.cc:224] Handling call
0709 13:16:47.628688 (+ 15138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.959574 (+330886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.911281 (+951707us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400198554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:48.911425 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590002560}
W20260709 13:16:48.895314  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 324081us
W20260709 13:16:48.940820  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.128225  8261 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:49.128477  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.127353  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 700848us
W20260709 13:16:49.136022  8892 leader_election.cc:336] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.789s (SENT)
I20260709 13:16:49.136727  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:49.077658  8368 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.001s	sys 0.019s
W20260709 13:16:49.140717  8368 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.001s	sys 0.022s
I20260709 13:16:49.141755  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1894) took 1161 ms. Trace:
W20260709 13:16:49.134761  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.115989 10465 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.000s
W20260709 13:16:48.912227 10598 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:16:48.821080 10467 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
W20260709 13:16:49.075498 10592 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.498s	user 0.000s	sys 0.000s
W20260709 13:16:48.909749 10587 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.449s	user 0.001s	sys 0.000s
I20260709 13:16:49.153156  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:48.760516 10542 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.128412 10505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.008s	sys 0.003s
I20260709 13:16:48.760303 10494 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:48.908931 10552 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:49.144390 10462 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:48.853082 10535 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:48.901536 10424 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.142971 10402 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:49.137533  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.089666 10415 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:48.758725 10568 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.058442 10550 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:48.667555  9977 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:48.909406  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 522) took 1307 ms. Trace:
I20260709 13:16:49.126770 10577 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:49.142495  8368 rpcz_store.cc:276] 0709 13:16:47.980775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.992780 (+ 12005us) service_pool.cc:224] Handling call
0709 13:16:47.993066 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:47.993261 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:48.046919 (+ 53658us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.141358 (+1094439us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.141416 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:49.141467 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.141553 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.141690 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9107,"prepare.queue_time_us":304128,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":252614,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":24756,"thread_start_us":1122651,"threads_started":3,"wal-append.queue_time_us":723137}
W20260709 13:16:49.174340  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.009s	sys 0.007s
W20260709 13:16:49.237768  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.009s	sys 0.007s
W20260709 13:16:49.238170  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 715970us
I20260709 13:16:48.750280 10548 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.177466  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:49.166462  8289 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.160523 10465 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:49.169519 10467 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.115722 10601 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:49.190845  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 73916.8us
I20260709 13:16:49.252072  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:49.201591 10540 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:49.202828  8363 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:49.145236 10549 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:49.231124  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.017s	sys 0.031s
W20260709 13:16:49.277832  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.018s	sys 0.031s
I20260709 13:16:49.194406 10424 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:49.184834  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.014s	sys 0.034s
W20260709 13:16:49.284499  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.014s	sys 0.035s
W20260709 13:16:49.285209  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 708188us
W20260709 13:16:49.243621  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 72198.8us
I20260709 13:16:49.240706  8183 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:49.249843  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1895) took 1265 ms. Trace:
W20260709 13:16:49.288434  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 48455.3us
I20260709 13:16:49.173627 10542 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:49.171034 10505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.009s	sys 0.003s
I20260709 13:16:49.276001  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:49.279481  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.242285  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1896) took 1257 ms. Trace:
I20260709 13:16:49.235374 10462 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:49.288496  8369 rpcz_store.cc:276] 0709 13:16:47.984315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.996450 (+ 12135us) service_pool.cc:224] Handling call
0709 13:16:48.029325 (+ 32875us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:48.133757 (+104432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.133804 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:48.134549 (+   745us) log.cc:844] Serialized 52 byte log entry
0709 13:16:48.257452 (+122903us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:48.257533 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.257632 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.249572 (+991940us) raft_consensus.cc:1685] finished
0709 13:16:49.249599 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.249776 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9720,"raft.queue_time_us":59790,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4208,"thread_start_us":64048,"threads_started":1,"wal-append.queue_time_us":309412}
I20260709 13:16:49.241123 10588 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.247915 10402 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.307219  8367 rpcz_store.cc:276] 0709 13:16:47.984714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.998956 (+ 14242us) service_pool.cc:224] Handling call
0709 13:16:48.026522 (+ 27566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.037671 (+ 11149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.037700 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.038122 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.163535 (+125413us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:48.163584 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.164305 (+   721us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.242024 (+1077719us) raft_consensus.cc:1685] finished
0709 13:16:49.242043 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.242208 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37413,"spinlock_wait_cycles":11748224,"thread_start_us":85643,"threads_started":1,"wal-append.queue_time_us":205620}
I20260709 13:16:49.287611  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:49.339098  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51571.3us
I20260709 13:16:49.339993  8258 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:49.240790 10593 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:49.344017  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:49.278815 10473 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.342929 10376 consensus_meta.cc:287] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.369s	user 0.007s	sys 0.004s
I20260709 13:16:49.274545 10599 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
W20260709 13:16:49.391434  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51550us
I20260709 13:16:49.316383 10505 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:49.393047 10600 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.398864 10600 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.401067 10600 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:49.402129 10614 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:16:49.404690 10548 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.404384 10462 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.406592 10601 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.407684 10608 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.408258 10608 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.410465 10608 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:16:49.411054 10608 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:49.412187 10617 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:49.412746 10617 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:49.413393 10555 consensus_meta.cc:287] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.332s	user 0.005s	sys 0.006s
I20260709 13:16:49.413622 10617 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.414129 10555 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.415169 10422 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.236s	user 0.007s	sys 0.000s
I20260709 13:16:49.414752 10555 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.232087  8923 rpcz_store.cc:276] 0709 13:16:47.601901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.605486 (+  3585us) service_pool.cc:224] Handling call
0709 13:16:47.605848 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:47.820430 (+214582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.909069 (+1088639us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400619254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:48.909342 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363140992}
I20260709 13:16:49.340994 10535 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:16:49.417613 10542 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.337221 10550 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:16:49.417876 10535 raft_consensus.cc:3055] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:49.418368 10519 consensus_meta.cc:287] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.459s	user 0.009s	sys 0.000s
I20260709 13:16:49.418440 10535 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:49.341251 10465 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.392752  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:49.396574 10604 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:49.397070 10612 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:49.397179 10610 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:49.448419 10424 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:49.448807 10610 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.449199 10610 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.387814 10593 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:49.450210 10549 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.450762 10549 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.450886 10593 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.451212 10549 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.390535 10473 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.452435 10563 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:49.396453 10590 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.626s	user 0.000s	sys 0.001s
I20260709 13:16:49.453990 10473 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.386706 10580 consensus_queue.cc:237] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.382702 10602 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.387503 10581 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:49.396924  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 80665.5us
W20260709 13:16:49.446959  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 54293.6us
I20260709 13:16:49.415570 10422 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.307776 10540 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.383558 10588 raft_consensus.cc:2764] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:49.456336  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1893) took 1475 ms. Trace:
W20260709 13:16:49.431644  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 295632us
W20260709 13:16:49.438494  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.000s	sys 0.009s
I20260709 13:16:49.392393 10547 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.471279  8258 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:49.493278  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.000s	sys 0.009s
I20260709 13:16:49.305830 10415 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:49.398290 10618 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:49.492987  8361 rpcz_store.cc:276] 0709 13:16:47.980444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.980944 (+   500us) service_pool.cc:224] Handling call
0709 13:16:47.981323 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:48.046335 (+ 65012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.046383 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:48.046943 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:16:48.172972 (+126029us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:48.173011 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.173074 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.456133 (+1283059us) raft_consensus.cc:1685] finished
0709 13:16:49.456152 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.456279 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38780,"raft.queue_time_us":55485,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":14332,"thread_start_us":154680,"threads_started":2,"wal-append.queue_time_us":464815}
I20260709 13:16:49.496934  8289 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:49.396993 10607 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:49.426863 10399 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.397289 10615 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.447492 10507 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.514031  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 207582us
I20260709 13:16:49.519287  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:49.461547 10550 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:49.527328  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 56134.3us
I20260709 13:16:49.529569  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:49.531984  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:49.255686 10532 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.505194 10424 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.419852 10376 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.537977  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:49.396688 10505 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:49.543159  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48791.7us
I20260709 13:16:49.544337  8183 leader_election.cc:400] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:49.544991  8183 leader_election.cc:403] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:49.397310 10584 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.360s
I20260709 13:16:49.448230 10612 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.551662  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:49.533805 10601 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.534089 10581 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:49.539814 10547 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.554090  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.018s
I20260709 13:16:49.390300 10577 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:49.557121  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.013s	sys 0.018s
I20260709 13:16:49.557883  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1899) took 1547 ms. Trace:
I20260709 13:16:49.517851 10399 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.541513 10563 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.558748  8364 rpcz_store.cc:276] 0709 13:16:48.010055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.167084 (+157029us) service_pool.cc:224] Handling call
0709 13:16:48.168169 (+  1085us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:48.552322 (+384153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.552369 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:48.553083 (+   714us) log.cc:844] Serialized 52 byte log entry
0709 13:16:49.129237 (+576154us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:49.129290 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.129377 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.557607 (+428230us) raft_consensus.cc:1685] finished
0709 13:16:49.557635 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.557811 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57170,"raft.queue_time_us":58144,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":6743,"thread_start_us":710916,"threads_started":2,"wal-append.queue_time_us":603512}
I20260709 13:16:49.528620 10507 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.508176 10535 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.572839  8287 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:49.581192  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:49.552831 10550 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.593367  8289 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:49.593442  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:49.596974  8287 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:49.542339 10424 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.556941 10588 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.598609  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:49.572957 10534 consensus_meta.cc:287] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.000s
W20260709 13:16:49.606240  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 63022.8us
I20260709 13:16:49.566442 10611 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.606365  8290 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:49.560637 10563 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:49.608680  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 49467.8us
I20260709 13:16:49.568887 10399 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.567319 10422 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.570066 10376 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.610652  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:49.610852 10626 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:49.611819 10633 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:49.612955 10619 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 2. Current term is 3.
I20260709 13:16:49.525470 10615 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.602689 10535 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.560501 10547 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.572253 10600 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:16:49.584821 10467 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:49.618044  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.622223  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:49.613536 10623 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.566130 10549 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.629952  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:49.624310  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.618832 10563 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.639950 10547 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.617801 10555 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.624023 10626 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.619598 10577 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.653443 10507 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.648234 10623 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.654690 10627 consensus_queue.cc:1059] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:16:49.655725 10506 consensus_meta.cc:287] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.941s	user 0.008s	sys 0.001s
I20260709 13:16:49.661232  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:49.618561 10611 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.660789 10612 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.634837 10599 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:49.571928 10494 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.656272 10623 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.666723 10376 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.667196 10540 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.668953  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:49.676236  8290 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:49.674403  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:49.677268  8287 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.663491 10626 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:49.681181  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 74046.3us
I20260709 13:16:49.683727 10603 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:49.684363 10615 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:49.684991 10605 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:49.685550 10605 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:49.686563 10569 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:49.686414 10605 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.686918 10569 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:49.668422 10230 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:49.691066 10230 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:49.691867 10611 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:49.692165 10230 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.693936 10230 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:49.694571 10559 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.694834 10595 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:16:49.681113 10376 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.697464 10582 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:49.697685 10376 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.697921 10582 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:49.698772 10582 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.699828 10582 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:49.701661 10566 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.108s	user 0.009s	sys 0.000s
I20260709 13:16:49.702055 10566 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:49.703265  8295 raft_consensus.cc:2410] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:49.704872  9977 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.706194 10494 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:49.708061 10610 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.695776 10595 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:49.705302  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1809) took 1135 ms. Trace:
I20260709 13:16:49.688388  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:49.712816  8295 rpcz_store.cc:276] 0709 13:16:48.570118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.570583 (+   465us) service_pool.cc:224] Handling call
0709 13:16:49.705105 (+1134522us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400388e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:49.705247 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383465216}
I20260709 13:16:49.709223  8290 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:49.699308 10318 consensus_meta.cc:287] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.845s	user 0.008s	sys 0.000s
I20260709 13:16:49.712523 10595 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:49.715812 10595 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.717064 10595 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.722204  8219 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:49.666237 10506 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.726346  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:49.727156  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:49.727587  8216 raft_consensus.cc:2410] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:49.727828  8220 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:49.730361  8213 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:16:49.730765  8213 pending_rounds.cc:85] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 6
I20260709 13:16:49.731040  8213 pending_rounds.cc:107] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:16:49.731190  8213 raft_consensus.cc:2889] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.734715  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:49.736267  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.735477  8290 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:49.705233 10568 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.726954 10559 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:49.751534 10474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.018s
W20260709 13:16:49.752216 10474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.005s	sys 0.018s
I20260709 13:16:49.728521 10615 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:49.756861  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:49.760138  8295 raft_consensus.cc:2410] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:49.743990 10551 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:49.725394 10318 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.776525 10551 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.778427 10318 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.779229 10551 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.744287 10399 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.743819 10376 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:49.781569 10376 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.781495 10399 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.783782 10376 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:49.784312 10376 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:49.784727 10376 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:49.745747 10123 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.785300 10123 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:49.768791 10641 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:16:49.758183  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:49.791378  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:49.791540 10123 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:49.806149  8295 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:49.797420  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:49.806708  8287 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:49.759953 10606 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.754817 10603 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:49.816932  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.761447 10559 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:49.823942  8290 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
W20260709 13:16:49.824841  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 62501.7us
I20260709 13:16:49.797915  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:49.791930 10376 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.848213  8292 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:49.849053  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 568) took 2234 ms. Trace:
I20260709 13:16:49.827855 10606 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.745128 10569 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.764719 10615 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:49.908913  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1484) took 1372 ms. Trace:
I20260709 13:16:50.123274  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.107688 10545 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:50.125380 10545 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:49.878464 10559 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:16:49.890270 10622 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
I20260709 13:16:49.849540  8924 rpcz_store.cc:276] 0709 13:16:47.615080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.620617 (+  5537us) service_pool.cc:224] Handling call
0709 13:16:47.681620 (+ 61003us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:47.681847 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:48.216440 (+534593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.848743 (+1632303us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b540062eb54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:49.848985 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121532544}
W20260709 13:16:49.892309  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.125574  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:50.130131  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 48e600fe8a934349bb2d4d18d10815a6: Illegal state: Request specified cas_config_opid_index of 2 but the committed config has opid_index of 6
I20260709 13:16:50.131844  8361 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:50.132781  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.137898  8369 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:50.041877  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.895931  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.138614  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:50.139026  8360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1483) took 1602 ms (client timeout 1595 ms). Trace:
I20260709 13:16:50.139245  8361 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
W20260709 13:16:50.139424  8360 rpcz_store.cc:269] 0709 13:16:48.536507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.587989 (+ 51482us) service_pool.cc:224] Handling call
0709 13:16:49.895732 (+1307743us) spinlock_profiling.cc:243] Waited 9.79 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:50.138961 (+243229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22525312}
I20260709 13:16:50.134320  8362 rpcz_store.cc:276] 0709 13:16:48.536789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.869564 (+332775us) service_pool.cc:224] Handling call
0709 13:16:49.907972 (+1038408us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:49.908243 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.908491 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.908527 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.908582 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:49.908628 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.908700 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.908838 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5005696}
W20260709 13:16:50.123560  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.144495  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.145035  8369 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.147051 10626 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:50.149362  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:50.150758  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:50.152154  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:50.117760 10399 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:50.128978 10376 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.128683 10577 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.169063  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.169891  8361 raft_consensus.cc:2410] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:16:50.163834  8332 leader_election.cc:400] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5.
I20260709 13:16:49.849620 10506 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.118808 10424 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.129010 10230 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:50.120545 10568 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:49.888880 10610 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:50.173668  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.186396  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.187083  8367 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:50.191565  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:50.192219  8213 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:50.193703 10642 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.194199 10642 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:50.194651  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:50.196171  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:50.196341 10642 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.196969  8216 raft_consensus.cc:2410] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:16:50.196910 10612 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.197475 10612 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:50.199494 10612 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.200574  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.200768  8219 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:50.202167  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:50.202919  8214 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:50.203935  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:50.204425  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.204947  8363 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.213189 10615 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.164131 10569 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.166800 10611 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:50.166018 10494 raft_consensus.cc:2764] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:16:50.214624  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.215216  8892 leader_election.cc:336] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.775s (SENT)
I20260709 13:16:50.215301 10230 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:50.215703  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:50.217427 10230 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:50.213121  8258 connection.cc:256] RPC call timeout handler was delayed by -1.667044555000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 13:16:49.850710 10603 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:50.218282 10606 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:50.224740  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1810) took 1654 ms. Trace:
I20260709 13:16:50.226001  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:50.227398 10563 consensus_meta.cc:287] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.001s
I20260709 13:16:50.165042 10605 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.231284  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.181375  8369 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:50.169441 10604 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:50.256132 10596 log.cc:927] Time spent T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.150s	user 0.000s	sys 0.014s
I20260709 13:16:50.256857 10626 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.181416 10577 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:50.259913  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:50.262876  8286 rpcz_store.cc:276] 0709 13:16:48.570398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.570677 (+   279us) service_pool.cc:224] Handling call
0709 13:16:48.591011 (+ 20334us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:48.594521 (+  3510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:48.594564 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:49.117900 (+523336us) log.cc:844] Serialized 52 byte log entry
0709 13:16:49.244371 (+126471us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:49.244556 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.244752 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.889412 (+644660us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:50.224435 (+335023us) raft_consensus.cc:1685] finished
0709 13:16:50.224458 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.224649 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3508,"raft.queue_time_us":154170,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":104297,"spinlock_wait_cycles":4355968,"thread_start_us":71953,"threads_started":1,"wal-append.queue_time_us":357599}
I20260709 13:16:50.269949  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:50.270757  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:50.290604  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:50.291983  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.294075 10606 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:50.294551 10540 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:50.294474  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:50.298079  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:50.621809  8213 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:50.715423  8220 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:16:50.347489  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.716259  8367 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:50.407214  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:50.398936  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.243566 10415 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:50.717777  8369 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:50.718649  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.718269 10415 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:50.719211  8369 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.243793 10599 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.476s
W20260709 13:16:50.581441  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.720283  8287 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
W20260709 13:16:50.274123 10591 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 13:16:50.721329  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:50.716109  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 490139us
W20260709 13:16:50.551645  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.723264 10604 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:50.310314 10563 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:50.723831 10604 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:50.416127  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:50.725641 10563 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.725989 10604 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:50.726186  8288 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:50.727080  8291 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.727280 10545 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:50.509074 10648 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:16:50.716151  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 500927us
I20260709 13:16:50.512398 10603 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:50.729269  8289 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:50.713157  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:50.716948  8258 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:50.716491  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:50.716084  8290 raft_consensus.cc:2410] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:50.471707  8363 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:50.298709 10577 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:50.728987  8892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.784s (SENT) [suppressed 30 similar messages]
I20260709 13:16:50.753264  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:50.415616  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.733914  8216 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:50.755980  8368 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:50.721895  8287 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.751363  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:50.714471  8295 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:50.760820  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.762662  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:50.771714  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 54842.5us
I20260709 13:16:50.773496  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:50.410358 10615 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.775223  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:50.780582  8216 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:50.797247  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.798200  8363 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
W20260709 13:16:50.750305 10580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.003s	sys 0.034s
I20260709 13:16:50.800894  8287 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:50.776906  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.806061  8368 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.804196  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.807314  8367 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:50.777622  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.808600  8361 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:50.815604  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:50.721879 10415 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:50.803697 10580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.003s	sys 0.035s
I20260709 13:16:50.858799  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.792522 10545 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.871337  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:50.876696  8369 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:50.878254  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:50.879068  8363 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
W20260709 13:16:50.866791  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 93945.2us
I20260709 13:16:50.881500  8368 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:50.808902  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:50.856329  8216 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:50.869663  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:50.900475 10652 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:16:50.900887  8922 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:50.902040  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:50.902397 10650 log.cc:927] Time spent T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.325s	user 0.000s	sys 0.000s
I20260709 13:16:50.902735  8293 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:50.875326  8213 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:50.904227  8924 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:50.904918  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1485) took 2359 ms. Trace:
I20260709 13:16:50.905396  8365 rpcz_store.cc:276] 0709 13:16:48.545121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.894869 (+349748us) service_pool.cc:224] Handling call
0709 13:16:49.909996 (+1015127us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:49.910169 (+   173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.910551 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.910578 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.911042 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.167540 (+256498us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:50.167577 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.167650 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.904592 (+736942us) raft_consensus.cc:1685] finished
0709 13:16:50.904614 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.904854 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6119,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"spinlock_wait_cycles":23300864,"thread_start_us":256126,"threads_started":1,"wal-append.queue_time_us":591233}
I20260709 13:16:50.810813 10424 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:50.908638 10649 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260709 13:16:50.908870 10424 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:50.911139 10424 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.875104  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:50.889564  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:50.873937  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.912861  8927 raft_consensus.cc:2410] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:50.803694 10615 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:50.852869 10474 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:50.890725  8258 leader_election.cc:400] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5.
W20260709 13:16:50.869992 10600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.000s	sys 0.052s
I20260709 13:16:50.925874  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:50.926519  8927 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:50.893349  8291 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:50.900060  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:50.923907  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:50.929003  8213 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:50.929522  8363 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:50.908658 10644 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.331s	user 0.000s	sys 0.000s
I20260709 13:16:50.930905  8258 leader_election.cc:403] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:50.868602  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:50.932312  8365 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:50.933318  8214 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:50.935478  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:50.936234  8920 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:50.936416  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:50.936715  8928 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:16:50.937227  8928 pending_rounds.cc:85] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 5
I20260709 13:16:50.937251  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:50.937722  8928 pending_rounds.cc:107] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:16:50.938191  8928 raft_consensus.cc:2889] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:50.925796 10600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.001s	sys 0.052s
I20260709 13:16:50.937052  8924 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.944553  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:50.950487  8892 leader_election.cc:336] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.750s (SENT)
W20260709 13:16:50.951936  8892 leader_election.cc:336] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.102s (SENT)
I20260709 13:16:50.952564  8892 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:50.955750  8183 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:50.956921  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:50.960258  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 78900.5us
I20260709 13:16:50.958400  8183 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:50.966820  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.968422  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:50.968664  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:50.969621  8293 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:50.937682  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:50.938102  8922 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:50.965621 10540 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.985002  8924 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:50.989097  8921 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:50.971428 10545 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:16:50.986233 10615 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:50.987282 10637 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:50.993162 10474 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:50.967185 10563 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:50.999853  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.002709  8364 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.966171 10606 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.008944  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:51.009692  8293 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
W20260709 13:16:50.993360 10399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.020s	sys 0.053s
I20260709 13:16:51.012487  8287 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:16:51.015357  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 63450us
W20260709 13:16:51.004865 10569 consensus_meta.cc:287] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.006s
I20260709 13:16:51.001405 10637 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.024626  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:51.008095 10651 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.334s	user 0.000s	sys 0.002s
W20260709 13:16:51.001618 10520 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.020s	sys 0.061s
I20260709 13:16:51.027194  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:51.031533  8293 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.002342 10563 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.001012 10474 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:51.010977 10606 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:51.011631 10399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.020s	sys 0.054s
W20260709 13:16:51.044018  8366 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.029s	sys 0.036s
W20260709 13:16:51.044564  8366 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.029s	sys 0.036s
I20260709 13:16:51.045302  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.029035 10637 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.048893  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.050009  8364 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:51.030113 10230 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:51.032294 10520 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.020s	sys 0.062s
W20260709 13:16:51.066677  8260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.003s	sys 0.063s
I20260709 13:16:51.056885  8361 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
W20260709 13:16:51.067160  8260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.003s	sys 0.064s
I20260709 13:16:51.042775 10563 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.067934  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.043877 10606 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.076761  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:51.065313  8293 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:51.068143 10230 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:51.089731  8889 connection.cc:256] RPC call timeout handler was delayed by -1.3502507389998755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:16:51.090461  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:51.091451  8889 connection.cc:256] RPC call timeout handler was delayed by -1.0630594520000614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:16:51.092099  8889 connection.cc:256] RPC call timeout handler was delayed by -1.0152663149997352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:16:51.094494  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.006s	sys 0.041s
W20260709 13:16:51.094815  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.006s	sys 0.041s
W20260709 13:16:51.095055  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 922752us
W20260709 13:16:51.093019  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 134678us
W20260709 13:16:51.080000  8919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 515) took 3479 ms (client timeout 1622 ms). Trace:
I20260709 13:16:51.103790  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:51.118046  8361 raft_consensus.cc:2410] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:51.109443  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.118978  8364 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:51.100337  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.124845  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:51.127295  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.128180  8364 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:51.121415  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:51.156876  8186 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.158071  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:51.157902  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:51.163955  8218 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:51.108449 10106 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.159811 10603 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.166312  8211 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:51.168457 10615 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.179747  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:51.109325  8919 rpcz_store.cc:269] 0709 13:16:47.595063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:47.614300 (+ 19237us) service_pool.cc:224] Handling call
0709 13:16:51.071727 (+3457427us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54002c33d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:51.074684 (+  2957us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269949312}
I20260709 13:16:51.186899  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:51.188941  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.177539 10106 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.194512 10106 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:51.197103 10569 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.197597 10569 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.197952 10569 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.177983 10603 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:51.200280 10603 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.164187 10415 consensus_queue.cc:1059] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:16:51.204141 10230 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:51.222342  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.224887  8364 raft_consensus.cc:2376] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6. Re-sending same reply.
I20260709 13:16:51.211302 10106 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:51.220777  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 249758us
W20260709 13:16:51.238231  8362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.032s	sys 0.020s
W20260709 13:16:51.238787  8362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.032s	sys 0.021s
I20260709 13:16:51.241077  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.242759  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.260521  8364 raft_consensus.cc:2410] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:16:51.261971  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 99734.6us
I20260709 13:16:51.263859 10342 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:51.265887  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:51.266134  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 108348us
I20260709 13:16:51.244908  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1910) took 1116 ms. Trace:
I20260709 13:16:51.268822  8366 rpcz_store.cc:276] 0709 13:16:50.128809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.129015 (+   206us) service_pool.cc:224] Handling call
0709 13:16:50.129355 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.129961 (+   606us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:51.045171 (+915210us) log.cc:844] Serialized 14 byte log entry
0709 13:16:51.244554 (+199383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.244618 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:51.244660 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.244726 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.244852 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3168,"prepare.queue_time_us":935177,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":16442,"thread_start_us":1110585,"threads_started":2}
I20260709 13:16:51.236799 10106 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.273180  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:51.276846  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.278108  8364 raft_consensus.cc:2410] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:16:51.268263 10342 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.277627 10106 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.258543 10581 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:51.295674  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 53013.9us
W20260709 13:16:51.296700  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.296859  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:51.261541 10582 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5.
I20260709 13:16:51.265667 10230 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:51.304364 10342 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:51.305138 10342 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.307989  8923 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:51.309826  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.310127  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1496) took 1082 ms. Trace:
I20260709 13:16:51.310570  8363 raft_consensus.cc:2368] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4.
I20260709 13:16:51.310459  8360 rpcz_store.cc:276] 0709 13:16:50.227742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.228901 (+  1159us) service_pool.cc:224] Handling call
0709 13:16:50.229196 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:50.295965 (+ 66769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.296000 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:50.296100 (+   100us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:50.296137 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.309911 (+1013774us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b5400156154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:51.309951 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.310061 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":884,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":152801152}
I20260709 13:16:51.311681  8363 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:51.312111 10581 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.277009 10540 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:51.319416  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.293241 10424 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.277433 10626 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:51.276240 10415 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:16:51.339244  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.334676  8294 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:51.361745  8363 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:51.361937  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1821) took 1084 ms. Trace:
I20260709 13:16:51.362272  8294 rpcz_store.cc:276] 0709 13:16:50.277325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.288615 (+ 11290us) service_pool.cc:224] Handling call
0709 13:16:50.295459 (+  6844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.313189 (+1017730us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b54003c3820. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd4131c0 00007f31fd414231 00007f31fd410d8f 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c
0709 13:16:51.361673 (+ 48484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.361881 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15511296}
I20260709 13:16:51.353334  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.280373  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:51.307519 10603 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:51.339561 10657 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:51.338709 10676 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.351537 10540 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.352200 10424 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.350898 10626 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:51.379356  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 109187us
I20260709 13:16:51.390707 10106 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.391846  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.395813  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.396917  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.397667  8363 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:51.396864  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.402101  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.402714  8364 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.339854 10230 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.339046 10123 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:51.382236 10422 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:51.383811  8360 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:51.381633  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 224841us
I20260709 13:16:51.377427 10615 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.386210 10581 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:51.389290 10603 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:51.405464  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:51.405715  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 108935us
I20260709 13:16:51.410302  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.384011 10637 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.390820 10626 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.379627 10540 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:51.459033 10673 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.069s	user 0.001s	sys 0.001s
I20260709 13:16:51.460605  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.461256  8365 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:51.462237  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.463296  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.463866  8365 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:51.465258 10230 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:51.444844 10615 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:51.466491 10615 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.476805 10106 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:51.477651 10637 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:51.455845  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.480496  8261 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:51.483330  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:51.484371  8261 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:51.411407  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.416419  8364 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:51.406070 10667 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.420852 10123 consensus_queue.cc:1243] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:51.379498 10424 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.408074 10666 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.411453 10422 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:51.511175 10422 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.512183 10422 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.525246 10682 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.525780 10682 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:51.526141 10682 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.488229 10342 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:16:51.532308  8892 leader_election.cc:336] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.644s (SENT)
I20260709 13:16:51.532862  8892 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:51.434190  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.437121  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.378268 10676 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.443634  8186 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:51.444715  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 164446us
I20260709 13:16:51.453915  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.455305  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:51.542338  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 98784.7us
I20260709 13:16:51.456430 10581 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:51.486706 10545 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:51.489192  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:51.490350  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 79526.2us
I20260709 13:16:51.492663 10123 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:51.496122 10674 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 13:16:51.496721 10563 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.503203 10424 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.504098  8365 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:51.506908  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:51.508991 10662 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.087s	user 0.002s	sys 0.000s
I20260709 13:16:51.486894 10681 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:51.543147  8186 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:51.605821  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 62753.1us
I20260709 13:16:51.606817  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.543967  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.609460  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.610174  8361 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:51.611121  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.544379  8363 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.542376  8889 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:51.612439  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70168.9us
I20260709 13:16:51.613240  8889 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:51.545663  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.616003  8360 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:51.617043  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.594919  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.618863  8367 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:51.490660 10659 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:51.490276 10666 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.596436  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.625638  8369 raft_consensus.cc:2376] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:16:51.599502  8364 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:51.488019 10606 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.600289  8183 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.541348 10415 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.602680  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.615396  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:51.607919  8186 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:51.622268  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.622874  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.630491  8926 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:16:51.601773 10376 consensus_meta.cc:287] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.426s	user 0.005s	sys 0.020s
I20260709 13:16:51.632391  8213 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:51.631721  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:51.626994  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.631755  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.623986  8361 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:51.633584  8927 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:51.634073  8365 raft_consensus.cc:2410] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:51.631013  8186 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.632745  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:51.634665  8361 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:51.634547  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 127697us
I20260709 13:16:51.599920 10667 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:51.637710  8219 raft_consensus.cc:2410] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:51.597800 10545 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:51.635138  8186 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.640615  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:51.547232 10569 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.626123 10637 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.625000 10106 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.644624  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:51.644733  8186 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.626761 10600 raft_consensus.cc:2764] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:51.664866  8364 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:51.668841  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 184548us
I20260709 13:16:51.651166  8363 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:51.597191 10540 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.676476  8365 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:16:51.672276  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 185232us
I20260709 13:16:51.628309 10520 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:51.628003 10666 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.630357 10659 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:51.678464  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:51.679543  8369 raft_consensus.cc:2368] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4.
I20260709 13:16:51.628559 10681 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:51.680553  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.636907 10603 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:51.640303 10677 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:51.668773 10376 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:51.696442 10376 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.696858 10376 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.684954  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1493) took 1458 ms. Trace:
I20260709 13:16:51.675942 10637 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.631718 10665 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.644069 10610 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.671141 10106 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.636632 10675 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:51.636286 10684 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.690083  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.679768  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:51.700573  8362 rpcz_store.cc:276] 0709 13:16:50.226815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.229358 (+  2543us) service_pool.cc:224] Handling call
0709 13:16:50.229645 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:50.299206 (+ 69561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:50.299249 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:50.412489 (+113240us) log.cc:844] Serialized 26 byte log entry
0709 13:16:51.244222 (+831733us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:51.244267 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:51.461408 (+217141us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b54000f4454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:51.461475 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:51.508402 (+ 46927us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:51.684765 (+176363us) raft_consensus.cc:1685] finished
0709 13:16:51.684786 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:51.684899 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":733,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":96,"spinlock_wait_cycles":206757888,"thread_start_us":659539,"threads_started":1,"wal-append.queue_time_us":911879}
I20260709 13:16:51.645781  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:51.702962  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 67528us
I20260709 13:16:51.683854 10667 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:51.724452 10540 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
W20260709 13:16:51.726876  8219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1390) took 1525 ms (client timeout 1595 ms). Trace:
W20260709 13:16:51.727304  8219 rpcz_store.cc:269] 0709 13:16:50.201820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.249476 (+ 47656us) service_pool.cc:224] Handling call
0709 13:16:51.726693 (+1477217us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b540019a354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:51.726821 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2057016576}
I20260709 13:16:51.687433 10230 raft_consensus.cc:2764] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:16:51.712157 10106 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.670902 10415 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:16:51.728385 10659 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.733494 10415 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:51.733884 10415 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:51.734648 10415 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.735769 10415 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.713027  8186 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:51.686968 10520 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:51.686228 10559 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:51.714104 10684 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.717885 10675 raft_consensus.cc:697] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:51.718025 10687 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:51.720767 10679 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:16:51.722824 10678 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:16:51.706944 10637 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:51.741392  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.745744  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:51.687813 10581 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:51.709438 10123 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.708592 10677 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:51.755424 10687 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.763940 10687 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.764348 10677 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.752808 10684 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.768527 10424 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:51.769117 10424 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.715934 10545 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.761324 10123 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.712474 10610 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.773268 10123 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.755442 10665 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:51.750552 10612 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:51.773792 10615 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.774577 10612 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.774979 10612 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.762368 10675 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.776017 10520 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.763324 10559 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.755658 10682 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.782270 10682 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:51.783962  8115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46484 (request call id 258) took 21923 ms (client timeout 15000 ms). Trace:
W20260709 13:16:51.795881  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 151306us
I20260709 13:16:51.796748  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.797873  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.787245 10688 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 13:16:51.807435  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 130814us
I20260709 13:16:51.808187  8261 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:51.783474 10676 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:51.783195 10606 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:51.756623 10540 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:16:51.784291 10563 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:51.823850  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:51.823655  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 110741us
W20260709 13:16:51.786614  8115 rpcz_store.cc:269] 0709 13:16:29.860676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.860955 (+   279us) service_pool.cc:224] Handling call
0709 13:16:51.783855 (+21922900us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:47.073776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:47.218840 (+145064us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:47.218905 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:16:47.218934 (+    29us) tablet.cc:662] Decoding operations
0709 13:16:47.241255 (+ 22321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:47.241337 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:47.241368 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:16:47.242167 (+   799us) tablet.cc:701] Row locks acquired
0709 13:16:47.242216 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:16:47.242417 (+   201us) write_op.cc:270] Start()
0709 13:16:47.242574 (+   157us) write_op.cc:276] Timestamp: P: 1783603007242342 usec, L: 0
0709 13:16:47.242591 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:16:47.243376 (+   785us) log.cc:844] Serialized 3190 byte log entry
0709 13:16:47.837414 (+594038us) op_driver.cc:464] REPLICATION: finished
0709 13:16:48.069910 (+232496us) write_op.cc:301] APPLY: starting
0709 13:16:48.076813 (+  6903us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:48.079243 (+  2430us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:48.079418 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:48.080681 (+  1263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:48.080976 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:16:48.081027 (+    51us) write_op.cc:312] APPLY: finished
0709 13:16:48.081362 (+   335us) log.cc:844] Serialized 65 byte log entry
0709 13:16:48.081549 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:48.081668 (+   119us) write_op.cc:454] Released schema lock
0709 13:16:48.081732 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:49.658131 (+1576399us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b54003ed6a8. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32037cd9e1 00007f32037cc64c 00007f3200e5d3fd 00007f3200e49389 00007f3200e48b53 00007f3200e4cd61 00007f3200e4cd19 00007f3200e4cca9 00007f3200e4cc71 00007f3200e4be9d 000000000038f354
0709 13:16:49.658545 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:49.658573 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":245999,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":173098,"apply.run_cpu_time_us":19983,"apply.run_wall_time_us":1608334,"num_ops":8,"prepare.queue_time_us":206256,"prepare.run_cpu_time_us":58230,"prepare.run_wall_time_us":310539,"raft.queue_time_us":157032,"raft.run_cpu_time_us":45121,"raft.run_wall_time_us":141541,"replication_time_us":594630,"spinlock_wait_cycles":13206912,"thread_start_us":401637,"threads_started":4,"wal-append.queue_time_us":175292,"wal-append.run_cpu_time_us":21474,"wal-append.run_wall_time_us":1684048}]]}
W20260709 13:16:51.826033  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 66508.8us
I20260709 13:16:51.838155  8186 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.757766 10626 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.844362  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.845896  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.827062  8368 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:51.832585  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:51.826290  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 136241us
I20260709 13:16:51.850675  8363 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.809935 10603 raft_consensus.cc:697] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:51.824946 10682 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:51.864562  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 160008us
I20260709 13:16:51.865327  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:51.860390 10123 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.821184 10230 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.857173 10667 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:51.853010 10615 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:51.824258 10342 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:16:51.783707 10681 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.872009  8363 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:51.864748 10682 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:51.867192 10606 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:51.873488 10661 raft_consensus.cc:3055] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:51.871629 10569 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:51.874033 10474 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.874707 10563 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.908845  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:51.909549  8926 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.868775 10422 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:16:51.878129 10230 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:51.918779  8288 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:51.922240  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:51.898308 10682 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.890049 10695 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:51.926205  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 80409.7us
I20260709 13:16:51.898518 10661 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:51.874953 10637 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.947441  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.949229  8365 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 4: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:51.947055  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:51.950249  8363 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:51.932113  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.951720  8366 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.941812  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:51.915531 10694 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.953476  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:51.922533 10655 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:51.953760  8220 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:51.963318  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:51.955999  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.963852  8364 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:51.964282  8363 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.926736 10603 consensus_queue.cc:237] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.929808 10606 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:51.965039 10687 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.965987  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:51.966195 10606 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.918347 10559 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:16:51.968326  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.969089  8362 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.970958 10666 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:51.972160  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.972363  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:51.974156 10685 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.550s	user 0.003s	sys 0.000s
I20260709 13:16:51.962215  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:51.973769 10667 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:51.975602  8211 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:51.960732  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:51.915558 10615 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:16:51.952811 10474 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.983502  8219 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:51.997818  8219 pending_rounds.cc:85] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 2
I20260709 13:16:51.998076  8219 pending_rounds.cc:107] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:51.998236  8219 raft_consensus.cc:2889] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:51.987486  8288 raft_consensus.cc:2410] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:51.985193  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:51.987521  8926 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:51.988683  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:51.994957  8362 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:52.000730  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.001281  8291 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
W20260709 13:16:51.926298  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 75481.6us
I20260709 13:16:52.002501  8258 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:52.003494  8214 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:52.003928  8214 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:52.004155 10707 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.004655 10707 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.004733  8214 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.005944  8214 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.006744 10707 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:52.007210 10376 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:51.946975 10695 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:52.008116 10703 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:52.009915 10695 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:52.010274 10637 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:52.010445 10695 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:51.925921 10700 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:16:52.010818 10695 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:52.011891 10666 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:52.012360  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.014967  8363 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:52.038619  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.013214  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:52.049299  8186 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:52.051432  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.052409  8288 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:52.051601  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:52.054198  8364 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:52.056903  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 43767.4us
I20260709 13:16:52.066669  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:52.026145 10691 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:52.059391  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.011605 10695 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.004673  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:51.980659 10694 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.059929  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.081099  8258 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:52.087010  8364 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:16:52.089123  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 173654us
I20260709 13:16:52.090162  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:52.090850  8219 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:52.090924  8220 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:52.090276  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:52.093318  8213 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.094071  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:52.095702  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:52.096092  8286 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
W20260709 13:16:52.097056  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.065157 10659 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.060694 10422 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:52.045486 10637 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:52.107236  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:52.085283 10691 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.104432  8213 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:52.107812  8364 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.102119 10704 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:52.111811  8217 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:52.049844 10612 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.087350 10626 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:52.134471 10626 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.135115 10626 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.114265  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:52.142612  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46969.5us
I20260709 13:16:52.145797  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.148212  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.148916  8213 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:52.123716  8364 raft_consensus.cc:2410] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:52.097325 10699 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.111209  8922 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:52.129462 10694 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:52.124810 10700 consensus_queue.cc:1059] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:16:52.130738 10682 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.157375  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:52.160861  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:52.250536  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.132153 10697 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.132746 10688 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:52.115085 10691 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.133860 10612 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:52.109688 10123 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:52.112545 10713 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:52.258282  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.332120  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:52.333678  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:52.152985 10708 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:52.259727  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.125268 10704 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.341657  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:52.153039 10706 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.345623  8217 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.097970 10684 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:52.336164  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.248756 10690 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:52.254019 10694 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.389727  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:52.390771  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 292100us
I20260709 13:16:52.061332 10661 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:52.330312  8211 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:52.395442 10661 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.387452  8288 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:52.256723  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:52.342975  8212 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:52.386301  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.391825  8261 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:52.392228  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.345463 10697 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:52.399447  8287 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:52.400228  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.359131 10704 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:52.406092  8217 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:52.359728  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:52.419755  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.355360 10422 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:52.442078 10422 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.443629 10684 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:52.421236  8293 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.420035  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:52.446748  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46020.3us
I20260709 13:16:52.416465  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:52.448170 10106 consensus_meta.cc:287] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 13:16:52.422824  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.448591 10106 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.359565 10711 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:16:52.396539 10694 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.448936  8286 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.359768 10708 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:52.453876 10709 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:16:52.450826 10693 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:52.454696 10708 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:52.459360  8364 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:16:52.459753  8366 consensus_meta.cc:287] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.000s
I20260709 13:16:52.464385  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:52.468899  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.467967  8214 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:52.396190 10690 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:52.341243 10714 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:16:52.472316  8214 pending_rounds.cc:85] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 2
I20260709 13:16:52.253867 10699 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:52.401284  8921 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:52.409685 10697 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.474963  8293 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:52.477583  8366 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:52.478468  8286 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:52.398053 10719 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:52.408473 10581 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:52.480710  8214 pending_rounds.cc:107] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:52.452236 10612 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.486661  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.487233  8214 raft_consensus.cc:2889] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:52.488176  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.489488  8293 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:52.495008  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:52.497342  8286 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:52.484921 10697 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.391019 10706 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:52.492472 10680 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:16:52.506302  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.506745  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.513242  8366 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:52.515439  8291 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:16:52.518805  8291 pending_rounds.cc:85] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 6
I20260709 13:16:52.518715  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.519235  8291 pending_rounds.cc:107] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:16:52.519613  8291 raft_consensus.cc:2889] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:52.520699  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:52.521379  8217 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:16:52.526139 10671 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.136s	user 0.002s	sys 0.022s
I20260709 13:16:52.526388  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:52.526875 10712 log.cc:927] Time spent T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:16:52.527117  8211 raft_consensus.cc:2368] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:52.526171  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.528443  8214 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:52.495959 10581 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:52.531889 10581 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:52.534628  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.538928 10704 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:52.540024  8290 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:52.540798 10694 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:52.547430 10682 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:52.551906  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:52.496106 10612 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:52.550791 10474 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:16:52.572094  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.726434 10694 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:52.804020 10603 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:52.691308 10599 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:52.729712  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:52.698379 10230 raft_consensus.cc:1064] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:16:52.879491 10697 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:52.709950  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.674868  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 281) took 1469 ms. Trace:
W20260709 13:16:53.021813 10545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.249s	user 0.022s	sys 0.043s
I20260709 13:16:52.705721 10706 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:52.883342 10688 consensus_meta.cc:287] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.001s
I20260709 13:16:52.733837 10699 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:52.558844 10415 consensus_meta.cc:287] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.799s	user 0.007s	sys 0.003s
I20260709 13:16:52.943678  8218 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 3. Current term is 5. Ops: []
I20260709 13:16:53.047552  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:53.048370  8218 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:53.049151  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:53.050186  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:52.934645  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.828070  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:52.948832  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.882367  8220 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.051760  8290 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:52.732290  8213 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:52.895676  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:52.894158  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:52.669902  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44030.8us
I20260709 13:16:53.052816  8367 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:53.003374 10474 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:52.639997  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:53.008153  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.020800  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:53.010354 10737 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:16:52.669691 10704 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:52.558084 10123 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.039839  8214 raft_consensus.cc:2393] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:52.918413  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:52.551812 10721 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.463s
I20260709 13:16:53.060670 10123 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.061069  8211 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:53.043179  8217 raft_consensus.cc:2393] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:53.015381 10606 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.062836 10123 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.063812  8215 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.064363 10606 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.066637 10606 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.045293 10688 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:53.070619 10697 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.055086 10474 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:53.071705 10474 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:53.072844 10691 consensus_meta.cc:287] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.005s
I20260709 13:16:53.073258 10691 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.075244 10691 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.042796 10687 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.077230 10106 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:53.079710  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.042999  8360 rpcz_store.cc:276] 0709 13:16:51.205457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.640229 (+434772us) service_pool.cc:224] Handling call
0709 13:16:51.640504 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.640692 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:51.677731 (+ 37039us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.071825 (+394094us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b180034a920. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb123a 00007f31fd41ba2a
0709 13:16:52.254307 (+182482us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.674153 (+419846us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b180034a920. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287 00007f31fd42c208
0709 13:16:52.674387 (+   234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:52.674454 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:52.674519 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.674612 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.674792 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387922,"prepare.queue_time_us":16432,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":518306,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":82928,"spinlock_wait_cycles":179225728,"thread_start_us":88532,"threads_started":1,"wal-append.queue_time_us":773740}
I20260709 13:16:53.041224 10610 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.054993  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59420 (request call id 307) took 1549 ms. Trace:
I20260709 13:16:53.055622  8212 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:53.117975  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:52.562229 10690 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:53.044241 10545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.022s	sys 0.043s
I20260709 13:16:53.059103  8286 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.138765 10599 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.140246  8292 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.059309  8220 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.059554  8287 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:53.041275 10603 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:53.141808  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:53.142608 10603 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.143674 10603 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.042444 10694 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.060074  8290 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.146999 10694 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:53.147207  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.147851  8290 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:53.149029  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:53.072845 10474 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.150909  8290 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.086723  8367 rpcz_store.cc:276] 0709 13:16:51.505458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.619590 (+114132us) service_pool.cc:224] Handling call
0709 13:16:52.893969 (+1274379us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:53.054937 (+160968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537344}
I20260709 13:16:53.116462  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:53.117137  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:53.096304  8293 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:16:53.057057  8219 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:53.118855  8369 raft_consensus.cc:2410] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:16:53.157812  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:53.158304  8369 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.159880  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:53.119688  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.120205  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:53.162714  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:53.163784  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:53.164772  8364 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.166554  8360 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:16:53.060122  8919 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:53.127744 10687 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:53.128209 10688 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.131253  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:53.188995  8366 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.189953  8366 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:53.190253  8366 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:53.190958  8366 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.191825  8366 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.156152  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:53.193156  8215 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 3.
I20260709 13:16:53.166736  8332 leader_election.cc:400] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:53.122413 10230 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.195823  8290 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:53.196826  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:53.197793  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.198679  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.199510  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.167858  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:53.169096  8286 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:53.163424  8368 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:53.185473  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:53.086270 10582 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.201937  8361 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
I20260709 13:16:53.192512  8183 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:53.194758  8332 leader_election.cc:403] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.206936  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:53.210037  8369 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:53.211884  8369 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:16:53.212587  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 132347us
W20260709 13:16:53.215413  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.209972  8364 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:53.212477  8290 raft_consensus.cc:2410] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:53.218353  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:53.220006  8290 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:53.225991  8892 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:53.205034 10713 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.234473  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.210469 10582 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.239789  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:53.240312  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.241575 10612 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.210821 10706 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:53.212738 10694 raft_consensus.cc:2764] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:53.251163 10694 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:53.251638 10694 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:53.251901 10690 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:53.241597 10376 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.214854 10123 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.245653 10339 tablet_copy_client.cc:538] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:53.253777 10123 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:53.249265  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.255541  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.249706  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.195473 10687 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.257025  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1411) took 1101 ms. Trace:
I20260709 13:16:53.229285 10569 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:53.247959  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:53.262578  8290 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:53.266579  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:53.260452  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:53.268445  8366 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:53.268952  8366 pending_rounds.cc:85] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 3
I20260709 13:16:53.229085 10424 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.269536 10424 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.271628 10424 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:53.262187  8213 rpcz_store.cc:276] 0709 13:16:52.155243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.155377 (+   134us) service_pool.cc:224] Handling call
0709 13:16:52.155701 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.052273 (+896572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.255794 (+203521us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54001d4054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:53.256964 (+  1170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325159680}
I20260709 13:16:53.269284  8366 pending_rounds.cc:107] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:53.200878 10688 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.277400 10688 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.252627 10694 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.269073  8365 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:53.283739  8366 raft_consensus.cc:2889] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.287358  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:53.294613  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:53.298012  8361 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:53.298496  8361 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:53.299472  8361 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.301798  8361 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.226980 10705 consensus_queue.cc:1059] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 13:16:53.305696  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 79794.1us
I20260709 13:16:53.308192  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:53.288187 10720 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.289631 10376 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:53.314361  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:53.289448 10569 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:53.323074  8361 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:53.337863  8361 pending_rounds.cc:85] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 4
I20260709 13:16:53.245471 10713 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.296499 10734 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:53.296226 10706 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:53.338176  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 119882us
I20260709 13:16:53.327641  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:53.320307 10376 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.329785 10415 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:53.305979 10699 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:53.314085 10422 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:16:53.338284 10424 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:53.340500 10569 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.349960  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:53.338866  8361 pending_rounds.cc:107] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:16:53.362636  8361 raft_consensus.cc:2917] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:16:53.354243  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:53.364406  8361 raft_consensus.cc:2889] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.365141  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:53.364027 10376 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.361529 10424 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.374687 10424 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.377679  8923 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:53.377750  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:53.367671  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.383350  8286 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:53.363009 10123 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.393911  8286 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:53.395516  8286 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:53.396854  8286 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:53.398375  8286 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:53.361001 10705 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.352209 10734 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:53.351899 10415 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.372401 10690 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.378551  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 523) took 1764 ms. Trace:
I20260709 13:16:53.411233  8923 rpcz_store.cc:276] 0709 13:16:51.614380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.620898 (+  6518us) service_pool.cc:224] Handling call
0709 13:16:53.377247 (+1756349us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:53.377481 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.378291 (+   810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.378491 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51296128}
I20260709 13:16:53.413225 10705 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.388315 10694 consensus_queue.cc:1059] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:53.406450  8286 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 13:16:53.382913 10683 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.961s	user 0.002s	sys 0.002s
I20260709 13:16:53.418594  8286 pending_rounds.cc:85] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 3
I20260709 13:16:53.418892  8286 pending_rounds.cc:107] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:53.360751 10746 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:53.419462  8286 raft_consensus.cc:2889] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.352473 10706 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.383195 10699 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:53.429731  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.407258 10415 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.415908 10705 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.423704 10745 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:53.454416  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 76729.6us
W20260709 13:16:53.455662  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 72530.7us
I20260709 13:16:53.456465  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:53.457702  8892 leader_election.cc:400] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4.
I20260709 13:16:53.458000  8892 leader_election.cc:403] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:53.423377 10559 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:16:53.459355  8213 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:53.460515  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:53.461180 10424 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.463203 10424 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.464182 10424 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:53.465456 10424 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 3. Current term is 4.
I20260709 13:16:53.438463 10691 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:53.422487 10563 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:53.471750 10424 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:53.447371 10699 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.475651 10424 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:53.472692 10754 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:53.474471 10540 raft_consensus.cc:3055] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:53.473923 10376 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:53.483230  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.425300 10106 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:53.425486 10698 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:53.495009 10339 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:16:53.453994 10705 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.455327 10745 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.453945 10694 consensus_queue.cc:1243] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:53.504715 10424 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.485956 10687 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.493479 10540 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:53.494463 10582 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.517562 10762 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:53.518476 10751 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:53.520931 10694 raft_consensus.cc:3055] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:53.521821 10655 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:53.523780  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:53.547951 10694 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:53.548492  8920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 536) took 1298 ms (client timeout 1665 ms). Trace:
I20260709 13:16:53.510470 10745 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.526129  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:53.548915  8920 rpcz_store.cc:269] 0709 13:16:52.250343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.253888 (+  3545us) service_pool.cc:224] Handling call
0709 13:16:53.523614 (+1269726us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:53.548433 (+ 24819us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24072576}
I20260709 13:16:53.554859 10706 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:53.556787 10376 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.500597 10759 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.568864 10695 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.515913  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:53.574090  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 58256.8us
I20260709 13:16:53.575543  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:53.498052 10734 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:53.539467  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.536767 10540 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.577993  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:53.584311  8927 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.586611  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:53.589710  8186 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:53.583098 10667 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:53.586727 10123 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:53.621141  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.622627  8927 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
W20260709 13:16:53.623543  8927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 530) took 1988 ms (client timeout 1897 ms). Trace:
W20260709 13:16:53.624154  8927 rpcz_store.cc:269] 0709 13:16:51.635185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.635298 (+   113us) service_pool.cc:224] Handling call
0709 13:16:53.577833 (+1942535us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:53.623443 (+ 45610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5617920}
W20260709 13:16:53.625943  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 168343us
I20260709 13:16:53.586977 10746 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:53.632339  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:53.615662 10540 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.618497 10422 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:53.548931 10694 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:53.661882  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44125.4us
I20260709 13:16:53.665269  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:53.666690  8186 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:53.648008 10422 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.674501 10422 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:53.683379  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.695039  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.688087 10770 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:53.708779 10720 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:53.692374 10775 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:53.734493 10123 raft_consensus.cc:697] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:53.764827 10230 raft_consensus.cc:3055] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:53.765297 10230 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:16:53.743904  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 73108.1us
W20260709 13:16:53.744776  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.743287 10720 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:53.742594 10745 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.752599 10699 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:53.758852 10422 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.761346 10666 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:53.782153  8889 connection.cc:256] RPC call timeout handler was delayed by -1.1803911910001261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:16:53.782577  8889 connection.cc:256] RPC call timeout handler was delayed by -1.0948911909999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 13:16:53.766510 10123 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.782491 10666 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:53.783674  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 151417us
I20260709 13:16:53.784399  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:53.776471  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.682040 10767 consensus_queue.cc:1059] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:16:53.785140 10779 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.780021 10720 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.731182 10746 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.784494 10666 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.731827 10415 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.736747 10776 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:16:53.787467  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 167803us
I20260709 13:16:53.779911 10699 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.734676 10777 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:16:53.797518  8362 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:53.795126  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:53.796679  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:53.796271  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:53.795910  8922 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEARNER]: Advancing to term 6
I20260709 13:16:53.800096  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 345) took 1460 ms. Trace:
I20260709 13:16:53.812340  8289 rpcz_store.cc:276] 0709 13:16:52.339504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.339608 (+   104us) service_pool.cc:224] Handling call
0709 13:16:52.343953 (+  4345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.344169 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:52.397720 (+ 53551us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.799155 (+1401435us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b180006da80. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fcfb94bc 00007f31fa30748b 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb123a
0709 13:16:53.799567 (+   412us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.799735 (+   168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.799776 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:53.799821 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.799893 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.800007 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56708,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":2741,"spinlock_wait_cycles":18602752,"thread_start_us":9165,"threads_started":1,"wal-append.queue_time_us":55503}
I20260709 13:16:53.815052  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.794893  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:53.806064  8213 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:53.795500  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:53.807091  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:53.738389 10770 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:53.819218  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:53.826297  8927 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:53.821532  8290 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.827421 10762 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:53.827950 10762 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:53.828429 10681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.373s	user 0.002s	sys 0.013s
I20260709 13:16:53.829030 10762 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.827886  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:53.830438  8927 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:53.833073  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:53.831712  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.830354  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:53.835070 10768 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:53.835250  8289 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:53.837293 10770 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:53.837440 10762 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.837726  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:53.782086 10422 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:53.839505  8286 raft_consensus.cc:2368] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:53.840468  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:53.841351  8286 raft_consensus.cc:2368] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:53.845872 10768 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:53.788084 10667 raft_consensus.cc:697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:53.849184  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.766233 10230 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:53.839190 10774 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:16:53.852955  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:53.847402 10681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.002s	sys 0.013s
I20260709 13:16:53.842373 10734 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.866765  8924 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:53.869793 10745 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:53.848416 10603 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:53.871837 10762 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.850229 10768 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:53.852963 10779 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.877357  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:53.881062  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 207639us
I20260709 13:16:53.898584  8213 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:53.848923 10415 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:53.871632 10769 log.cc:927] Time spent T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:16:53.849359  8923 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.898897  8219 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:53.907138  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:53.930163  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.912595  8290 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:53.886734 10230 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:53.887722 10759 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:53.939643  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.936342 10745 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:53.944234  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:53.944803  8366 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.895569  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:53.939073 10789 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:16:53.946772  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.945577  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:53.892544 10734 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.949383  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:53.947321  8289 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:53.943254  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:53.954932  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:53.956276  8290 raft_consensus.cc:2393] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:53.897176 10682 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.954046  8365 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:53.941946  8921 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:53.959436  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:53.964900  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:53.901357 10603 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.977890  8366 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:53.943640 10422 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:53.946432 10106 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:16:53.974227 10768 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:53.950139 10759 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:53.993793 10759 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:53.998402  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:53.999039  8927 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:53.944227 10667 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.000068 10786 raft_consensus.cc:3055] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:54.000654 10786 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:54.001909 10786 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.003626 10786 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.003906 10734 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:53.961436 10682 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:54.008620  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:54.010217 10718 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.557s	user 0.000s	sys 0.009s
I20260709 13:16:54.010505  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.011344  8924 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:54.012075  8286 raft_consensus.cc:2410] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:54.014904  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:53.886469 10655 consensus_queue.cc:1175] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e95b04d03d241329435b6d08dd1f236" responder_term: 5 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: [4.2-4.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:54.021279 10699 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:54.022226  8368 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:54.025823  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:54.026314 10710 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 2.061s	user 0.000s	sys 0.007s
W20260709 13:16:53.980723 10716 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.878s	user 0.012s	sys 0.012s
W20260709 13:16:54.028440  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.015924  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.034426  8286 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:16:53.995743 10727 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.542s	user 0.002s	sys 0.000s
I20260709 13:16:54.010823 10694 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:54.039294  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.903941 10779 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.045517 10603 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:54.045733 10779 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:54.047741  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.010989 10784 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:54.049059  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.048969 10784 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.050239  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.050539  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 341) took 1712 ms. Trace:
W20260709 13:16:54.028182  8919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 532) took 1878 ms (client timeout 1532 ms). Trace:
W20260709 13:16:54.056437  8919 rpcz_store.cc:269] 0709 13:16:52.150042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.152818 (+  2776us) service_pool.cc:224] Handling call
0709 13:16:54.027923 (+1875105us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b540065f754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:54.028114 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382914944}
I20260709 13:16:54.050956  8291 rpcz_store.cc:276] 0709 13:16:52.337679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.337785 (+   106us) service_pool.cc:224] Handling call
0709 13:16:52.338037 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:52.520150 (+182113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.050327 (+1530177us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400426154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:54.050487 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407218432}
I20260709 13:16:54.057600  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.058223  8919 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:54.058302  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.059108  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.067123  8919 raft_consensus.cc:2393] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:54.059685  8927 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:54.070763  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.071718  8286 raft_consensus.cc:2368] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:54.051152 10784 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:54.065230  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.073712  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.078073  8921 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:54.079414  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.080019  8921 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:54.080881  8923 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:54.085331  8923 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:54.086937  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.088557  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.086247 10793 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.095889  8332 leader_election.cc:400] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:54.096249  8332 leader_election.cc:403] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:16:54.095541 10793 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.097240  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:54.097715  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:54.097972 10599 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:54.098428  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:54.098744 10599 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:54.100432  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:54.101238  8919 raft_consensus.cc:2376] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6. Re-sending same reply.
I20260709 13:16:54.101313 10770 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.102490  8924 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:54.103024  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.098898  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.103710  8919 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:54.098723  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.105032  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.105191  8286 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:54.105955  8291 raft_consensus.cc:2393] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:54.090157  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:54.106709  8220 raft_consensus.cc:2368] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
W20260709 13:16:54.108901  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.104146  8921 raft_consensus.cc:2368] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:54.115397  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.103451 10770 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:54.114116  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:54.116439  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:54.117513  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:54.115533  8922 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:54.121274 10745 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:54.121183 10705 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:54.120821  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:54.122603  8369 raft_consensus.cc:2410] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:54.123776  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:54.124014  8927 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:54.115900 10230 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:54.127615  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:54.128646  8286 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:54.130638  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:54.131269  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.121245 10599 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:54.122092 10745 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.123186 10694 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:54.148883  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:54.146090 10766 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.151309  8332 leader_election.cc:400] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:54.150465  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.152945  8286 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:54.148582 10745 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.156853  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.158294  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.148480  8923 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEARNER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:54.160214  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.161537  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:54.162418  8288 raft_consensus.cc:2368] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:54.160801  8927 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:54.152992  8332 leader_election.cc:400] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:54.164278  8332 leader_election.cc:403] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:54.147847 10599 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.149240 10705 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:54.160578 10706 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:54.172135 10723 log.cc:927] Time spent T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.717s	user 0.003s	sys 0.000s
I20260709 13:16:54.172326  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:54.173143  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1961) took 1015 ms. Trace:
I20260709 13:16:54.121574 10759 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:16:54.178392  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:54.185914  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:54.186326  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1949) took 2130 ms. Trace:
I20260709 13:16:54.187634  8366 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:54.186869  8363 rpcz_store.cc:276] 0709 13:16:52.056435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.056562 (+   127us) service_pool.cc:224] Handling call
0709 13:16:52.056874 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:53.523388 (+1466514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.523420 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:53.524021 (+   601us) log.cc:844] Serialized 52 byte log entry
0709 13:16:53.634302 (+110281us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:53.634344 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.178646 (+544302us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54003647d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:54.178715 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.178762 (+    47us) raft_consensus.cc:1685] finished
0709 13:16:54.178781 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.186255 (+  7474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51963,"raft.queue_time_us":5968,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":34794,"spinlock_wait_cycles":3371709184,"thread_start_us":109892,"threads_started":1,"wal-append.queue_time_us":136485}
I20260709 13:16:54.180789  8361 rpcz_store.cc:276] 0709 13:16:53.157866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.203836 (+ 45970us) service_pool.cc:224] Handling call
0709 13:16:53.211224 (+  7388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.365200 (+153976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.172922 (+807722us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b540010cf54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:54.173076 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199245568}
I20260709 13:16:54.189879  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:54.186465  8288 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.178300 10599 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.180100 10706 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.193601 10706 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.181092 10705 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:54.195133 10705 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.180090 10694 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:54.200322  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.201823  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:54.201845  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:54.203732  8368 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.208879  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:54.209659  8366 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:16:54.209651  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.210922  8295 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:54.212322  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:54.215330  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:54.217170  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.218086  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:54.219748  8332 leader_election.cc:400] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7.
I20260709 13:16:54.224457  8368 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:54.225416  8295 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:54.236922  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:54.234567  8286 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:54.206604 10786 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.265591  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.225395 10759 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.311084 10599 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.315841 10599 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:54.316762  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 79908.1us
I20260709 13:16:54.318742 10793 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:54.320223 10717 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.865s	user 0.008s	sys 0.024s
I20260709 13:16:54.332152  8295 raft_consensus.cc:1217] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:16:54.334460  8295 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:54.310977  8288 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
W20260709 13:16:54.345590  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.299472 10230 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:54.353850 10745 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.306025 10786 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:54.364780 10722 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.910s	user 0.009s	sys 0.000s
I20260709 13:16:54.366156 10786 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:54.368448  8286 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:54.367538 10682 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:54.371239  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.380481  8295 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:54.386142  8286 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:54.349568 10766 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:54.390540  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:54.391189  8366 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:54.391427  8361 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:16:54.392266  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.385792 10705 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.396592  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:54.397183  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:54.401239  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:54.382616 10750 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:54.406695  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.409390  8366 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:54.412338  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:54.422365  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:54.423288  8186 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:54.426695  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:54.427799 10721 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:54.448756  8186 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:54.419773 10770 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:54.432346  8261 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:54.433068  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:54.461589  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 388070us
I20260709 13:16:54.461856  8295 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:54.462707  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.463414  8295 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:54.433763  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:54.442216 10694 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:54.442943  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.445472  8360 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:54.475256  8360 pending_rounds.cc:85] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:16:54.475559  8360 pending_rounds.cc:107] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:54.475840  8360 raft_consensus.cc:2889] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:54.476302  8295 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:54.435896  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:54.413520 10786 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:54.458814  8889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.013s	sys 0.028s
I20260709 13:16:54.429081  8362 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:16:54.472765  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:54.479766  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47485.6us
I20260709 13:16:54.445690  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:54.477633  8291 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:54.483479  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:54.484205  8213 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:54.488476 10770 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:16:54.479095  8889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.013s	sys 0.028s
W20260709 13:16:54.490142  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.489691 10770 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.491772  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.492491  8220 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:54.492519  8928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 535) took 2329 ms (client timeout 1850 ms). Trace:
W20260709 13:16:54.493007  8928 rpcz_store.cc:269] 0709 13:16:52.162669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.162786 (+   117us) service_pool.cc:224] Handling call
0709 13:16:54.491630 (+2328844us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:54.492454 (+   824us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139517312}
I20260709 13:16:54.573356  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:54.474721 10694 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:54.536705  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:54.582566  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.592850 10694 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.520088  8212 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:54.593667  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:54.478722 10786 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:54.511189  8293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1845) took 2045 ms (client timeout 2633 ms). Trace:
I20260709 13:16:54.594571 10786 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.533576  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:54.594834  8293 rpcz_store.cc:269] 0709 13:16:52.465744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.493572 (+ 27828us) service_pool.cc:224] Handling call
0709 13:16:54.511031 (+2017459us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400389854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:54.511129 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1265973504}
I20260709 13:16:54.501036  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:54.533957 10766 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:54.474382 10610 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:54.517717  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.598568  8213 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:54.593972 10694 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.473775  8923 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.598393 10766 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:54.507899  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:54.600461 10766 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:54.593484  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.516580 10563 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:54.603693 10563 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:54.604317  8219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.017s	sys 0.045s
W20260709 13:16:54.604650  8219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.017s	sys 0.045s
W20260709 13:16:54.604589  8287 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 347) took 2264 ms (client timeout 2341 ms). Trace:
I20260709 13:16:54.506053 10682 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
W20260709 13:16:54.605332  8287 rpcz_store.cc:269] 0709 13:16:52.339998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.422476 (+ 82478us) service_pool.cc:224] Handling call
0709 13:16:54.604329 (+2181853us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400425254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:54.604482 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356480896}
I20260709 13:16:54.607863 10563 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:54.611483  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.612273  8290 raft_consensus.cc:1217] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:16:54.612955  8290 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:54.613680  8367 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:54.614413  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1953) took 1465 ms. Trace:
W20260709 13:16:54.612273  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 166635us
I20260709 13:16:54.610271 10563 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.621974  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:54.618592  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:54.614790  8367 rpcz_store.cc:276] 0709 13:16:53.148923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.168714 (+ 19791us) service_pool.cc:224] Handling call
0709 13:16:54.613225 (+1444511us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:54.613467 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.614130 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.614349 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15680256}
I20260709 13:16:54.628281 10655 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.633528 10713 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:54.635246  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 45335.7us
I20260709 13:16:54.459749 10559 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:54.641419  8258 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.010s	sys 0.021s
W20260709 13:16:54.650614  8258 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.022s
W20260709 13:16:54.651304  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 591880us
I20260709 13:16:54.640435  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:54.643245  8927 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:54.657708  8928 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:16:54.642372  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:54.496299  8889 leader_election.cc:336] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.688s (SENT)
I20260709 13:16:54.659055  8364 raft_consensus.cc:2410] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:16:54.661094 10724 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.661684 10724 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:54.662611 10745 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:54.663687  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1964) took 1505 ms. Trace:
I20260709 13:16:54.664328 10665 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:54.664238  8360 rpcz_store.cc:276] 0709 13:16:53.158558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.208707 (+ 50149us) service_pool.cc:224] Handling call
0709 13:16:54.023378 (+814671us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:54.445092 (+421714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.476412 (+ 31320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.663519 (+187107us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400157050. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:54.663635 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974156288}
I20260709 13:16:54.660295  8889 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:54.669111  8287 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:54.666502  8290 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:54.500837 10545 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:54.649025 10612 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.018s	sys 0.024s
I20260709 13:16:54.680066 10665 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:54.665987 10693 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:16:54.680930 10696 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:54.657599 10766 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:54.643194 10702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.685s	user 0.011s	sys 0.046s
I20260709 13:16:54.663736 10724 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:54.684382 10706 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:54.684859 10801 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:16:54.685515 10705 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:54.686583  8925 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:54.642300 10230 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.640769 10559 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:54.675588  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 179232us
I20260709 13:16:54.675850 10690 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:54.641970 10768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.009s	sys 0.016s
W20260709 13:16:54.648437 10424 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.019s	sys 0.019s
I20260709 13:16:54.636116 10720 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:16:54.674363 10545 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.657732  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:54.711083  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70735.5us
I20260709 13:16:54.758033  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:54.641083 10610 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:54.692826 10702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.746s	user 0.011s	sys 0.046s
W20260709 13:16:54.761226  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 103570us
I20260709 13:16:54.767828  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:54.770550  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:54.759634  8332 leader_election.cc:400] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:54.771425  8332 leader_election.cc:403] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:16:54.716662  8889 leader_election.cc:336] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.783s (SENT)
W20260709 13:16:54.700722 10612 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.018s	sys 0.024s
I20260709 13:16:54.688310 10762 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:54.772758  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 56148.5us
W20260709 13:16:54.700728 10339 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.001s	sys 0.029s
I20260709 13:16:54.716962 10724 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:54.718545 10768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.010s	sys 0.017s
W20260709 13:16:54.777127  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.715773 10745 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:54.809285  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.765234 10599 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.765470 10705 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.760715 10545 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.775681 10762 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:54.811898 10697 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:54.833454  8920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.025s	sys 0.042s
W20260709 13:16:54.838759  8920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.025s	sys 0.042s
I20260709 13:16:54.813922 10713 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:54.817173  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 344) took 2478 ms. Trace:
I20260709 13:16:54.806284 10682 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:54.761628 10719 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:54.808343 10339 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.001s	sys 0.029s
I20260709 13:16:54.842218  8292 rpcz_store.cc:276] 0709 13:16:52.339119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.339256 (+   137us) service_pool.cc:224] Handling call
0709 13:16:52.388851 (+ 49595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.140676 (+751825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.816876 (+1676200us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54002e59d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:54.817077 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727483264}
I20260709 13:16:54.717182 10559 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:54.843788  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.720130 10230 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:54.835171 10424 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.021s	sys 0.032s
W20260709 13:16:54.854544  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.851823 10745 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:16:54.845192 10768 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.844980 10682 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.854507 10776 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:54.838035 10724 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:54.843294 10599 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:54.878783 10762 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.883584 10762 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:54.843511 10705 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.879057 10682 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:54.918994  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.881726 10745 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.906023 10719 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.934440  8361 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.005s	sys 0.030s
W20260709 13:16:54.968425  8361 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.018s	sys 0.034s
W20260709 13:16:54.927610  8365 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.011s	sys 0.019s
W20260709 13:16:54.969409  8365 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.011s	sys 0.022s
W20260709 13:16:54.978166  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.999787 10721 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:55.000730 10721 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:54.865340 10610 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.018537 10705 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:55.020476 10230 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:55.025406 10688 raft_consensus.cc:3055] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:55.025970 10688 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:54.933282 10706 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:55.029469 10724 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.030174  8923 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:54.933532 10745 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:55.033409 10745 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:55.033951 10745 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:55.034543 10745 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:54.972919 10806 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:16:55.039644  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.889772 10776 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:54.972488 10784 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.972275 10720 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.026943 10688 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:54.981937 10766 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:55.078593 10688 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:55.093022 10745 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:55.076822 10655 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.973341 10719 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:55.116799  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1277) took 1138 ms. Trace:
I20260709 13:16:55.117358  8219 rpcz_store.cc:276] 0709 13:16:53.978065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.978223 (+   158us) service_pool.cc:224] Handling call
0709 13:16:53.978537 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.978841 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:53.978868 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.979301 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.605244 (+625943us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:54.605283 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.605355 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.116531 (+511176us) raft_consensus.cc:1685] finished
0709 13:16:55.116559 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.116727 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17684,"raft.queue_time_us":32432,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":576958,"threads_started":1,"wal-append.queue_time_us":811231}
I20260709 13:16:55.078989 10720 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.082094 10784 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:55.129369 10655 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:55.143280  8218 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.012s	sys 0.046s
W20260709 13:16:55.143690  8218 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.013s	sys 0.046s
I20260709 13:16:55.132661 10599 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:55.147387 10721 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:55.148792  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.155908  8215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.056s
W20260709 13:16:55.156383  8215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.008s	sys 0.056s
I20260709 13:16:55.148077 10655 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:55.169425  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 503017us
W20260709 13:16:55.168756  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 495677us
W20260709 13:16:55.174746  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 367641us
I20260709 13:16:55.180088  8364 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:55.179445  8363 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:16:55.180941  8363 pending_rounds.cc:85] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 4
I20260709 13:16:55.181181  8363 pending_rounds.cc:107] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:16:55.181396  8363 raft_consensus.cc:2889] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:55.192619  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.193128  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.193435  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.193770  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.194415  8211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.055s
I20260709 13:16:55.202132  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:55.203066  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.204694  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 445181us
I20260709 13:16:55.207604  8368 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:55.208566 10719 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:55.208738 10784 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:55.208873  8368 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:55.209818 10786 consensus_meta.cc:287] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:16:55.210219 10786 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:55.211697  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:55.214116  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:55.216105  8220 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:55.218827  8215 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:55.219908  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:55.220718  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:55.238466  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 431898us
W20260709 13:16:55.239352  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.201793 10724 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:16:55.243105  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 44214.1us
I20260709 13:16:55.243557  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:55.201589  8211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.013s	sys 0.055s
I20260709 13:16:55.249107  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:55.261672  8220 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:16:55.261113  8258 connection.cc:256] RPC call timeout handler was delayed by -1.6582833109998774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 13:16:55.264097  8258 connection.cc:256] RPC call timeout handler was delayed by -1.5772833109997464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:16:55.264432  8258 connection.cc:256] RPC call timeout handler was delayed by -1.5385833109999112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:16:55.264710  8258 connection.cc:256] RPC call timeout handler was delayed by -1.3720833109998694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
I20260709 13:16:55.264897  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:55.267961  8219 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:16:55.272296  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:55.279636  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:55.323137  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.282169  8258 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:55.335726  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70886.3us
I20260709 13:16:55.336740  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:55.337929  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 94114.2us
I20260709 13:16:55.338869  8183 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:55.339329  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:55.222414 10766 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.345861  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:55.341573  8290 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:55.342557  8362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.020s	sys 0.020s
W20260709 13:16:55.347002  8362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.020s	sys 0.020s
I20260709 13:16:55.347810  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:55.350628  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:55.342411  8287 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:55.417034  8367 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:55.417491  8292 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.419188  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:55.265008 10339 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:16:55.464321  8928 raft_consensus.cc:2410] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:55.467674 10702 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.334021 10690 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.459995  8288 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:55.263908 10688 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.386188  8289 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:55.388149 10766 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.340808 10706 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:55.261775 10762 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.262317 10759 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:55.491657  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:55.388329  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.476819  8292 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:16:55.341001 10705 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:55.343101 10697 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.015s
I20260709 13:16:55.480114  8889 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:55.340879 10768 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.341188 10230 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:55.463896  8116 catalog_manager.cc:5697] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 3 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:16:55.497177  8219 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:55.502367  8366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.035s	sys 0.017s
W20260709 13:16:55.482414  8920 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.008s	sys 0.029s
W20260709 13:16:55.562009  8366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.035s	sys 0.025s
I20260709 13:16:55.562296  8928 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:55.477720 10424 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:55.246551 10559 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.492359 10720 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.491619  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:55.570621 10706 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 13:16:55.570990 10813 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.434s	user 0.001s	sys 0.000s
I20260709 13:16:55.581707  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:55.586654  8212 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:55.583415  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:55.584962  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:55.593211  8261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.020s	sys 0.035s
W20260709 13:16:55.593676  8261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.020s	sys 0.035s
W20260709 13:16:55.492370 10694 consensus_meta.cc:287] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.893s	user 0.005s	sys 0.007s
I20260709 13:16:55.595777  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:55.483858 10702 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:55.568770  8920 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.008s	sys 0.030s
I20260709 13:16:55.594010  8116 catalog_manager.cc:5697] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 3 to 4, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 4 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
W20260709 13:16:55.511811 10697 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.013s	sys 0.017s
I20260709 13:16:55.619938  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:55.592474  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:55.499732 10719 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.576568 10721 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:55.486203 10675 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:55.626434 10563 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:55.492250 10599 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:55.493557 10688 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.686501  8116 catalog_manager.cc:5697] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 4, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 4 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:16:55.689214 10720 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:55.706416  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.698729  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.485697 10690 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:55.571842  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:55.573650 10776 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:55.575419 10706 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.110s
W20260709 13:16:55.736236  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.808964  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:55.809476  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.678061 10697 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:55.698697 10563 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.511651 10762 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:55.776530 10545 consensus_meta.cc:287] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.928s	user 0.010s	sys 0.002s
I20260709 13:16:55.597405 10424 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:55.822413 10813 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:16:55.777894 10599 raft_consensus.cc:697] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:55.818446  8925 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:55.822742 10339 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:16:55.808054 10655 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:55.854915 10721 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:55.867475 10721 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.704131 10724 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:16:55.872332 10702 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.872613 10690 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.873337 10655 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.873205 10690 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:55.873889 10655 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.875360 10702 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.876890 10688 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.877106 10762 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:55.877460 10688 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.845197 10545 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.877986 10688 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:55.879761 10545 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.879983 10424 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.873205 10599 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:55.880977 10424 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.881570 10424 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:55.882615 10682 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.961s	user 0.008s	sys 0.001s
I20260709 13:16:55.883024 10682 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.846122  8116 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 3 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:55.704312 10821 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
W20260709 13:16:55.839567 10610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.022s	sys 0.072s
I20260709 13:16:55.864215 10815 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.865309 10694 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.837750 10675 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:16:55.775323 10720 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.828730 10786 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.830215 10563 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:55.890049  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1983) took 1479 ms. Trace:
I20260709 13:16:55.843127 10776 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:16:55.891295  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1544) took 1270 ms. Trace:
I20260709 13:16:55.874917 10690 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:55.571699 10230 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.697861 10719 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:55.875880 10655 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:55.872632 10339 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 13:16:55.909395  8360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.028s	sys 0.040s
W20260709 13:16:55.945135  8360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.028s	sys 0.040s
W20260709 13:16:55.816270  8218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.013s	sys 0.013s
I20260709 13:16:55.858623 10833 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:55.875834 10702 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:55.895759  8368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.011s	sys 0.007s
W20260709 13:16:55.905311 10610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.022s	sys 0.072s
I20260709 13:16:55.879766 10688 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:55.925439  8364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.015s	sys 0.005s
W20260709 13:16:55.973887  8364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.015s	sys 0.005s
I20260709 13:16:55.920815  8116 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 3 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:55.905133 10825 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:55.905680 10766 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:55.926415  8362 rpcz_store.cc:276] 0709 13:16:54.620765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.620911 (+   146us) service_pool.cc:224] Handling call
0709 13:16:54.621355 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.621765 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.621805 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.827813 (+206008us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b2c0001cc18. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fbd0aa11 00007f31fbd1a372 00007f31fd44ca01 00007f31fd41143a 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:16:54.828180 (+   367us) log.cc:844] Serialized 26 byte log entry
0709 13:16:55.347509 (+519329us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:55.347550 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.347620 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.891021 (+543401us) raft_consensus.cc:1685] finished
0709 13:16:55.891041 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.891238 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":467,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":17355648,"thread_start_us":519053,"threads_started":1,"wal-append.queue_time_us":1015417}
I20260709 13:16:55.916178 10694 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:55.946481  8218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.013s	sys 0.013s
I20260709 13:16:55.998468  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 331) took 1478 ms. Trace:
I20260709 13:16:55.998696  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:55.917625  8366 rpcz_store.cc:276] 0709 13:16:54.411044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.416707 (+  5663us) service_pool.cc:224] Handling call
0709 13:16:54.417034 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.908457 (+491423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.908488 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.915588 (+  7100us) log.cc:844] Serialized 26 byte log entry
0709 13:16:55.564803 (+649215us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:55.564846 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.564922 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.889726 (+324804us) raft_consensus.cc:1685] finished
0709 13:16:55.889756 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.889965 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12810,"raft.queue_time_us":25918,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":11180,"thread_start_us":1055146,"threads_started":2,"wal-append.queue_time_us":913222}
I20260709 13:16:56.000739  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:56.002249  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.012s	sys 0.009s
W20260709 13:16:55.971786  8368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.012s	sys 0.007s
I20260709 13:16:55.937830 10690 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.977936 10825 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:55.883973 10424 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:56.010670  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.013s	sys 0.008s
W20260709 13:16:56.011125  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.014s	sys 0.008s
I20260709 13:16:55.999002  8218 rpcz_store.cc:276] 0709 13:16:54.520331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.520493 (+   162us) service_pool.cc:224] Handling call
0709 13:16:54.520739 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.520970 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:55.144100 (+623130us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.998023 (+853923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:55.998093 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:55.998155 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.998245 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.998399 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":290108,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":1476316,"threads_started":2}
W20260709 13:16:56.012606  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 730451us
I20260709 13:16:56.014393  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:56.001441  8366 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:56.018426  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:55.997684 10559 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:55.970469 10655 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:56.009402 10766 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:56.026197  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:56.011413  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.011s	sys 0.015s
I20260709 13:16:55.909569 10815 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.029551  8366 raft_consensus.cc:2410] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:56.016011  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:16:56.002679  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.012s	sys 0.009s
I20260709 13:16:56.019809  8261 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:56.009891 10690 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.038895  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:56.029744  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.011s	sys 0.016s
W20260709 13:16:56.005445  8361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.007s	sys 0.015s
W20260709 13:16:56.042575  8361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.007s	sys 0.015s
W20260709 13:16:56.024497  8891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.007s	sys 0.023s
W20260709 13:16:56.044309  8891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.007s	sys 0.023s
W20260709 13:16:56.036211  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 693857us
W20260709 13:16:56.068295  8367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.006s	sys 0.014s
I20260709 13:16:55.972748 10833 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:56.074499  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 54790.5us
I20260709 13:16:56.076584  8924 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:56.077366  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:56.038699 10766 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.073598 10682 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:56.080583 10682 consensus_queue.cc:1059] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:56.081270 10721 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:56.081588 10682 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:56.081825 10721 raft_consensus.cc:3055] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:56.082020 10682 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.082260 10721 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:56.082476 10682 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:56.083189 10721 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.070582 10675 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.084746 10702 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.084563 10675 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.085999 10720 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:56.086243 10702 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:56.086790 10836 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:16:56.087322 10694 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:56.056208 10826 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:16:56.088981 10832 log.cc:927] Time spent T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:16:56.101547  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 87252.7us
W20260709 13:16:56.102968  8259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.012s	sys 0.016s
W20260709 13:16:56.105486  8259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.012s	sys 0.016s
I20260709 13:16:56.014530 10697 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.074138 10339 tablet_bootstrap.cc:492] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:16:56.041814  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:56.035696 10655 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:56.112105  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.120833  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:56.110445  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:56.128582  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.125568  8928 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:16:56.089737 10786 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.147854  8927 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:56.119503  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:16:56.147627  8260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.008s	sys 0.012s
W20260709 13:16:56.152257  8260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.008s	sys 0.012s
W20260709 13:16:56.153223  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.147338  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:56.143767 10694 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:56.158483  8889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.012s	sys 0.005s
I20260709 13:16:56.134652 10721 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:56.069098  8367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.006s	sys 0.015s
W20260709 13:16:56.187813  8889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.012s	sys 0.005s
I20260709 13:16:56.124805 10834 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:56.187206 10693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.504s	user 0.016s	sys 0.019s
I20260709 13:16:56.145490 10833 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:56.148069 10778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.010s	sys 0.009s
I20260709 13:16:56.192581  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:56.191377  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:56.196738  8287 raft_consensus.cc:2410] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:56.197556  8288 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:16:56.188477  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 708391us
I20260709 13:16:56.194856  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:56.199467  8293 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:56.199424  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:56.195479  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:56.198413  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:56.200881  8369 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.005s	sys 0.017s
I20260709 13:16:56.201210  8292 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:56.201304  8369 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.005s	sys 0.017s
I20260709 13:16:56.156973 10766 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.203621  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:56.229991  8289 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.194649 10339 ts_tablet_manager.cc:1403] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 2.715s	user 0.049s	sys 0.046s
W20260709 13:16:56.195717  8923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.002s	sys 0.020s
I20260709 13:16:56.233093  8290 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:56.233750  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:56.236219  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:56.193760 10230 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.157472 10786 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.194024  8925 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:56.196265 10675 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:56.203234 10833 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:56.229127 10778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.011s	sys 0.009s
W20260709 13:16:56.191308 10693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.508s	user 0.017s	sys 0.019s
W20260709 13:16:56.259351  8890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.009s	sys 0.019s
W20260709 13:16:56.266004  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.199488 10815 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.202437  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:56.196076 10705 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:16:56.245901  8923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.004s	sys 0.022s
I20260709 13:16:56.244518 10702 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:56.192333 10694 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:56.251443 10612 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.000s	sys 0.023s
I20260709 13:16:56.252758 10667 raft_consensus.cc:3055] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:56.194454 10834 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.277458 10833 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:16:56.282447 10784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.007s	sys 0.023s
I20260709 13:16:56.287204  8922 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:56.290019 10612 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.000s	sys 0.023s
I20260709 13:16:56.290931 10667 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:56.296579 10833 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.296236 10825 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.299678  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:16:56.297549 10784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.008s	sys 0.023s
I20260709 13:16:56.329578 10853 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:56.301787 10844 log.cc:927] Time spent T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:16:56.352187 10839 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:16:56.362738 10855 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:56.363472 10834 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:56.363660 10856 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:56.364265 10842 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:16:56.289992 10705 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:56.350922 10770 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.438s	user 0.012s	sys 0.012s
I20260709 13:16:56.007627  8116 catalog_manager.cc:5697] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 3 to 4, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 4 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:56.280226  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.277766  8890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.020s
I20260709 13:16:56.362812 10682 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.533289 10339 raft_consensus.cc:359] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:56.536878  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.518164 10786 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.451908  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1993) took 1256 ms. Trace:
I20260709 13:16:56.462450  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 598) took 2675 ms. Trace:
I20260709 13:16:56.463485  8925 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
W20260709 13:16:56.454648  8184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.015s
W20260709 13:16:56.395433 10843 log.cc:927] Time spent T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:16:56.452289  8365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.011s	sys 0.012s
I20260709 13:16:56.462714  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:56.454288  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1997) took 1257 ms. Trace:
I20260709 13:16:56.542294  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:56.464186 10230 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.451398  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.001s	sys 0.022s
W20260709 13:16:56.444536  8216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.004s	sys 0.013s
I20260709 13:16:56.385242 10853 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.544432  8292 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:56.543605  8116 catalog_manager.cc:5697] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:16:56.360760 10655 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.388698 10856 consensus_queue.cc:1243] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:56.493608  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2002) took 1274 ms. Trace:
I20260709 13:16:56.450826  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1977) took 2046 ms. Trace:
I20260709 13:16:56.445255  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1991) took 1265 ms. Trace:
W20260709 13:16:56.445588  8211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.002s	sys 0.009s
W20260709 13:16:56.389518 10770 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.483s	user 0.013s	sys 0.013s
W20260709 13:16:56.468448 10599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.062s	sys 0.043s
W20260709 13:16:56.585175  8184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.000s	sys 0.021s
I20260709 13:16:56.494228  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:56.598289  8921 raft_consensus.cc:2368] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7.
I20260709 13:16:56.599022  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 546) took 1119 ms. Trace:
I20260709 13:16:56.579499  8360 rpcz_store.cc:276] 0709 13:16:55.195273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.203115 (+  7842us) service_pool.cc:224] Handling call
0709 13:16:55.203448 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.203844 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.203883 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.205667 (+  1784us) log.cc:844] Serialized 26 byte log entry
0709 13:16:55.945723 (+740056us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:55.945784 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.945880 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.451231 (+505351us) raft_consensus.cc:1685] finished
0709 13:16:56.451285 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.451660 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7434,"raft.run_cpu_time_us":495,"raft.run_wall_time_us":251420,"thread_start_us":739575,"threads_started":1,"wal-append.queue_time_us":1028967}
I20260709 13:16:56.580888  8920 rpcz_store.cc:276] 0709 13:16:53.786535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.791076 (+  4541us) service_pool.cc:224] Handling call
0709 13:16:53.795919 (+  4843us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:54.160288 (+364369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.162770 (+  2482us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:54.237424 (+ 74654us) log.cc:844] Serialized 52 byte log entry
0709 13:16:54.854161 (+616737us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:55.698575 (+844414us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.461447 (+762872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.461724 (+   277us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.461835 (+   111us) raft_consensus.cc:1685] finished
0709 13:16:56.461860 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.462185 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9453,"prepare.queue_time_us":1005330,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":54,"raft.queue_time_us":289298,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":12681,"thread_start_us":2044483,"threads_started":4,"wal-append.queue_time_us":815262}
I20260709 13:16:56.517886 10815 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.604408 10849 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:56.604584 10815 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.605405 10849 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.610145 10705 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.610813 10230 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.612519 10339 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:16:56.613155  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.613857 10230 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.613363 10339 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:16:56.614771  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.615752  8219 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:56.603560  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:56.591446  8365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.017s	sys 0.013s
W20260709 13:16:56.593173  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.001s	sys 0.028s
I20260709 13:16:56.484813 10424 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:56.594170 10768 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:56.594419  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:56.622211  8216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.008s	sys 0.015s
I20260709 13:16:56.597262  8923 raft_consensus.cc:2410] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:56.620307  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.620572 10667 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.607497 10815 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:16:56.596220  8362 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.007s	sys 0.010s
I20260709 13:16:56.587297  8366 rpcz_store.cc:276] 0709 13:16:55.218599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.069604 (+851005us) service_pool.cc:224] Handling call
0709 13:16:56.069971 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.180530 (+110559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.180576 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.180632 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:56.180677 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.493021 (+312344us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000f3f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:56.493100 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.493411 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253525248}
W20260709 13:16:56.634222  8362 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.007s	sys 0.010s
W20260709 13:16:56.626875 10599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.062s	sys 0.054s
I20260709 13:16:56.580336 10825 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.628392  8211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.006s	sys 0.017s
W20260709 13:16:56.637734  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.638307  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1540) took 2248 ms. Trace:
W20260709 13:16:56.638579  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 403036us
I20260709 13:16:56.640442 10768 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.642762 10655 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:56.643489 10815 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:56.587350  8361 rpcz_store.cc:276] 0709 13:16:54.404392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.404500 (+   108us) service_pool.cc:224] Handling call
0709 13:16:54.404811 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.405171 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:54.968943 (+563772us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.043044 (+1074101us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.043623 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.043779 (+   156us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:56.449299 (+405520us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.449978 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.450175 (+   197us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.450268 (+    93us) raft_consensus.cc:1685] finished
0709 13:16:56.450284 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.450574 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":964275,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":51,"raft.queue_time_us":392209,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":76057,"thread_start_us":2035404,"threads_started":4,"wal-append.queue_time_us":883438}
I20260709 13:16:56.644618  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:56.580821  8368 rpcz_store.cc:276] 0709 13:16:55.196449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.209518 (+ 13069us) service_pool.cc:224] Handling call
0709 13:16:55.209773 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.209960 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:55.210561 (+   601us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.452953 (+1242392us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.453436 (+   483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.453535 (+    99us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.453699 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.453811 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.454073 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3057,"prepare.queue_time_us":402337,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":132868,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3966,"thread_start_us":1238450,"threads_started":2,"wal-append.queue_time_us":947863}
I20260709 13:16:56.648964 10667 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:56.649935  8926 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:56.649142  8116 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 3 to 4, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 4 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.651678  8919 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:56.652009  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.599519  8921 rpcz_store.cc:276] 0709 13:16:55.479310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.482298 (+  2988us) service_pool.cc:224] Handling call
0709 13:16:56.493938 (+1011640us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:16:56.598912 (+104974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10806656}
I20260709 13:16:56.664727  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 543) took 1269 ms. Trace:
I20260709 13:16:56.665234 10786 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:56.665125 10815 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.665611  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 608) took 2554 ms. Trace:
I20260709 13:16:56.665741 10786 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:56.666090  8919 rpcz_store.cc:276] 0709 13:16:54.111628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.121457 (+  9829us) service_pool.cc:224] Handling call
0709 13:16:55.482636 (+1361179us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:56.650933 (+1168297us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecf8c 00007f31fa2ecef6 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:56.651168 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.665293 (+ 14125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.665542 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27026176}
I20260709 13:16:56.669314  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.669763  8289 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:56.670269  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.670735  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.665261  8926 rpcz_store.cc:276] 0709 13:16:55.391692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.391954 (+   262us) service_pool.cc:224] Handling call
0709 13:16:56.648838 (+1256884us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:56.649223 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.659878 (+ 10655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.661290 (+  1412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57587584}
I20260709 13:16:56.669363  8116 catalog_manager.cc:5697] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 3, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 3 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:16:56.674587  8116 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 3 to 4, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 4 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.667337 10786 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.677383  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1549) took 1081 ms. Trace:
I20260709 13:16:56.677152  8116 catalog_manager.cc:5697] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 4, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 4 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:16:56.677975  8366 rpcz_store.cc:276] 0709 13:16:55.595577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.676122 (+1080545us) service_pool.cc:224] Handling call
0709 13:16:56.676589 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.676968 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.677002 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.677061 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.677092 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.677163 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.677292 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.679248  8361 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:56.677498 10786 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:56.679116  8116 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 3, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:56.680438 10655 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.681845 10853 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:56.682767 10655 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.683262 10694 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.683501 10655 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:56.684456  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.684860  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:56.685505  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1551) took 1088 ms. Trace:
I20260709 13:16:56.686187 10762 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:56.686522 10825 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.687013 10762 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.681020  8116 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 4, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 4 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:16:56.689218 10825 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.679912  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1553) took 1080 ms. Trace:
I20260709 13:16:56.690163  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:56.689270  8116 catalog_manager.cc:5697] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 2, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 2 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.411886 10864 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.246s
I20260709 13:16:56.677127  8286 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:56.685917  8368 rpcz_store.cc:276] 0709 13:16:55.596818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.684595 (+1087777us) service_pool.cc:224] Handling call
0709 13:16:56.684980 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.685202 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.685227 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.685281 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:56.685312 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.685362 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.685452 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.697971  8361 rpcz_store.cc:276] 0709 13:16:55.599751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.678480 (+1078729us) service_pool.cc:224] Handling call
0709 13:16:56.678943 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.679654 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.679842 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.683781  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:56.654131  8365 rpcz_store.cc:276] 0709 13:16:54.389662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.390032 (+   370us) service_pool.cc:224] Handling call
0709 13:16:54.390321 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.390503 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:54.969825 (+579322us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.637670 (+1667845us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.637782 (+   112us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:56.637917 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.638038 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.638223 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":613954,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":218526,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":8662912,"thread_start_us":2232035,"threads_started":3,"wal-append.queue_time_us":971205}
I20260709 13:16:56.409571 10859 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.282s
W20260709 13:16:56.661413  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 1.31549e+06us
W20260709 13:16:56.686558 10836 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:56.718364 10682 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:56.718953 10563 consensus_meta.cc:287] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.776s	user 0.003s	sys 0.018s
I20260709 13:16:56.720656  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:56.722468  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:56.723150 10719 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.724849  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:56.725660  8361 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:56.725878  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 330) took 2205 ms. Trace:
W20260709 13:16:56.727929 10802 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.812s	user 0.006s	sys 0.012s
W20260709 13:16:56.729559 10804 log.cc:927] Time spent T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.748s	user 0.008s	sys 0.019s
I20260709 13:16:56.730412  8116 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 3, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 3 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.587841  8369 rpcz_store.cc:276] 0709 13:16:55.179052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.179836 (+   784us) service_pool.cc:224] Handling call
0709 13:16:55.180425 (+   589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.198077 (+ 17652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.198112 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.198557 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.229296 (+1030739us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.229353 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.229447 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.444324 (+214877us) raft_consensus.cc:1685] finished
0709 13:16:56.444402 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.444893 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14794,"raft.queue_time_us":143,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":15731,"thread_start_us":1018105,"threads_started":1,"wal-append.queue_time_us":1205920}
I20260709 13:16:56.709427  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1992) took 1530 ms. Trace:
I20260709 13:16:56.710716  8366 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:16:56.707613  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1550) took 1111 ms. Trace:
I20260709 13:16:56.745877  8360 rpcz_store.cc:276] 0709 13:16:55.596183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.699041 (+1102858us) service_pool.cc:224] Handling call
0709 13:16:56.706838 (+  7797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.707181 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.707215 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.707289 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:56.707334 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.707410 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.707546 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.659974  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:56.667887 10815 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:16:56.735342 10809 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.809s	user 0.013s	sys 0.015s
W20260709 13:16:56.737121 10837 log.cc:927] Time spent T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.722s	user 0.000s	sys 0.001s
I20260709 13:16:56.723891  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:56.683966 10655 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.745131  8364 rpcz_store.cc:276] 0709 13:16:55.179328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.181108 (+  1780us) service_pool.cc:224] Handling call
0709 13:16:55.181436 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.181679 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.181714 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.197478 (+ 15764us) log.cc:844] Serialized 26 byte log entry
0709 13:16:55.974453 (+776975us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:55.974509 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.974598 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.708996 (+734398us) raft_consensus.cc:1685] finished
0709 13:16:56.709031 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.709262 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":763927,"threads_started":1,"wal-append.queue_time_us":986334}
I20260709 13:16:56.743623  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:56.719396 10563 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:56.758889  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 75321.5us
I20260709 13:16:56.762616  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:56.756817 10655 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.781669 10863 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:56.782373 10863 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:56.782967 10863 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:56.784806 10762 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.784498 10859 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:56.789422  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.790542  8214 raft_consensus.cc:2410] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:56.766367 10825 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:56.777077  8927 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:56.801182  8365 raft_consensus.cc:2410] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:56.767788 10849 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.726497  8211 rpcz_store.cc:276] 0709 13:16:54.520065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.520273 (+   208us) service_pool.cc:224] Handling call
0709 13:16:54.674092 (+153819us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:55.345403 (+671311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.347529 (+  2126us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:55.620136 (+272607us) log.cc:844] Serialized 52 byte log entry
0709 13:16:56.725160 (+1105024us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:56.725247 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.725419 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.725504 (+    85us) raft_consensus.cc:1685] finished
0709 13:16:56.725534 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.725736 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1632,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":1419561,"threads_started":2,"wal-append.queue_time_us":718944}
I20260709 13:16:56.808360  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1548) took 1208 ms. Trace:
I20260709 13:16:56.822333  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1554) took 1188 ms. Trace:
I20260709 13:16:56.822829  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.806932 10855 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:56.822747  8366 rpcz_store.cc:276] 0709 13:16:55.633486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.745598 (+1112112us) service_pool.cc:224] Handling call
0709 13:16:56.796333 (+ 50735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.821921 (+ 25588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.821953 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.822000 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:56.822039 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.822122 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.822253 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.826627 10855 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.829057  8366 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:56.830427 10399 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:16:56.831719  8889 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:56.833571  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:56.834622  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:56.835619 10682 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:56.836556 10713 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:56.837266 10713 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:56.837769 10682 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:56.838390 10682 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:56.838521 10713 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.763588 10424 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.814800  8922 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:56.804453 10825 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:56.857127  8368 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:56.866020  8365 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:56.866974  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:56.811702  8362 rpcz_store.cc:276] 0709 13:16:55.594726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.079226 (+484500us) service_pool.cc:224] Handling call
0709 13:16:56.079452 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.079628 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:56.668235 (+588607us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.751709 (+ 83474us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.756256 (+  4547us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:56.777524 (+ 21268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.793223 (+ 15699us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.803485 (+ 10262us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":329016,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":43066,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":10806,"thread_start_us":607844,"threads_started":2,"wal-append.queue_time_us":39463}
I20260709 13:16:56.876551 10880 consensus_queue.cc:1059] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:56.877291 10864 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:56.877978 10864 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:56.878203 10880 raft_consensus.cc:3055] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:56.878577 10880 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:56.879105 10864 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.880077 10884 consensus_queue.cc:1059] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:16:56.882580 10845 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:56.865334  8183 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:56.875365  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1430) took 1292 ms. Trace:
I20260709 13:16:56.859476 10424 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.889544  8213 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:56.890811 10724 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:56.891252 10724 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:56.892381 10563 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:56.839633 10682 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.893865 10768 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:56.895387  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:56.895690  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.897257  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.883035 10845 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.910627  8217 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:56.892405 10724 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:56.886582  8216 rpcz_store.cc:276] 0709 13:16:55.580119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.588717 (+  8598us) service_pool.cc:224] Handling call
0709 13:16:55.589092 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.589366 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.589403 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.589932 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.751521 (+1161589us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:56.807297 (+ 55776us) log.cc:844] Serialized 14 byte log entry
0709 13:16:56.860316 (+ 53019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.865274 (+  4958us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.865319 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:56.865332 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.872426 (+  7094us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33814,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":5766,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10363,"thread_start_us":1032574,"threads_started":1,"wal-append.queue_time_us":819033}
I20260709 13:16:56.860546 10833 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.920946 10399 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:56.921777  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:56.923897 10724 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.955164  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:56.911293 10845 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:56.959030  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 125598us
I20260709 13:16:56.978395  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:56.964425 10807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.332s	user 0.011s	sys 0.012s
I20260709 13:16:56.978609  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:56.883184 10880 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.912269 10825 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:56.985424  8294 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
W20260709 13:16:56.989236  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 189585us
I20260709 13:16:56.995492  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:56.983107 10807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.505s	user 0.012s	sys 0.012s
I20260709 13:16:56.988983 10339 ts_tablet_manager.cc:1434] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.743s	user 0.037s	sys 0.030s
I20260709 13:16:56.999675  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.002966 10697 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:57.003319 10690 consensus_meta.cc:287] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.946s	user 0.009s	sys 0.007s
I20260709 13:16:57.004063 10834 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.004880  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:57.004943 10834 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.007426 10399 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:57.007987 10399 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:57.008194 10880 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.009158 10399 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.008448 10860 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:16:57.011255 10860 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:57.011646 10860 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:57.012877  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.012962 10860 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.003842 10690 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.014609 10860 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.015363  8928 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:57.022728 10690 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:57.023726 10667 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:16:57.007999 10834 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:57.031975  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.034917 10667 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:57.036784  8183 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:57.038486  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:57.039153 10667 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.040131 10784 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.040591 10784 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.040948 10784 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.041702 10690 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.042366 10690 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:57.043673  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.044687 10690 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:57.048847  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:57.050827 10667 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:57.057425 10876 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.436s	user 0.004s	sys 0.000s
I20260709 13:16:57.059621  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1999) took 1862 ms. Trace:
W20260709 13:16:57.060153  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.046164  8213 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:57.060076 10833 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:57.073731  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.074589  8219 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:57.074998 10667 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:57.076694  8361 raft_consensus.cc:2410] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:16:57.079105  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 190470us
I20260709 13:16:57.059965  8367 rpcz_store.cc:276] 0709 13:16:55.196967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.462120 (+265153us) service_pool.cc:224] Handling call
0709 13:16:55.462584 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.188202 (+725618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.188230 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.188692 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.725640 (+536948us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b480015c258. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f 00007f3202428f37 00007f320243d55c 00007f320243d508 00007f320243d488 00007f320243d443 00007f320243c6ec 00007f3201366a96
0709 13:16:56.751812 (+ 26172us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:56.751989 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.763867 (+ 11878us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.056953 (+293086us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b24002c5238. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa1aa9c4 00007f31fa1a8acb 00007f31fa363dc9 00007f31fa363a55 00007f31fa36309d 00007f31fcf9510e 00007f31fcfac88c 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221
0709 13:16:57.059290 (+  2337us) raft_consensus.cc:1685] finished
0709 13:16:57.059309 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.059434 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18489,"raft.queue_time_us":163211,"raft.run_cpu_time_us":2078,"raft.run_wall_time_us":1089580,"spinlock_wait_cycles":172777472,"thread_start_us":1150638,"threads_started":2,"wal-append.queue_time_us":422358}
I20260709 13:16:57.085822  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.088502  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.092156 10784 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.093408  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:57.093770  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.094120  8365 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:57.094218  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:57.094517  8294 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:57.094991  8362 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:57.095400  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:57.095964  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.096364  8360 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:16:57.096905  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:57.097549  8368 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.099159 10784 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:57.063726 10863 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.100732  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.100951  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.101411  8287 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:57.101564  8289 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:57.102360 10863 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:57.102479  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.096148  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.111886  8220 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
W20260709 13:16:57.127928  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.129392  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.103257  8288 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:57.149451  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:57.150794  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46007.4us
I20260709 13:16:57.151934  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.153183 10849 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:16:57.155647  8218 raft_consensus.cc:2410] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:57.153784 10849 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:57.075747 10339 ts_tablet_manager.cc:1467] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Tablet startup took 764ms
I20260709 13:16:57.180558  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.187667  8292 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:57.188851  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:57.190678  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.189620  8367 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:57.209722  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.206238  8922 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:57.209767 10851 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.211789  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:57.212090  8927 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:57.179224 10705 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:57.219610  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 43857.5us
W20260709 13:16:57.218246 10721 consensus_meta.cc:287] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.026s	user 0.006s	sys 0.012s
I20260709 13:16:57.225626 10849 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:57.226323  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.226557 10399 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:57.227291  8919 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:57.178979 10745 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.232461  8293 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:57.231786 10784 raft_consensus.cc:3055] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.232609 10705 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.257905  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 1994) took 2036 ms. Trace:
I20260709 13:16:57.259510 10705 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.258267  8363 rpcz_store.cc:276] 0709 13:16:55.195599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.203489 (+  7890us) service_pool.cc:224] Handling call
0709 13:16:55.203994 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.216293 (+ 12299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.216320 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.216736 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.823405 (+1606669us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b480015c258. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f 00007f3202428f37 00007f320243d55c 00007f320243d508 00007f320243d488 00007f320243d443 00007f320243c6ec 00007f3201366a96
0709 13:16:56.827207 (+  3802us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b180045d3c0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:16:56.981840 (+154633us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.130021 (+148181us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.191561 (+ 61540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.216570 (+ 25009us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.216611 (+    41us) raft_consensus.cc:1685] finished
0709 13:16:57.216621 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.232126 (+ 15505us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76471,"prepare.queue_time_us":162917,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":64223,"raft.run_cpu_time_us":19971,"raft.run_wall_time_us":1609855,"spinlock_wait_cycles":599095936,"thread_start_us":80256,"threads_started":1,"wal-append.queue_time_us":1801533}
I20260709 13:16:57.260186  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.255968 10667 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:16:57.260978  8291 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:57.245509 10851 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.260340  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:57.219981  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.256938  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2005) took 1395 ms. Trace:
I20260709 13:16:57.265101  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:57.266471  8368 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
W20260709 13:16:57.265300  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 78381us
I20260709 13:16:57.268754  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.263206  8369 rpcz_store.cc:276] 0709 13:16:55.861618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.762521 (+900903us) service_pool.cc:224] Handling call
0709 13:16:56.802173 (+ 39652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.893434 (+ 91261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.893464 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:56.893943 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:16:57.001642 (+107699us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:57.238793 (+237151us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.256652 (+ 17859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.256722 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.256767 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:57.256778 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.256890 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144327,"prepare.queue_time_us":151834,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":39339,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"thread_start_us":192508,"threads_started":2,"wal-append.queue_time_us":200903}
I20260709 13:16:57.246793 10784 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:57.275044 10745 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.276381  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.277464  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:57.280402  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.281518 10696 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:16:57.288601  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.292196  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.277477 10745 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.294445  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.295535 10895 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:57.293299 10845 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.312779  8218 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:57.297600  8920 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:57.310731 10667 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:57.352564  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 75198.6us
I20260709 13:16:57.334899 10784 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:57.358853  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 241962us
I20260709 13:16:57.360333  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:57.356314 10784 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.366470 10823 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:57.358582 10655 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.001s
I20260709 13:16:57.391538  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:57.392491 10696 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.393344 10724 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:57.394883 10867 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:57.395275 10724 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:57.396375 10867 consensus_queue.cc:1059] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:57.397440 10696 raft_consensus.cc:3055] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:57.405354  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:57.412761  8369 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:16:57.183908 10339 ts_tablet_manager.cc:1469] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Trace:
0709 13:16:40.408381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.413105 (+  4724us) service_pool.cc:224] Handling call
0709 13:16:41.056931 (+643826us) ts_tablet_manager.cc:934] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
0709 13:16:45.071401 (+4014470us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:16:46.429789 (+1358388us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:46.437242 (+  7453us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:16:46.748466 (+311224us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:16:46.748849 (+   383us) tablet_replica.cc:206] Creating consensus instance
0709 13:16:46.749168 (+   319us) ts_tablet_manager.cc:989] Replica registered.
0709 13:16:46.749273 (+   105us) inbound_call.cc:177] Queueing success response
0709 13:16:47.545183 (+795910us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b4c00152bc0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fb6dda20 00007f31fb6eea29 00007f31fb6ef13f 00007f31fb6b32ab 00007f31fb6e0f3c 00007f31fb6e1461 00007f31fb6e1768 00007f320146766b 00007f32023a415b 00007f32023a3f98 00007f3202395322
0709 13:16:53.479269 (+5934086us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:16:56.247685 (+2768416us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:16:56.477266 (+229581us) tablet_replica.cc:261] Starting instrumentation
0709 13:16:56.478788 (+  1522us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":270,"mutex_wait_us":39701,"raft.queue_time_us":54181,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"spinlock_wait_cycles":14392192,"tablet-copy.queue_time_us":385527,"tablet-download-pool.queue_time_us":51800,"tablet-download-pool.run_cpu_time_us":16298,"tablet-download-pool.run_wall_time_us":6295191,"thread_start_us":440906,"threads_started":3}
I20260709 13:16:57.428480 10845 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.368646 10667 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.436471 10895 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.402011 10807 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:16:57.447101 10667 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:57.449676  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.450505 10895 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.450605  8261 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.450923 10895 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:57.383631 10655 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.407114 10696 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:57.455335 10721 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.455255  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.455869 10721 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:57.456346 10721 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.456394 10807 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.456980 10807 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:57.457425 10807 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.459249  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 430) took 1367 ms. Trace:
I20260709 13:16:57.459666  8928 rpcz_store.cc:276] 0709 13:16:56.091723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.191523 (+ 99800us) service_pool.cc:224] Handling call
0709 13:16:57.459020 (+1267497us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400563bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:57.459187 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772683008}
I20260709 13:16:57.460942  8261 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.451328 10895 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.459415  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:57.472470  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 69673.9us
I20260709 13:16:57.475445 10851 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.479449  8258 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:57.481050  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.481972  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.482686 10762 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.483040 10762 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:57.483361 10762 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.484337 10849 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:16:57.488703  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 94706us
I20260709 13:16:57.492415  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.485306 10849 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:57.502796 10545 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:57.509326  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.502851 10599 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:57.496652 10705 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:57.503552 10892 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:16:57.495033  8892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.575s (SENT) [suppressed 30 similar messages]
I20260709 13:16:57.494380 10833 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:57.513453  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:57.515349  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:57.516386 10655 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.513479 10696 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.517362  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:57.554355  8367 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:57.558982 10721 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:57.560508  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.560719  8364 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:57.561506  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 53172.2us
W20260709 13:16:57.499696  8889 connection.cc:256] RPC call timeout handler was delayed by -1.8126160200001777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:16:57.563092  8367 pending_rounds.cc:85] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 1
I20260709 13:16:57.522604 10599 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:57.573576 10599 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.568502 10853 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.541100 10745 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.579684 10745 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:57.580293 10745 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.519073 10705 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:57.585693  8361 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:57.585254 10705 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.587204 10705 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.590694  8362 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:57.578008 10833 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:57.593238  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.571630  8367 pending_rounds.cc:107] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:57.601146  8367 raft_consensus.cc:2889] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:57.605444  8261 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.565052 10849 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:57.607663  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.611217  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:57.611511 10713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.005s	sys 0.020s
I20260709 13:16:57.625871  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:57.626114  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 110917us
I20260709 13:16:57.612339 10655 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.616453 10851 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:57.623643 10713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.005s	sys 0.020s
W20260709 13:16:57.636875  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 320052us
I20260709 13:16:57.637387  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.622999 10846 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.644961 10759 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.645370 10759 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.645713 10759 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.648254 10696 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:57.649454  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.651336  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.634739 10851 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:57.659386 10851 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.650449 10846 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.664377 10846 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.617527 10853 consensus_queue.cc:1059] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:57.631202 10655 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:57.657125  8889 connection.cc:256] RPC call timeout handler was delayed by -1.2177016860000549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:16:57.669749  8889 connection.cc:256] RPC call timeout handler was delayed by -1.1790016859999923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 13:16:57.670130  8889 connection.cc:256] RPC call timeout handler was delayed by -1.1673016859999734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:16:57.655484  8928 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:57.645390 10688 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:57.667505  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.674525  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:57.677621 10807 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.685792 10849 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.690258 10807 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:57.691156 10697 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.692173 10860 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.692355  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.692787  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:57.693401  8928 raft_consensus.cc:2376] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7. Re-sending same reply.
I20260709 13:16:57.694554  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:57.692719 10860 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.695140  8369 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.695570  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:57.696681 10860 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:57.696908  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:57.697268 10860 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.697994 10807 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.698395 10807 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.698755 10807 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.698796  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:57.671972 10655 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.700366 10697 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:57.700985 10697 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:57.701862 10697 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.703300  8369 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:16:57.694487  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.704463  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.706183 10721 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:57.706918 10721 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:57.707340 10721 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:57.673316 10688 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.708283 10688 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.708876 10759 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.713660 10759 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:57.715233 10823 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:57.715776 10721 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.717696 10762 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.722440  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:57.675522 10853 consensus_queue.cc:1243] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:57.729909  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:57.733264  8369 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.723212 10807 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.731760  8920 raft_consensus.cc:3055] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:57.730249 10768 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.683707 10599 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.736596  8928 raft_consensus.cc:2410] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:57.736912 10859 raft_consensus.cc:3055] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.740700 10724 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:57.655526 10833 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.742411  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1280) took 1203 ms. Trace:
I20260709 13:16:57.749409  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.747958 10599 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:57.750717 10745 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.746685 10859 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:57.744374  8920 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:16:57.757055 10895 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.753182  8220 rpcz_store.cc:276] 0709 13:16:56.539167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.541661 (+  2494us) service_pool.cc:224] Handling call
0709 13:16:57.742175 (+1200514us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54002f4c54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:57.742301 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887380736}
I20260709 13:16:57.760632 10724 raft_consensus.cc:3055] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:57.728791 10655 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.760650  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.762722 10762 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.795219  8920 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.796643  8920 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.796919 10688 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.799122 10688 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:57.776991  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:16:57.784404  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 111139us
I20260709 13:16:57.723117 10846 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.792918 10724 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:57.816184 10563 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.816797 10724 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.818152 10724 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.820417  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:16:57.809860  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 111171us
W20260709 13:16:57.812222 10905 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.401s	user 0.004s	sys 0.000s
I20260709 13:16:57.812358  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.780393 10599 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.812906 10701 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.828801  8369 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:57.835417  8261 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.815380 10878 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:57.833581 10701 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.843140 10655 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.843991  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.844838  8293 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:57.842936  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:57.846621  8363 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.847961 10825 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:57.848488 10859 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.849668 10859 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.852406  8367 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.852301 10851 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.854146 10768 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:57.854445 10745 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.854713 10851 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:57.856117 10846 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:57.856612 10713 raft_consensus.cc:3055] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:57.857045 10713 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:57.857977 10713 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:57.859246 10713 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.859488 10682 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.860648  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.866542  8363 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:57.868108  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.868741  8261 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:57.854619 10768 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.875525  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:57.814778 10845 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:16:57.843014 10701 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:57.881897  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 61585.7us
I20260709 13:16:57.883365 10719 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:57.885322 10688 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:57.886859  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.887087 10807 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:57.887481  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:57.888326  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:57.862475 10721 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:57.942982  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.944985 10719 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:57.881927  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:57.954152  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:16:57.964620 10920 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:16:57.872864 10878 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:57.955415  8921 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
W20260709 13:16:58.160013  8258 connection.cc:256] RPC call timeout handler was delayed by -1.1865883030002351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 13:16:58.020133  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.160771  8258 connection.cc:256] RPC call timeout handler was delayed by -1.1361883030001536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 13:16:58.100788  8922 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
W20260709 13:16:58.113104  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.065811  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:58.162482  8928 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.066406  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:58.148922  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:58.172951  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:58.173007  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 106723us
I20260709 13:16:58.173138  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.175117  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.175128  8218 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.980165  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:58.177027  8291 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.094010 10895 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:58.090435 10878 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:58.178548  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.165279 10807 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.975437 10688 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:58.171377 10849 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.165284 10721 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:58.214321  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.079242  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:58.221226  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:57.978768 10599 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.092816 10719 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.221730  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.276589  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:58.357127  8219 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
W20260709 13:16:58.252751  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.276275  8213 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:16:58.357959  8213 pending_rounds.cc:85] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 4
I20260709 13:16:58.358178  8213 pending_rounds.cc:107] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:58.358417  8213 raft_consensus.cc:2889] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.358937  8213 pending_rounds.cc:107] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:16:58.359251  8213 raft_consensus.cc:2889] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.313108  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.290203  8214 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:16:58.356956  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.289767  8363 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.363503  8294 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.360791  8928 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:16:58.368326  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 54876.1us
I20260709 13:16:58.289944  8366 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:58.290249  8369 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:58.278293  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.388208  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.362973  8367 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:58.319099  8211 raft_consensus.cc:2410] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:58.206866  8925 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:16:58.423096  8217 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:58.264307  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:58.252815  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.387071  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.337654 10851 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:58.277544 10932 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.426353  8214 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:58.264178  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.363557  8215 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:58.383463  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.427333  8289 raft_consensus.cc:2368] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7.
I20260709 13:16:58.253684  8923 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:16:58.320261  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:58.434876  8213 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:58.435051  8295 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.436908  8360 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.434372  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.345144 10933 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.426359  8920 consensus_meta.cc:287] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.004s
I20260709 13:16:58.220479 10807 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:58.443704 10923 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:16:58.253870  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:58.445478  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:58.446306  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 266549us
I20260709 13:16:58.385506 10688 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:58.222602 10895 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:58.320796 10696 consensus_queue.cc:1059] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.130s
W20260709 13:16:58.466987  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.464628  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.472430  8218 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:16:58.472852  8289 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:58.515799  8294 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
W20260709 13:16:58.526831  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 52727.9us
I20260709 13:16:58.510217  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:58.541011  8212 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:58.551789  8295 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:58.438781 10851 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.557410  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:58.560544  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.569413  8294 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.517571 10696 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:58.555722 10682 consensus_meta.cc:287] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.696s	user 0.013s	sys 0.000s
W20260709 13:16:58.564103 10919 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.011s	sys 0.015s
I20260709 13:16:58.551937  8920 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:16:58.469905 10895 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.574318  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.579829  8289 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:16:58.575127  8292 raft_consensus.cc:2410] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:58.575188  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.468022 10932 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:58.465284 10933 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:58.585853  8295 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
W20260709 13:16:58.573107 10919 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.012s	sys 0.016s
I20260709 13:16:58.574340  8920 pending_rounds.cc:85] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 5
I20260709 13:16:58.600028  8920 pending_rounds.cc:107] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:16:58.600450  8920 raft_consensus.cc:2889] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.589313 10721 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.586532  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:58.605522  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:58.606455 10927 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.607195 10927 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.607342  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:58.591277  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:58.609215  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:58.610328 10849 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.611196 10849 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.611619 10849 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:58.592273 10768 consensus_meta.cc:287] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.004s
I20260709 13:16:58.572515 10696 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:58.612017 10849 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.612594 10768 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.618780 10768 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:58.619200  8364 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.613332 10851 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:58.597332 10933 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:58.613606 10696 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:58.599331 10895 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:58.623546  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.624567  8289 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:58.625536  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.626612 10863 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:58.626808  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.627220 10863 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.627554  8289 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:16:58.629133 10599 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:58.648404  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:16:58.654438  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 214054us
I20260709 13:16:58.686231  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:58.687765  8289 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:58.638834 10696 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.640187 10563 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:58.695032  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.698624  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:58.699895  8294 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:16:58.711272  8369 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:58.712527  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:58.727185  8295 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:58.730963 10610 consensus_queue.cc:1059] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:58.736934 10610 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:16:58.737533 10701 consensus_meta.cc:287] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.001s
I20260709 13:16:58.737466 10610 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.737974 10701 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.739459 10610 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:58.743919 10941 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:58.744436 10941 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.746326 10941 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:58.736864 10867 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:58.699980 10563 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:58.748821 10867 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:58.749205 10867 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:58.750437 10563 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:58.751183 10563 raft_consensus.cc:3055] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:58.751581 10563 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:58.739800 10701 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:58.754864 10867 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:58.755998 10867 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.756804  8286 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:58.759171  8286 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:16:58.760474  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.707152 10688 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.841086  8293 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:58.841238  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.820669  8294 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:16:58.845898  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 236802us
I20260709 13:16:58.831072  8292 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:58.850387  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 196653us
I20260709 13:16:58.853178  8213 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.854413  8295 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:16:58.861538  8212 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:58.833863 10807 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:58.863765  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.839847 10696 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.770725 10863 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:58.769891 10939 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.878654  8217 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:58.881247  8292 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:58.882455  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:58.880234  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:58.889011  8213 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:58.886317  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.890554  8220 raft_consensus.cc:2368] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7.
I20260709 13:16:58.892436  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.892586  8218 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 4.
I20260709 13:16:58.921903  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:16:58.939865  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.960206  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:58.961084  8360 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:58.964082  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:58.964663  8360 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.971817 10932 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:58.971944  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.972282  8292 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:16:58.972659 10925 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.094s	user 0.006s	sys 0.009s
I20260709 13:16:58.973532  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:58.974213  8361 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
W20260709 13:16:58.974679  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.972631  8214 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:58.982122  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 99753.9us
I20260709 13:16:58.982286  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:58.957412 10599 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.990842  8293 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:58.995370  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:58.996260  8365 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:16:58.999975  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.896639 10696 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.000141  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:58.864336 10563 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:59.005259  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 108966us
I20260709 13:16:59.005903  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.006546  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.011984  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:58.990166 10939 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:59.023699  8367 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:16:59.024253  8362 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:59.026969  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.034397  8363 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:59.023252 10941 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.036935  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.037317 10941 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.047150  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.049834  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.050483  8213 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.055483  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.057379  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.057497  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.064463  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.064724  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.064494  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.065501  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.028402 10943 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.070878  8365 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:59.071346 10918 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.064973  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:59.071511  8332 connection.cc:256] RPC call timeout handler was delayed by -1.4757389660001081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 13:16:59.074405  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:16:59.074759  8332 connection.cc:256] RPC call timeout handler was delayed by -1.4595389660000819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 13:16:59.075276  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.077119  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.075350  8212 raft_consensus.cc:2393] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 5: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:59.029515 10939 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:59.075801  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.094818  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.096065  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.097039  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.098310  8286 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:59.039412 10563 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:59.100308 10936 log.cc:927] Time spent T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:16:59.102954 10948 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:59.103973 10949 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:16:59.105253  8924 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:59.105481 10956 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:16:59.106698  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:59.106901 10939 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.097306 10918 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.108667  8924 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:59.110234  8258 leader_election.cc:400] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7.
I20260709 13:16:59.111193 10697 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:59.039251 10599 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.112663  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.112716 10697 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:59.114221 10849 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.115320  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 629) took 1037 ms. Trace:
I20260709 13:16:59.116217 10849 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:59.116482 10933 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.117458  8219 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:59.118598 10941 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:59.119457  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:59.118610  8332 connection.cc:256] RPC call timeout handler was delayed by -1.3020389660000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:16:59.120564  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1922389660001045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 13:16:59.120007  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 628) took 1053 ms. Trace:
W20260709 13:16:59.121086  8332 connection.cc:256] RPC call timeout handler was delayed by -1.0743389660001412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 13:16:59.122576  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:59.091696  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.124785  8365 raft_consensus.cc:2410] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:59.125439  8214 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:16:59.127429  8213 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:59.098830  8363 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:59.129343  8360 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:16:59.130138 10958 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:59.130617  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.130704 10958 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.131378  8360 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
I20260709 13:16:59.132015  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.132360  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.132988 10958 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:59.133308  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.133656  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.124819  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.119887  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.135093  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:59.121137  8922 rpcz_store.cc:276] 0709 13:16:58.067122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.306043 (+238921us) service_pool.cc:224] Handling call
0709 13:16:58.306382 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.358403 (+ 52021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.358433 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.414403 (+ 55970us) log.cc:844] Serialized 26 byte log entry
0709 13:16:58.586180 (+171777us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:58.586230 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.586291 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.119822 (+533531us) raft_consensus.cc:1685] finished
0709 13:16:59.119839 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.119957 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8509,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1145,"thread_start_us":134768,"threads_started":1,"wal-append.queue_time_us":295643}
I20260709 13:16:59.136309  8360 raft_consensus.cc:2410] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:59.138345  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:16:59.139458  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.115715  8927 rpcz_store.cc:276] 0709 13:16:58.080267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.380205 (+299938us) service_pool.cc:224] Handling call
0709 13:16:58.384214 (+  4009us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:58.412745 (+ 28531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.412775 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:58.437477 (+ 24702us) log.cc:844] Serialized 52 byte log entry
0709 13:16:58.767450 (+329973us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:58.767513 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.767612 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.115102 (+347490us) raft_consensus.cc:1685] finished
0709 13:16:59.115121 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.115265 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5967,"raft.queue_time_us":29230,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":13137,"spinlock_wait_cycles":1408,"thread_start_us":257488,"threads_started":1,"wal-append.queue_time_us":574361}
I20260709 13:16:59.141021  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.141433  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.143311  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.144680  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-8d3403855d4147a9b056dc8678880fdf received from {username='slave'} at 127.0.0.1:59420
I20260709 13:16:59.145188 10834 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.146171  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:59.147444 10696 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:59.147925  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:59.148525  8919 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.145339  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-8d3403855d4147a9b056dc8678880fdf on tablet 8d3403855d4147a9b056dc8678880fdf with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.150086  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1445) took 1287 ms. Trace:
I20260709 13:16:59.150501  8211 rpcz_store.cc:276] 0709 13:16:57.863088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.868032 (+  4944us) service_pool.cc:224] Handling call
0709 13:16:59.149872 (+1281840us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b540019a854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:16:59.150029 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794913152}
I20260709 13:16:59.152706  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.152909  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.154162  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.133585 10958 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.157205  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.153491  8217 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:16:59.110291 10918 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:59.159345  8362 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:59.159751 10849 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.159364  8218 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:59.173743  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.173592  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.171428  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.172492  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.120476 10859 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.177712  8360 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.177826 10960 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.183420  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.159708  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.160679 10943 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:59.192889  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.198570  8289 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:16:59.179706  8214 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:59.202014  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.202881  8290 raft_consensus.cc:2410] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:59.211591  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 439) took 2108 ms. Trace:
I20260709 13:16:59.212025  8926 rpcz_store.cc:276] 0709 13:16:57.103202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.103343 (+   141us) service_pool.cc:224] Handling call
0709 13:16:57.765852 (+662509us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:16:57.766060 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.349009 (+582949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.349044 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:58.349088 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:58.349123 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.211380 (+862257us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54002256d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:59.211423 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.211536 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":407,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":1356712448}
I20260709 13:16:59.214891  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 630) took 1118 ms. Trace:
I20260709 13:16:59.215322  8928 rpcz_store.cc:276] 0709 13:16:58.096577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.421893 (+325316us) service_pool.cc:224] Handling call
0709 13:16:58.422214 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.444820 (+ 22606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.444850 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.463523 (+ 18673us) log.cc:844] Serialized 26 byte log entry
0709 13:16:58.833504 (+369981us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:58.833546 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.833610 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.214693 (+381083us) raft_consensus.cc:1685] finished
0709 13:16:59.214711 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.214833 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1140,"raft.queue_time_us":8687,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":279775,"threads_started":1,"wal-append.queue_time_us":684286}
I20260709 13:16:59.200380 10943 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.217271 10943 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.223544  8919 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:59.199616 10863 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.190537  8920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:49218
W20260709 13:16:59.236326  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 63896.9us
I20260709 13:16:59.236825  8920 raft_consensus.cc:606] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:59.237078  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.238255  8183 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.239039 10563 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.239624  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.239861 10563 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.199815 10859 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.246788  8220 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:16:59.240489  8920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:49218
I20260709 13:16:59.259703  8215 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:16:59.260381  8289 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:16:59.260769  8289 pending_rounds.cc:85] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 6
I20260709 13:16:59.260988  8289 pending_rounds.cc:107] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:16:59.261215  8289 raft_consensus.cc:2889] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.262498  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.264511  8366 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.205274  8211 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.272364  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.273002  8290 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.268695  8920 raft_consensus.cc:606] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:59.276296  8920 raft_consensus.cc:614] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.269783 10859 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.276758 10943 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.277288 10859 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.277782 10859 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.278837 10943 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:59.279172 10958 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.280467  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.281141  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.281806  8294 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:16:59.283594  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.284149  8286 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.284458  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.285244  8212 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:59.285739  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.286769 10867 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.286973  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.287302 10867 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:59.258385 10863 consensus_queue.cc:1059] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:16:59.288211 10696 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:59.271761 10950 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.299s	user 0.000s	sys 0.004s
I20260709 13:16:59.289219 10696 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:59.289573 10696 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:59.290351 10696 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.291441 10696 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.291538  8286 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:16:59.288398 10863 consensus_queue.cc:1243] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:59.293035  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.293582  8287 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.293665  8218 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:59.294116  8218 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:59.294951  8218 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.258611 10928 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.294008  8183 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.296015  8218 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.296301  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.301033  8286 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:59.296590  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:59.267279 10906 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:59.305392  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 162149us
I20260709 13:16:59.310518 10721 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:59.279912 10859 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.324586  8290 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:59.311667 10828 consensus_queue.cc:1059] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:59.319222  8186 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.316499  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.326906  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.327261  8291 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:59.296980 10928 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.334359  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.342687  8258 leader_election.cc:400] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7.
I20260709 13:16:59.343223  8258 leader_election.cc:403] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:59.354607  8367 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:59.318727 10563 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.296110 10867 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:16:59.356170  8892 leader_election.cc:336] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.575s (SENT)
I20260709 13:16:59.312886 10863 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:16:59.328826 10906 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:59.340382 10918 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:59.333338 10599 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:59.372092  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.320623 10960 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:16:59.371903  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.330539 10943 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:16:59.374945 10682 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:16:59.374815 10697 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:59.357076 10399 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:59.373271 10942 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7.
I20260709 13:16:59.373090 10853 raft_consensus.cc:3055] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:59.371371  8287 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:16:59.384263  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.366973 10968 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.379750 10721 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.374819 10688 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.380708 10701 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:59.412326 10701 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:59.412858 10701 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.378729 10906 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.389902 10933 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:59.389699 10853 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:59.421003 10853 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.422912  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:59.423264 10954 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
I20260709 13:16:59.425338  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:59.426167 10968 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.426870 10968 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:59.427191 10968 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:59.427349  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.427623 10968 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:59.427733 10938 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.572s	user 0.000s	sys 0.002s
W20260709 13:16:59.429869  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.430070  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 626) took 1452 ms. Trace:
I20260709 13:16:59.431061 10859 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.371968 10895 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:59.395606 10563 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:59.437058 10563 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:59.400516 10599 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.400938  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.403020 10828 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.406764  8211 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:16:59.406876 10941 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:59.440630 10941 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:59.441489 10941 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.441627 10563 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.442689 10941 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.443336 10682 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.411453  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:59.385648 10697 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.448338 10697 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.450982 10682 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.432760 10971 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.433228  8889 leader_election.cc:400] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7.
I20260709 13:16:59.432951 10688 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.443766  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.383421 10849 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:59.448779 10968 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.453698 10928 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.431795 10859 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.430523  8921 rpcz_store.cc:276] 0709 13:16:57.977339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.209961 (+232622us) service_pool.cc:224] Handling call
0709 13:16:58.256424 (+ 46463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.270418 (+ 13994us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:58.275670 (+  5252us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.576317 (+300647us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:58.576986 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:16:58.577172 (+   186us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:58.873684 (+296512us) log.cc:844] Serialized 14 byte log entry
0709 13:16:58.909816 (+ 36132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.924257 (+ 14441us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.427090 (+502833us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:16:59.429847 (+  2757us) raft_consensus.cc:1685] finished
0709 13:16:59.429873 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.430010 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3693,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":54,"raft.queue_time_us":7137,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":30256,"spinlock_wait_cycles":50679424,"thread_start_us":569680,"threads_started":2,"wal-append.queue_time_us":427515}
I20260709 13:16:59.443377 10563 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.456547  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 366) took 1136 ms. Trace:
W20260709 13:16:59.458806  8892 leader_election.cc:336] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.587s (SENT)
W20260709 13:16:59.502477  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70023.7us
W20260709 13:16:59.502513  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 43748.5us
I20260709 13:16:59.503269  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:59.462896  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 129506us
I20260709 13:16:59.484767  8363 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:59.520430  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:59.521482 10745 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:59.521934 10745 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:59.522246 10958 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:59.480930  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 161777us
I20260709 13:16:59.485993  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.522316 10745 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.523672 10958 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:59.489362 10942 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.492420 10968 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:59.493012 10859 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:59.493765  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.525305 10942 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.525625  8289 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:16:59.495885  8367 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:59.525802 10942 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.497426  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.501647  8295 rpcz_store.cc:276] 0709 13:16:58.319831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.769591 (+449760us) service_pool.cc:224] Handling call
0709 13:16:58.843247 (+ 73656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:58.854925 (+ 11678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.456246 (+601321us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5400426154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:16:59.456473 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24976640}
I20260709 13:16:59.527787  8362 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:59.461608  8218 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:59.524861 10713 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.534583  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.525776  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1903) took 1317 ms. Trace:
I20260709 13:16:59.535609  8288 rpcz_store.cc:276] 0709 13:16:58.207996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.208145 (+   149us) service_pool.cc:224] Handling call
0709 13:16:58.241344 (+ 33199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:58.384194 (+142850us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:58.836211 (+452017us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.488740 (+652529us) log.cc:844] Serialized 14 byte log entry
0709 13:16:59.525405 (+ 36665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.525458 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:59.525514 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.525581 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.525694 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61359,"prepare.queue_time_us":67482,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":2933,"raft.queue_time_us":69575,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":3944,"thread_start_us":1019686,"threads_started":3,"wal-append.queue_time_us":516925}
I20260709 13:16:59.537391  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.523661  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.540307 10696 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.541442 10696 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.542049 10696 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:59.542389 10696 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:59.542764 10696 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.550861 10979 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:59.481235 10849 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:59.482486 10969 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:59.552755 10948 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:16:59.565305  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.531070 10884 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:59.490477 10933 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:16:59.573582 10849 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:59.591641  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 69056.3us
I20260709 13:16:59.550383 10696 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.592847  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:16:59.596475  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 72897.3us
I20260709 13:16:59.482560 10971 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.554666 10697 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.584400 10884 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:16:59.599866  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 60622.6us
I20260709 13:16:59.599459  8186 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.588084 10859 raft_consensus.cc:2764] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:16:59.591090  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:16:59.604785  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 72056us
I20260709 13:16:59.605729  8889 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.607088  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:59.620965  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.616520 10943 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:59.622778 10943 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.622895 10859 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.623225 10943 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:59.623868 10976 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:59.624871  8369 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:59.598848 10932 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:16:59.627592  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.623798  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.603919 10884 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.616848 10942 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.606671 10968 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.644763  8367 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:16:59.647264  8367 pending_rounds.cc:85] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 6
I20260709 13:16:59.647517  8367 pending_rounds.cc:107] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:16:59.647730  8367 raft_consensus.cc:2889] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.645037 10971 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.609979 10928 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:59.648995  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46394.8us
I20260709 13:16:59.651253  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:16:59.654299  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 51316.3us
I20260709 13:16:59.637847 10958 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:59.610555 10941 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:16:59.601506 10981 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:16:59.649847 10928 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:59.668164  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 62496.4us
I20260709 13:16:59.669215  8889 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:59.670388 10971 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:59.670696 10713 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.671137 10971 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:59.671666 10971 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.673633  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:59.674467  8921 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:16:59.671541 10713 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:59.676630  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:59.676802 10987 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.677646 10987 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:59.677987  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:59.679488 10939 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:59.680436  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:59.680320 10939 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.681639 10859 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:59.682137 10859 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.682554 10859 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.677310  8921 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:16:59.655381 10724 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.691869  8889 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.696270  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:59.698536 10867 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:59.658524 10958 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:16:59.666481 10928 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.706436  8889 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.704595  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:16:59.661010 10701 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.735760  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:16:59.693120 10688 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.711549 10667 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:59.693189 10918 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:59.663635 10989 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:16:59.708053 10958 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:59.710451 10724 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:59.743582 10667 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:16:59.713331 10860 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.692167 10971 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.754180 10939 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.736064 10919 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:59.754539 10993 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:16:59.756404 10697 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:16:59.756647 10993 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:59.758046 10993 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:59.755473 10860 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:16:59.759513 10860 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.760680 10667 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.711654 10719 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:59.766086 10887 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:59.766661 10887 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.767414 10884 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.768829 10887 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.768980 10991 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:59.769408 10991 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:59.769767 10884 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:59.769838 10991 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:59.772267 10990 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.772989 10990 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.705006 10867 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.774937 10867 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.748142 10918 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.764782 10696 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:16:59.775835 10986 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:16:59.792536  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 43601.6us
I20260709 13:16:59.796908  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:16:59.759513 10863 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.771812 10992 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.811956  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:16:59.812778  8921 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:16:59.813862  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:59.817255 10969 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:59.817999 10969 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.818480 10969 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:59.819260 10969 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.807087 10863 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:16:59.820405 10983 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:16:59.820683  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.820829 10863 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.821328  8365 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:59.822188 10863 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.825510  8367 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.781075 10667 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.817670 10991 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.827955  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.832365  8364 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:16:59.827397  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:16:59.832983  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.840552  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.840656  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.842548  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:16:59.842983  8288 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:16:59.833946  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.849181  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.840684 10853 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.853067  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:16:59.856240  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.851511 10990 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:16:59.858685 10990 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.861054 10990 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.857316 10724 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.871162  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.877591  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.877889  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.878417  8218 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.878515  8213 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:16:59.879909  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.880801  8213 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:16:59.871897  8293 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.850630 10884 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:59.887377  8219 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:59.887764  8219 pending_rounds.cc:85] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 3
I20260709 13:16:59.887969  8219 pending_rounds.cc:107] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:59.888206  8219 raft_consensus.cc:2889] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.889864  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.890512  8215 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:16:59.893757  8220 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:59.895272  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 188881us
I20260709 13:16:59.896556  8889 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.899086  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.899688  8219 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:59.900352  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.901232  8213 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:59.914098  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:16:59.887318 10884 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.918743  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.919710  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:16:59.920555  8219 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.892556 10993 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:16:59.911612 10990 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.854808 10968 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:59.929232  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.929986 10599 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.930349  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.889508 10928 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:16:59.931591  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 75432.6us
I20260709 13:16:59.922533 10884 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.939332  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.942934  8218 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:16:59.943394  8360 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:59.943984  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.942116  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:16:59.946679  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.961335  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:59.963035  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.964481  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:16:59.965687  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:16:59.927410 10701 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.966081  8218 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:16:59.967375  8292 raft_consensus.cc:2368] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8.
I20260709 13:16:59.967593  8219 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:16:59.967985  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:16:59.969473  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:16:59.969574  8919 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.922360 10992 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:16:59.974393  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.949126 10599 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.979233  8216 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:59.982915  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:16:59.959323 10971 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:16:59.928817 10993 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:16:59.994179 10849 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:16:59.995131 10993 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:16:59.987047 10987 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.977149  8925 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:59.988915  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:16:59.968947 10990 consensus_queue.cc:1059] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:17:00.016469  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 91147.7us
I20260709 13:17:00.024749 11006 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:00.026829 10713 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:00.027654 11008 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:00.028213 10995 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.045579  8293 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:00.045864 10995 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:00.028699 10999 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:00.029278 10990 consensus_queue.cc:1059] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:00.034262 10745 consensus_meta.cc:287] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.001s
I20260709 13:17:00.018486 10991 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:00.038926 10958 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.004733 11004 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:00.015799 10968 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.043391  8369 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:00.014523 10978 raft_consensus.cc:1064] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
W20260709 13:17:00.047907  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 59093.3us
I20260709 13:17:00.048360  8364 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:00.023396 10849 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.027842 10713 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.065800  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:00.052701 10884 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.066466  8186 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:00.088613  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:00.067968 10918 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.065102  8261 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:00.080255 10992 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.084169 11001 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:00.085719 11010 raft_consensus.cc:3055] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.066157 10745 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.099546  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:00.113860  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:00.004819 11009 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
W20260709 13:17:00.124867  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 149168us
I20260709 13:17:00.056906 10999 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.086591 10958 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.116714  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:00.119012 10667 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:00.122349  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:00.123272  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:00.134410  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:00.141062  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:00.136533  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:00.138111  8367 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:00.138880  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:00.100241 10991 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.143522  8291 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:00.146577  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:00.143407  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:00.105154 10610 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.062376 10927 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:17:00.148720  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:00.144634  8363 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:00.067025 10853 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:17:00.105975 11010 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:00.151990  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:00.153026  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:00.114171 10833 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.112617 11006 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:00.146386  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:00.155198  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 103232us
I20260709 13:17:00.169637  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:00.151638  8216 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:00.128405 10987 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.168692  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:00.172971  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:00.142576 10993 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:00.136898 10999 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.176892  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:00.181536  8368 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:17:00.183882  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.186929  8286 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:00.105381 11004 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:17:00.136267 10971 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:17:00.136765 10981 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:00.152578 10939 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:00.169292 10833 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.204440  8365 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:00.178699 10991 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:00.169567 11006 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:00.177975 10928 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:00.184267 10993 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:00.177836 10610 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:00.252645  8922 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:17:00.215497 10943 consensus_meta.cc:287] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.003s
I20260709 13:17:00.170720 10667 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.204775 10994 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:00.265190  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 94856us
I20260709 13:17:00.302532  8889 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:00.204934 10987 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:00.214844 10833 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.221654 10991 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.299818  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:00.312492 11005 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:00.312924 10994 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:00.313123 11005 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:00.241990 11006 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.195058 11002 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.194931 10988 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.279s
I20260709 13:17:00.256093 10993 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:00.300745  8368 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:00.204783 10958 consensus_queue.cc:1059] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:17:00.220681 10939 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:00.315625 10991 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:00.335040 10859 consensus_meta.cc:287] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.002s
W20260709 13:17:00.360383  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 172436us
I20260709 13:17:00.270533 10943 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.321556 10995 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:00.398891  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:00.399655  8368 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.345700  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:00.403411  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:00.404721 10985 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.552s	user 0.004s	sys 0.000s
I20260709 13:17:00.379211 10988 raft_consensus.cc:3055] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:00.398451 10884 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:00.476172  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:00.489884  8218 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:00.493225  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 189660us
I20260709 13:17:00.406373 10918 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.469100  8924 raft_consensus.cc:2368] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:17:00.397221 10958 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.166s
I20260709 13:17:00.401790 11001 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.313977 10994 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:00.562348 11001 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:00.474581 11012 log.cc:927] Time spent T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:17:00.517427 11015 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.393s	user 0.000s	sys 0.001s
I20260709 13:17:00.406373 10995 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.525884  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:00.379992 10859 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.533423  8368 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:00.559007  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:00.561653 11016 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:17:00.534641  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 393666us
I20260709 13:17:00.292425 11010 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.336618 11002 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.572860  8218 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:00.584231  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:00.585580  8332 leader_election.cc:400] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:17:00.485721 10988 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:00.592617  8183 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:00.595235  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:00.314000 11005 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.405877 10610 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:00.616266  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:00.600806  8332 leader_election.cc:403] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:17:00.615479  8216 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:00.569957 10943 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.569662 11001 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:00.614902 10968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.002s	sys 0.025s
I20260709 13:17:00.629841  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:00.632447  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:00.647150  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:00.647650 11019 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:17:00.648833  8922 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:00.621783 10969 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6.
I20260709 13:17:00.619891 10667 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:00.633165 10968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.002s	sys 0.026s
I20260709 13:17:00.561827 11006 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:00.594151 10995 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.477507 10987 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:00.653440 10863 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.831s	user 0.015s	sys 0.002s
I20260709 13:17:00.668185  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1464) took 1511 ms. Trace:
I20260709 13:17:00.668597  8217 rpcz_store.cc:276] 0709 13:16:59.157017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.196687 (+ 39670us) service_pool.cc:224] Handling call
0709 13:16:59.610552 (+413865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.610732 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.610754 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:59.610793 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:59.610836 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.610894 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.667980 (+1057086us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b540043dd50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:00.668130 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930901376}
W20260709 13:17:00.669545  8925 consensus_meta.cc:287] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.003s
I20260709 13:17:00.673934 11041 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:00.675557 11036 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:00.676137 11036 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:00.676548 11036 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:00.678524 11031 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:17:00.679577  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.681311 11034 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:17:00.682865 10713 consensus_meta.cc:287] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.593s	user 0.004s	sys 0.004s
I20260709 13:17:00.684229 11002 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.684418  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:00.684989 10991 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.687062 10991 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.687141 10859 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:00.687662 11014 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.432s	user 0.000s	sys 0.001s
I20260709 13:17:00.688594 10859 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.689144 10859 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:00.668586 10939 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:00.690249 10859 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.658367 10745 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.662282 10667 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:00.706526  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.730440  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 100820us
I20260709 13:17:00.673954  8925 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:00.735285  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:00.753968  8889 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:00.762697  8927 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.734856 11027 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
W20260709 13:17:00.798233 10999 consensus_meta.cc:287] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
W20260709 13:17:00.854331 11052 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:00.828962  8925 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:00.863267  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1599) took 1257 ms. Trace:
I20260709 13:17:00.868274 10995 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.842368 11036 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.870865 11036 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:00.871555 11028 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.443s	user 0.003s	sys 0.000s
I20260709 13:17:00.872287  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:00.873981  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:00.874996 11017 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 13:17:00.875126 10994 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:00.875747 10994 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:00.875905 11029 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:00.876472 10979 raft_consensus.cc:3055] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.876890 10979 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:00.877702 10979 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:00.878865 11029 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:00.834646 10999 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.879346 11010 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.879943  8214 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:00.878252  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:00.876724 10994 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.880960 10999 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:00.863761  8363 rpcz_store.cc:276] 0709 13:16:59.605874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.606041 (+   167us) service_pool.cc:224] Handling call
0709 13:16:59.617751 (+ 11710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.149455 (+531704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.862989 (+713534us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b5400355554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:00.863200 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211233664}
I20260709 13:17:00.891520 10991 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:00.891968 10991 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.892370 10991 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.475524  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:00.896391  8927 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:00.852070 11006 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:00.693342 10988 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:00.900323 10833 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.001s
W20260709 13:17:00.921591  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.922880  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:00.923615  8364 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:00.916859 10971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.005s	sys 0.029s
I20260709 13:17:00.915233 11035 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:00.931231  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:00.919114 11027 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:00.949009  8220 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:17:00.943284 10993 consensus_meta.cc:287] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
I20260709 13:17:00.948078 11027 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:17:00.932652 10563 consensus_queue.cc:1175] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" responder_term: 4 status { last_received { term: 4 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 4 index: 2 } }
I20260709 13:17:00.965126 11027 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:00.966501 11027 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.941567 10988 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:00.946600 10971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.006s	sys 0.029s
I20260709 13:17:00.930015 10833 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:00.947223 10682 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:00.944093 10987 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:00.981323  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 454) took 1039 ms. Trace:
I20260709 13:17:00.972430 10971 consensus_queue.cc:1243] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:00.988807  8923 rpcz_store.cc:276] 0709 13:16:59.941968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.944016 (+  2048us) service_pool.cc:224] Handling call
0709 13:16:59.950331 (+  6315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:00.125863 (+175532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.128341 (+  2478us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:00.305970 (+177629us) log.cc:844] Serialized 52 byte log entry
0709 13:17:00.613306 (+307336us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:00.613367 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.937353 (+323986us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400563bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:00.937419 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.966569 (+ 29150us) raft_consensus.cc:1685] finished
0709 13:17:00.966592 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.981246 (+ 14654us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20337,"raft.queue_time_us":437884,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":24270,"spinlock_wait_cycles":268483328,"thread_start_us":224876,"threads_started":1,"wal-append.queue_time_us":587994}
I20260709 13:17:01.005882 10833 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:00.972457 10993 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.016443  8362 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:01.017979  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 74754.9us
W20260709 13:17:01.084462  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.109896  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 356024us
I20260709 13:17:01.112104  8889 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:01.114365  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:01.192250 11006 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.212940 11006 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.205667 11067 consensus_queue.cc:1059] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 13:17:01.225909  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 113911us
I20260709 13:17:01.027704 10833 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.147276  8361 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:01.204836 10993 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:01.111536 10948 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.111334 10982 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.114574 10999 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:01.188710 11062 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:01.001335 10987 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.253543 10696 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.267059 11006 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:01.267395 10948 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.296896 10991 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.248165 10833 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.267956 10682 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:01.316471  8363 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:01.267079 10999 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:01.322160  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.335600 10991 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:01.269825 10982 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.376341 10682 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.379686 10991 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.331350 10724 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.304626 10696 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.397729 10991 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.408234 10696 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:01.411824 11010 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.000s
I20260709 13:17:01.397982 10724 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:01.447506  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 279959us
W20260709 13:17:01.501526  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.502348  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 244662us
I20260709 13:17:01.503396  8889 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:01.520514  8924 raft_consensus.cc:2410] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:17:01.529239  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.458601 10696 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:01.459345 10988 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.545696  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:01.519460 11062 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:01.551412  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:01.553596 11072 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.555861 11072 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.562891  8889 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:01.548415 11010 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:01.561276 10999 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:01.569829 11027 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:01.561156 10991 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:01.560439 10833 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:01.550529 10988 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.549295 10696 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.606230  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 555) took 1069 ms. Trace:
I20260709 13:17:01.571337 10987 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:01.612172  8924 rpcz_store.cc:276] 0709 13:17:00.537212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.558732 (+ 21520us) service_pool.cc:224] Handling call
0709 13:17:01.605943 (+1047211us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400174654. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:01.606151 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170887936}
I20260709 13:17:01.560235 11058 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:17:01.619169 11072 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:01.626158 10833 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.622715 10982 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:01.630887  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 186704us
I20260709 13:17:01.628396 11010 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:01.625041 10948 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:01.634093  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 71269.6us
I20260709 13:17:01.632493 10833 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.638163 10941 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:01.638830 10696 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:01.640564 10833 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:01.633775 10987 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:01.645383  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:01.649389  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:01.649995  8366 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:01.639863 10724 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:01.657290  8889 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:01.657914  8261 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:01.661269 10941 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:01.663116 10939 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.663314 10941 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.663645 10939 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.664143 10939 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.664883 10853 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:01.665424 10941 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:01.648319 10987 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.667021  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2060) took 1622 ms. Trace:
I20260709 13:17:01.667431  8367 rpcz_store.cc:276] 0709 13:17:00.044663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.044766 (+   103us) service_pool.cc:224] Handling call
0709 13:17:00.059125 (+ 14359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.151098 (+ 91973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.666759 (+1515661us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b5400366ad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:01.666938 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181220736}
I20260709 13:17:01.668002 10987 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:01.668489 10682 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.669065 10682 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.671314 10682 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:01.672588 11058 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:01.672719  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:01.673525  8367 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:01.656702 10980 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:01.674464  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:01.679616  8258 connection.cc:256] RPC call timeout handler was delayed by -1.1438684730001114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:17:01.681000  8258 connection.cc:256] RPC call timeout handler was delayed by -1.0835684730000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:17:01.683919  8258 connection.cc:256] RPC call timeout handler was delayed by -1.0070684730001176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 13:17:01.662102 10833 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:01.658649 11010 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:01.660785 10988 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:01.681779 11074 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.682073 10887 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.686264 10833 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.689332 11074 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:01.697731 11032 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.180s	user 0.005s	sys 0.000s
I20260709 13:17:01.681890 10941 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:01.678556 10980 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:01.699532  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.726874  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 69651.7us
I20260709 13:17:01.687731 10682 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.665434 10853 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.692058 11070 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.699268 11067 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.744481  8889 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:01.742497 10941 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.780467  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:01.784427  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 98628.6us
I20260709 13:17:01.787287  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:01.745999 10887 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.746832 10682 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.747498 11067 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.811288  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:01.794452  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:01.756255 10939 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.831218  8213 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.744199 11070 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:01.831992  8215 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:01.781767 11010 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:01.812923  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:01.833266  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 72824.5us
W20260709 13:17:01.831797  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 44590.3us
W20260709 13:17:01.911903 11080 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:17:01.902722 11013 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.588s	user 0.005s	sys 0.000s
W20260709 13:17:01.882194 11055 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.091s	user 0.014s	sys 0.030s
I20260709 13:17:01.859282  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:01.947767 10918 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.769449 10980 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:01.903973  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1476) took 1993 ms. Trace:
I20260709 13:17:01.860961  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:02.196195  8220 rpcz_store.cc:276] 0709 13:16:59.910785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.910957 (+   172us) service_pool.cc:224] Handling call
0709 13:16:59.920435 (+  9478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.949450 (+1029015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.903706 (+954256us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400093b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:01.903905 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364814720}
W20260709 13:17:02.158684  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 252952us
I20260709 13:17:02.159974 10833 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.159673 10399 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.833231 10991 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:02.160930 10993 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.161809 10992 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:02.162431 11085 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.162685 11067 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:02.163056  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.164502 11070 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:01.901037 11004 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:02.214164  8290 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:02.214823  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.215456  8294 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.216457  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.217072  8287 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.165570 10941 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:02.165848 10682 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.166740 10960 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:01.811324 11081 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:17:02.170372  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1322) took 1805 ms. Trace:
I20260709 13:17:02.171165  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:01.794682 11062 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:02.172235  8216 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:17:02.173111  8924 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:02.021302 10994 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.170943  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:02.174582  8213 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
W20260709 13:17:02.187466  8292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1367) took 2327 ms (client timeout 2177 ms). Trace:
I20260709 13:17:02.161829 10939 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.206257  8923 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:02.213059  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.214089  8295 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:02.221833  8214 rpcz_store.cc:276] 0709 13:17:00.365039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.365226 (+   187us) service_pool.cc:224] Handling call
0709 13:17:00.404576 (+ 39350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.885435 (+480859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.170122 (+1284687us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b54002f4c54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:02.170306 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092731136}
W20260709 13:17:02.223569  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 52559.2us
I20260709 13:17:02.169953 10713 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:17:02.203687 11077 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.253104  8292 rpcz_store.cc:269] 0709 13:16:59.846269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.846431 (+   162us) service_pool.cc:224] Handling call
0709 13:17:01.915957 (+2069526us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540032e1d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:02.173805 (+257848us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261194112}
I20260709 13:17:02.254885 10990 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:02.263690 10990 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:02.264624 10990 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.216786 11074 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:02.265947 11027 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:02.266479 11027 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.253217  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.268115 11073 raft_consensus.cc:3055] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:02.268261  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.268524 11073 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:02.269084 10713 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:02.249073 10960 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.209438 10993 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.268535  8290 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:02.269502 11073 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.270836 11073 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.271001  8290 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:02.271142 10960 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.271502 10993 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:02.205610 10992 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:02.272285 11074 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:02.272706 10992 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.272840 11074 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:02.273725 10992 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.274859 11074 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.212745 11085 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:02.276237  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.276921 11067 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:02.255677  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.256669  8211 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:02.283378  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.279088  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.257871  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.284487  8287 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.280671  8293 raft_consensus.cc:2410] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:02.261201  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.285451  8291 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.287175 11085 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:02.269533 10713 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:02.288422  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.289244 10978 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.253702 10994 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:02.304670  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 133069us
I20260709 13:17:02.305150  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.305409  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:02.305745  8288 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:02.300540  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:02.289256  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.303850  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2059) took 2259 ms. Trace:
I20260709 13:17:02.307226  8360 rpcz_store.cc:276] 0709 13:17:00.044363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.044807 (+   444us) service_pool.cc:224] Handling call
0709 13:17:00.045113 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.139945 (+ 94832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.139972 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.140010 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:00.140062 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.303572 (+2163510us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b5400355054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:02.303636 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.303783 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217666304}
I20260709 13:17:02.202510 11084 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:02.201973 10918 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.311947  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:02.259584 10599 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:02.214529 11004 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:02.222390  8919 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:02.219784 10833 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:17:02.309718 11085 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:02.333187  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.332984  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1369) took 2384 ms. Trace:
I20260709 13:17:02.334861  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:02.262838 10991 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.335777  8289 rpcz_store.cc:276] 0709 13:16:59.945187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.945714 (+   527us) service_pool.cc:224] Handling call
0709 13:16:59.946011 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.946368 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.946396 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.946802 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.111446 (+164644us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.111500 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.111595 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.902058 (+1790463us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:02.322395 (+420337us) raft_consensus.cc:1685] finished
0709 13:17:02.322424 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.329861 (+  7437us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11665,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7395,"spinlock_wait_cycles":458767104,"thread_start_us":133357,"threads_started":1,"wal-append.queue_time_us":227618}
I20260709 13:17:02.311447 11010 raft_consensus.cc:697] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:02.283766 11077 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.331524  8919 pending_rounds.cc:85] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 6
I20260709 13:17:02.327679 10960 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.347990  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.348227  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.348742  8367 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:02.348555 10960 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.349962  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.350466  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.350569  8367 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:02.351186  8364 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:02.351224 10960 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:02.341411  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.351954  8366 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:02.352444  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.353159  8364 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:02.356462 11082 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.356691  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:02.357441  8369 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.357096 11082 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.359606 11082 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.360483 11070 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:02.361114 11070 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.363644 11070 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.364800 11010 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.367936  8361 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:17:02.329495 11084 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:02.346194  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.371812  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.371968  8218 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:17:02.335930 10887 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:02.349074  8363 raft_consensus.cc:2410] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:02.219439 10399 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.374940  8294 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.345386  8919 pending_rounds.cc:107] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:02.383292 10997 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.382688  8919 raft_consensus.cc:2889] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.395282 10993 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.401562 10993 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.402547 10991 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:02.375344 11084 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.403632 10993 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:02.383630 11082 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.391748 11027 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.404498 11027 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:02.404855 11027 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.405172 11027 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.405467 10918 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:02.406692 10994 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:02.400635  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.386961 10399 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.416098  8369 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:02.388595 10997 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.415402 10960 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.448293 10993 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:02.448700 10998 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.449000 10993 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.449297 10998 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.450126 10997 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.451046 10993 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:02.451331 10998 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.451222 10960 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.416500 10399 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:02.465684  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 213542us
W20260709 13:17:02.473098  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 612165us
I20260709 13:17:02.479984  8924 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:02.495241  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.500514  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.474714  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:02.505303  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:02.506417  8332 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.791s (SENT) [suppressed 10 similar messages]
I20260709 13:17:02.507582  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:02.508208  8923 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:02.508306  8926 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.396404 11004 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.535199  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.536628  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:02.499004 10960 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.536273  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.539393  8364 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:17:02.541675  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:02.546769  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.547406  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:02.548172  8363 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.548481  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.549469  8364 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:02.530582 11088 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:02.529354 10991 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:02.552776  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:02.562466  8922 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.547895  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.563640  8362 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:02.555612  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.555859  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.564813  8369 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:02.501973 10399 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.538439 10994 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.517704 11092 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:17:02.533463 11090 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:02.561156  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.538236 10993 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:02.569576  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:02.554481 11083 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.288s	user 0.003s	sys 0.000s
I20260709 13:17:02.569583 11088 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:02.572767 10399 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:02.575062 11038 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.383s	user 0.005s	sys 0.000s
I20260709 13:17:02.577214  8922 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:02.579953 10992 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:02.582793 10853 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.586490 10998 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.589912  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.633771  8364 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.590225  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.590962  8361 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:02.591290  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:02.592383  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.592454  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.636590  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.636912  8367 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:02.591907  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.546782 11087 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:02.596808  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.551226 10960 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.608625  8363 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.609333  8926 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.554896 11004 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.567266  8919 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:02.569983 10991 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.567732 11077 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:02.587954 11082 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.631446  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.642395  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:02.643043  8287 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:02.622030 11092 consensus_queue.cc:1243] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:02.637632  8366 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.623431 10918 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:02.632647  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.646744  8922 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:02.601333 10994 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.610055 10993 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.643747  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.670753  8291 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:02.671768  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.645423  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.672355  8291 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:02.672646  8287 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:02.673485  8291 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:02.673722  8287 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:02.676784 11088 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.637676 10998 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.682619 10998 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.683589 10918 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.686367 10918 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:02.688824 10994 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:02.690109  8286 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
W20260709 13:17:02.675886  8116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46486 (request call id 267) took 24683 ms (client timeout 15000 ms). Trace:
I20260709 13:17:02.694336  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.696878  8369 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
W20260709 13:17:02.558727  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 53641.9us
I20260709 13:17:02.649107  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.699348  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.700126  8922 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:02.655791  8290 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:02.656674 11092 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:02.704308 10991 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:02.704952  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 455) took 2762 ms. Trace:
I20260709 13:17:02.664155 11084 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.705359  8920 rpcz_store.cc:276] 0709 13:16:59.942275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.956113 (+ 13838us) service_pool.cc:224] Handling call
0709 13:16:59.956473 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.956716 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.956755 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.957215 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.529891 (+572676us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.554744 (+ 24853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.569892 (+ 15148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.574461 (+2004569us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:02.695855 (+121394us) raft_consensus.cc:1685] finished
0709 13:17:02.696419 (+   564us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.704877 (+  8458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56265600,"thread_start_us":470072,"threads_started":1,"wal-append.queue_time_us":1232020}
I20260709 13:17:02.707165 11084 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:02.634001 10992 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.642132 11087 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:02.622515 11090 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.644893 10960 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:02.666787 10971 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:02.684998  8117 catalog_manager.cc:5697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.738004  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1624) took 1099 ms. Trace:
W20260709 13:17:02.734601  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 422674us
W20260709 13:17:02.735296  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.739815  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 407582us
I20260709 13:17:02.738552  8365 rpcz_store.cc:276] 0709 13:17:01.638680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.638836 (+   156us) service_pool.cc:224] Handling call
0709 13:17:01.639154 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.667062 (+ 27908us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:01.667387 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.749394 (+ 82007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.749451 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:01.749529 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.532193 (+782664us) spinlock_profiling.cc:243] Waited 951 us on lock 0x7b180041b120. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa2f22a6 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419
0709 13:17:02.737701 (+205508us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b54003674d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:02.737770 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.737930 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":578,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":89,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6951,"spinlock_wait_cycles":65838208,"thread_start_us":81551,"threads_started":1,"wal-append.queue_time_us":101954}
I20260709 13:17:02.740839  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:02.741940  8366 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:02.746822  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:02.747604  8367 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:02.751471  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:02.755832  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.756377  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:02.757126  8217 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:02.758306  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.758373  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:02.759469  8213 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:02.738394  8117 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 3 to 5, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 5 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:02.763157  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:02.763844  8213 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:17:02.758338  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:02.773088  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:02.774293  8216 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.776310  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:02.782014  8922 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.784034  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:02.784471  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:02.784863  8218 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.785434  8214 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:02.783658  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:02.786245  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:02.786526  8213 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:02.740828 10971 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:02.788818  8294 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:02.773116  8261 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:02.778934  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:02.736248 10993 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:02.781421  8220 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:17:02.761051 11074 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:02.794628  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:02.795341  8214 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:02.778980 11077 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:02.803773  8218 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:02.806316  8213 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:02.814201  8922 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:02.816205  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:02.816802  8214 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:02.794050  8117 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 2 to 6, term changed from 4 to 6, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:02.693327  8116 rpcz_store.cc:269] 0709 13:16:37.992408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.992809 (+   401us) service_pool.cc:224] Handling call
0709 13:17:02.675746 (+24682937us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:57.354528 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:57.462997 (+108469us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:57.463058 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:16:57.463091 (+    33us) tablet.cc:662] Decoding operations
0709 13:16:57.465443 (+  2352us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:57.465511 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:57.465536 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:16:57.466748 (+  1212us) tablet.cc:701] Row locks acquired
0709 13:16:57.466798 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:16:57.466968 (+   170us) write_op.cc:270] Start()
0709 13:16:57.467138 (+   170us) write_op.cc:276] Timestamp: P: 1783603017466898 usec, L: 0
0709 13:16:57.467165 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:16:57.468108 (+   943us) log.cc:844] Serialized 5864 byte log entry
0709 13:16:57.843523 (+375415us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b1800220180. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:16:58.254311 (+410788us) op_driver.cc:464] REPLICATION: finished
0709 13:16:58.757401 (+503090us) write_op.cc:301] APPLY: starting
0709 13:16:58.757521 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:58.757945 (+   424us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:58.757986 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:59.100415 (+342429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:59.100725 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:16:59.100776 (+    51us) write_op.cc:312] APPLY: finished
0709 13:16:59.101191 (+   415us) log.cc:844] Serialized 107 byte log entry
0709 13:16:59.101424 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:59.101586 (+   162us) write_op.cc:454] Released schema lock
0709 13:16:59.101650 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:59.209900 (+108250us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b1800220180. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa324522 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:16:59.210003 (+   103us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:59.210029 (+    26us) write_op.cc:454] Released schema lock
0709 13:16:59.296249 (+ 86220us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b1800220180. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
Metrics: {"mutex_wait_us":2361713,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":502758,"apply.run_cpu_time_us":6089,"apply.run_wall_time_us":344626,"num_ops":15,"prepare.queue_time_us":309207,"prepare.run_cpu_time_us":63562,"prepare.run_wall_time_us":281515,"raft.queue_time_us":396171,"raft.run_cpu_time_us":25492,"raft.run_wall_time_us":316057,"replication_time_us":786976,"spinlock_wait_cycles":74544000,"thread_start_us":798853,"threads_started":4,"wal-append.queue_time_us":169682,"wal-append.run_cpu_time_us":49516,"wal-append.run_wall_time_us":2247725}]]}
W20260709 13:17:02.928489  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.815063 11077 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.188289 11077 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.189316 11087 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:03.191431  8217 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
W20260709 13:17:03.039551  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.004s	sys 0.040s
W20260709 13:17:03.192863  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.010s	sys 0.045s
I20260709 13:17:02.824679  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.822710  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:03.193495  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 772253us
W20260709 13:17:03.193701  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 371017us
I20260709 13:17:03.194854  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:02.953595  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 447163us
W20260709 13:17:02.822887  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.850661  8117 catalog_manager.cc:5697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:02.841645  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.198925  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.199082  8216 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:03.164387  8218 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:02.961228  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.173820  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:03.206485  8220 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.825091  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.207161  8926 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:02.823405  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.210558  8261 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:02.964612  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.215008  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:03.215359  8213 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:03.215747  8216 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.219122  8214 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:03.183182  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:03.222203  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.222508  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.222765  8219 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:17:03.223577  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:03.223569  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.224431  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.224839  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.225546  8212 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:03.226505  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.226975  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.221935  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:02.811369 10993 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.227638  8214 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:03.224853  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.228426  8217 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:03.232106  8117 catalog_manager.cc:5697] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 4 to 5, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:03.244732  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.245577  8218 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:02.876932  8920 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:02.818101 11074 raft_consensus.cc:697] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:03.192152  8919 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:17:03.249150  8258 connection.cc:256] RPC call timeout handler was delayed by -1.0789993209998556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 13:17:03.259841  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:02.933861 11058 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.963487 10998 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:03.244532  8117 catalog_manager.cc:5697] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 6, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 6 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.934208 11093 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.823098 11082 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:02.924469 11010 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.258235  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.251556  8220 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:03.069094 11092 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.241117 10980 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.267359  8216 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
W20260709 13:17:03.268533  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.823001 10932 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.437s
I20260709 13:17:03.225926 10853 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:02.893512 11027 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.451068  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.243209 10993 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.437716  8117 catalog_manager.cc:5697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.464285  8220 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:03.247994 11094 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:03.247675 11098 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:02.967065 10971 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.481178  8926 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:03.267706 11082 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:03.479620  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.480496  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.484504  8213 raft_consensus.cc:2410] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:03.262337 10992 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:03.487799  8924 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:03.269637 11095 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:03.489535  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 240869us
I20260709 13:17:03.409952 10960 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.575603  8117 catalog_manager.cc:5697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 6, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 6 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.491832  8219 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:03.587185  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 343028us
I20260709 13:17:03.451100 10853 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:03.516533 11088 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.011s	sys 0.045s
I20260709 13:17:03.595459  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.596261  8216 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:03.281400 11058 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.408131  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:03.487769 11082 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.602662  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.611094  8213 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:03.604637  8117 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 4 to 5, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:03.592861  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.612146  8926 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:03.608657  8216 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:17:03.609189  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 349277us
W20260709 13:17:03.595183 11088 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.012s	sys 0.063s
I20260709 13:17:03.620148  8117 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:03.515538 11098 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:03.601464 10853 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.266863 10939 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.336s
I20260709 13:17:03.307556 11092 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.292790 11093 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.624792  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:03.633426  8922 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:03.281774 10998 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:03.635800  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2076) took 1056 ms. Trace:
I20260709 13:17:03.597692  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.642561  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.299935 11010 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:03.645800  8290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1378) took 1307 ms (client timeout 1566 ms). Trace:
I20260709 13:17:03.632951  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.647074 11114 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:03.667397  8290 rpcz_store.cc:269] 0709 13:17:02.328977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.329083 (+   106us) service_pool.cc:224] Handling call
0709 13:17:03.636225 (+1307142us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400389354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:03.636337 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632345472}
I20260709 13:17:03.648242  8369 rpcz_store.cc:276] 0709 13:17:02.569188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.569331 (+   143us) service_pool.cc:224] Handling call
0709 13:17:03.625710 (+1056379us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b540018fe54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:03.625820 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216029440}
I20260709 13:17:03.666718  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.648146  8219 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:03.594285 11095 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.650199  8261 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:03.675578  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.696318  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 46224.2us
I20260709 13:17:03.663491 11027 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:03.677397 11093 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.678917  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.680184 11114 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.517581 11074 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:03.662294 11116 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:03.682510 10998 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.684299 11058 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:03.688575 11004 consensus_meta.cc:287] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.044s	user 0.009s	sys 0.002s
W20260709 13:17:03.733284  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 116286us
I20260709 13:17:03.690507 11010 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:17:03.694407 10867 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.694346 11105 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:03.736754  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.649619  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:03.702062 11126 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:03.717842  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 100050us
I20260709 13:17:03.745594  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:03.721494  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:03.746555  8368 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:17:03.680868  8920 raft_consensus.cc:2410] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:17:03.724869  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 136102us
I20260709 13:17:03.748577  8928 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:17:03.748950  8928 pending_rounds.cc:85] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 7
I20260709 13:17:03.749154  8928 pending_rounds.cc:107] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:17:03.749408  8928 raft_consensus.cc:2889] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.749433  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:03.749912  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:03.750087  8368 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
W20260709 13:17:03.701287 11109 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
W20260709 13:17:03.725461  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 151769us
W20260709 13:17:03.648828  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.726068  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:03.728534 11121 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:03.725303 11099 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.519s	user 0.000s	sys 0.001s
I20260709 13:17:03.739251  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:03.728546 11093 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:03.651678  8117 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 3, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 3 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.742862  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:03.729669  8219 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:03.480980 11094 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:03.723942  8921 raft_consensus.cc:2376] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5. Re-sending same reply.
I20260709 13:17:03.786212 11092 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.779922  8362 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:03.782075  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:03.783646 11093 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.740362 10867 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:03.757079 11070 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:17:03.794471  8258 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:03.784598  8360 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:03.785756 11094 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:03.758694  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:03.736141 11117 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.740603 11084 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:03.790005 11085 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.799853  8368 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:03.787248 10932 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:03.789383 11116 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:17:03.787626 11077 consensus_meta.cc:287] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
I20260709 13:17:03.884634 11077 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:03.886335  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.887270 11077 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.759575 11105 consensus_queue.cc:1243] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:03.778264 11004 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:03.888969  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.852666 11085 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.859800 11090 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.844420 11095 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.871170  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1647) took 1109 ms. Trace:
I20260709 13:17:03.844729 10958 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:03.838346 11114 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.851977 11128 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.836570 11084 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:03.852583  8117 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 4 to 5, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:03.797622 11096 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:17:03.910053  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.001s	sys 0.013s
I20260709 13:17:03.797624 11107 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:03.846436 11094 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:03.793313 10960 consensus_queue.cc:1059] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:03.871752 11093 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.788568 11121 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.800711 11081 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.837278 10942 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.798962 10867 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.783228 10599 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.890926  8365 rpcz_store.cc:276] 0709 13:17:02.761346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.762827 (+  1481us) service_pool.cc:224] Handling call
0709 13:17:03.625908 (+863081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.626098 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.626123 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:03.626163 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:03.626194 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.626246 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.871000 (+244754us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b540018fe50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:03.871107 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948109568}
I20260709 13:17:03.904124 10958 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:03.896574  8366 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:03.887264  8925 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:03.803949 11117 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:03.911212  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.002s	sys 0.013s
I20260709 13:17:03.912988  8117 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:03.888954 10932 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:03.916733  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 122323us
W20260709 13:17:03.918625  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 168757us
I20260709 13:17:03.942230  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:03.943100  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:03.915719  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.755591 11058 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.933698  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 568) took 1109 ms. Trace:
I20260709 13:17:03.933955  8923 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:03.945910  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:03.945616  8922 rpcz_store.cc:276] 0709 13:17:02.823866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.824395 (+   529us) service_pool.cc:224] Handling call
0709 13:17:03.933518 (+1109123us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002c1fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:03.933641 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1011431296}
I20260709 13:17:03.944199  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:03.945151  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:03.938695  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 742809us
I20260709 13:17:03.894961 11004 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.920778 11081 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.920583 10993 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:03.946560  8286 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.952581  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:03.953377  8292 raft_consensus.cc:2410] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:03.921326 11121 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.755218 11126 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:03.949051  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:03.950598  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:03.955637  8293 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.955791  8290 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:03.955904  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:03.956380  8366 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:03.951771  8295 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:17:03.951700  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:03.948388  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:03.939625  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 152751us
I20260709 13:17:03.936617 10958 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.945333 10932 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.959218  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:04.031694  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 57303.8us
I20260709 13:17:03.957209  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:03.921029 11094 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.060345  8117 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:03.949357 11122 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.066846  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.067612  8290 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:04.069775  8288 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:17:04.070960 11136 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:17:04.071235  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.072324  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:04.073000  8295 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.076915 11085 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:03.912694 11128 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.069133 10563 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.103435 10853 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.104017 10563 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.104856 10563 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.105048 11128 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.105892 10853 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:03.937450 10599 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.109107 10599 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:04.109659 10599 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.110004 10599 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.110352 10599 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:04.110616  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.042948  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 94616us
W20260709 13:17:04.035418  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 78262.3us
I20260709 13:17:03.755455 11098 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.128165  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.129210 11138 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:04.130291  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.130872  8290 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
W20260709 13:17:04.132346  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.113235  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.090538  8117 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 3 to 5, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:03.953694 11081 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.095252  8295 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
W20260709 13:17:04.123247 11134 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:17:04.033638 11130 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.133663  8286 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:04.133874  8293 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:03.954628 10992 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.137202  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:04.155633  8214 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:04.138999  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:04.155825  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:04.156390  8293 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.136675  8117 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 4 to 6, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 6 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:04.140529  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 181842us
I20260709 13:17:04.141009  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:04.158208  8922 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:04.158334  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.159005  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:04.143991  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.144366  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.077342 11117 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.160764  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.066294 11122 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.066414 10682 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.031380 10993 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:17:04.169414 10682 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:04.151044  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:04.176472  8220 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 4.
I20260709 13:17:04.151742  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:04.176684 10682 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.150074  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:04.153684 11126 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:04.154422  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:04.127518 10942 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.159286  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:04.159602  8214 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:04.159050  8286 raft_consensus.cc:2393] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:04.066015 11132 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:17:04.160823  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:03.950872 11058 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:04.167743  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.177363  8217 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:04.228404  8369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c835fd22b7643a981b446089ad74066"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:17:04.232089 10563 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.231009 11085 consensus_queue.cc:1059] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:17:04.233573 11084 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.167629  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:04.234207 10563 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:04.234431  8922 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:04.162559  8212 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:04.232450  8369 raft_consensus.cc:606] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:04.165009  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:04.160344  8186 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.175585  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.153270  8219 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:04.236320  8365 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.238138 11094 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:04.238508 11058 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:04.239636 11004 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:04.242410 11082 consensus_meta.cc:287] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.000s
I20260709 13:17:04.242872 11082 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:04.163589  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.244349  8292 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:04.233636 11085 raft_consensus.cc:3055] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:04.245095 11085 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:04.229290 11102 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.781s	user 0.003s	sys 0.000s
I20260709 13:17:04.245946 11085 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.247151 11085 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.248858 10682 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.250430 10867 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.255028  8369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:17:04.255748  8369 raft_consensus.cc:606] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:04.256201  8369 raft_consensus.cc:614] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:04.257547 10867 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:04.259268 10998 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:04.260319  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 100069us
I20260709 13:17:04.261343 10998 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:04.260870 11107 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:04.263361 11107 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.154186 11121 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.262820  8186 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.264494 10997 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.264612  8186 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.264899 10997 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.265261 10997 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.265405 11121 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.263723 11107 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.262411 10998 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.269755 11140 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.270164 11140 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.261519 10971 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.270478 11140 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.261425  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1328) took 1506 ms. Trace:
I20260709 13:17:04.272805 10713 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.273756 10713 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.274538  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:04.227612 10932 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.277226 10932 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:04.280377  8186 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.281363 11118 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.281536  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 469) took 1023 ms. Trace:
I20260709 13:17:04.281761 11118 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:04.282243 11118 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.281960  8921 rpcz_store.cc:276] 0709 13:17:03.257780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.259482 (+  1702us) service_pool.cc:224] Handling call
0709 13:17:04.281350 (+1021868us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b5400214154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:04.281479 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226285440}
I20260709 13:17:04.282864 10599 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.284215 11115 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.272192  8211 rpcz_store.cc:276] 0709 13:17:02.754986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.760960 (+  5974us) service_pool.cc:224] Handling call
0709 13:17:02.818699 (+ 57739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.693966 (+875267us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18003dd860. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f32012e558f 00007f31fa324571 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd
0709 13:17:03.873847 (+179881us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b18003dd860. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fcfb94bc 00007f31fa30748b 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa321455 00007f31fd409060 00007f31fd409bfb 00007f31fd41464b
0709 13:17:03.874020 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.874064 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:03.874761 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 13:17:03.995831 (+121070us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:04.036758 (+ 40927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.079045 (+ 42287us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.261205 (+182160us) raft_consensus.cc:1685] finished
0709 13:17:04.261232 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.261366 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4848,"raft.queue_time_us":306427,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":14975,"spinlock_wait_cycles":41939072,"thread_start_us":367301,"threads_started":2,"wal-append.queue_time_us":359249}
I20260709 13:17:04.270525  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:04.284844 11115 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.285605  8927 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.286790 10979 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.287495 11115 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.289608 10960 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:04.291442 11140 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.260565  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:04.301254  8369 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:17:04.282325  8186 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.325089  8186 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.330900  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:04.334739  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.174474  8293 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
W20260709 13:17:04.208127  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.316469  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.353647  8261 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:04.195528  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:04.354812  8213 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:04.354892  8365 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:04.356001  8368 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.355405  8117 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 3 to 4, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 4 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:04.356074  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:04.355417  8186 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.360558  8927 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:04.363688 11140 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.364627  8215 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:04.307298  8289 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:04.372301  8186 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.175531  8364 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:17:04.361065  8927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 464) took 1510 ms (client timeout 1568 ms). Trace:
W20260709 13:17:04.375882  8927 rpcz_store.cc:269] 0709 13:17:02.850722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.851018 (+   296us) service_pool.cc:224] Handling call
0709 13:17:04.270373 (+1419355us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:04.361013 (+ 90640us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5289216}
I20260709 13:17:04.155195 11130 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.378917  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 644) took 1878 ms. Trace:
I20260709 13:17:04.368613 10989 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.379971  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.161120 10992 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.381699  8924 rpcz_store.cc:276] 0709 13:17:02.500068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.500210 (+   142us) service_pool.cc:224] Handling call
0709 13:17:04.378635 (+1878425us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54002c29d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:04.378814 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254373120}
I20260709 13:17:04.365103 10980 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.384171  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:04.384888  8922 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:04.161316 11127 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.390026  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:04.169396 11122 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.358714 10563 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.364744 10941 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.406746 10941 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:04.406932 10599 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:04.407212 10941 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.407949  8212 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:04.408524  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:04.410878  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1337) took 1618 ms (client timeout 1603 ms). Trace:
W20260709 13:17:04.411281  8215 rpcz_store.cc:269] 0709 13:17:02.792841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.793075 (+   234us) service_pool.cc:224] Handling call
0709 13:17:03.959078 (+1166003us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:04.410717 (+451639us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400035cd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:04.410815 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768025344}
I20260709 13:17:04.412984  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:04.365489 10988 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.413940 10988 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:04.414388 10988 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:04.414917  8258 connection.cc:256] RPC call timeout handler was delayed by -1.3584671539999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:17:04.415292  8258 connection.cc:256] RPC call timeout handler was delayed by -1.3089671539999017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 13:17:04.415549  8258 connection.cc:256] RPC call timeout handler was delayed by -1.3080671539999003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260709 13:17:04.393231  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:04.394606  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:04.417659 11082 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:04.418377  8258 connection.cc:256] RPC call timeout handler was delayed by -1.0812671539999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260709 13:17:04.394325  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:04.367902 10932 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:04.399407  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:04.401525  8368 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:04.420950  8927 raft_consensus.cc:2410] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:04.393294 10979 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.421221  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:04.392917 10980 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.405777 11126 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:04.393236 11107 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.405773  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:04.441046  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 329111us
I20260709 13:17:04.416452  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:04.420255  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:04.392843 10989 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.421756  8368 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.392544 10992 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.387820 11130 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.381170 11140 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.428215  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 465) took 1459 ms. Trace:
I20260709 13:17:04.428867  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.429316 10979 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:04.430697  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.451962  8368 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:04.413537  8217 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.431062 10998 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.443671  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:04.442449  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:04.443506  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:04.374712 10960 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:17:04.404706 11127 raft_consensus.cc:697] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:04.426613 11073 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.479103  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.448104  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:04.467869  8923 rpcz_store.cc:276] 0709 13:17:02.968636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.968922 (+   286us) service_pool.cc:224] Handling call
0709 13:17:03.884847 (+915925us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:17:03.933642 (+ 48795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.946107 (+ 12465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.428018 (+481911us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54002c1fd0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:04.428161 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119148672}
I20260709 13:17:04.445935  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:04.446583  8369 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:04.472365  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:04.481249  8922 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.482254  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:04.419679 10713 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.475147  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:04.475868  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:04.477593  8361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.022s	sys 0.022s
I20260709 13:17:04.469204 10979 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.479667  8294 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:04.444921 11132 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.484668  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:04.501353  8361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.025s	sys 0.022s
I20260709 13:17:04.444756 10599 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.470214 11140 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.404381 10958 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.489848  8217 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:04.503249  8261 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:04.487031  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:04.501868  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.504401  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:04.476967 11112 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.478650 11097 raft_consensus.cc:2764] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:04.486135 11111 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:04.501384  8921 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:04.507179  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:04.516168  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 468) took 1274 ms. Trace:
I20260709 13:17:04.502749 11004 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.547194  8295 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:04.502642 11027 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:04.546959  8928 rpcz_store.cc:276] 0709 13:17:03.241471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.241590 (+   119us) service_pool.cc:224] Handling call
0709 13:17:03.261674 (+ 20084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.749931 (+488257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.515871 (+765940us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540066ec54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:04.516101 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103645568}
I20260709 13:17:04.553220  8295 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:04.510164 11121 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.445608 10932 raft_consensus.cc:697] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:04.500502 10867 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:04.445374 11126 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.501482 11131 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:04.546236  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:04.521001  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.525249 10942 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.485595 11073 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.501008 11094 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:04.547458 11072 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.567094 10867 raft_consensus.cc:2764] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:04.550119 10996 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.549572 11004 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.570662 11127 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.505125 10713 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.529592 10988 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.565433 11027 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:04.508283 11082 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:04.507488 11140 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.622848  8288 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:17:04.509146 10599 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.546833 11152 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:17:04.513285 11137 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:04.624316  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 78169.7us
I20260709 13:17:04.625866  8293 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:04.531234  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:04.524057  8922 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:04.592229 11072 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.592753 10942 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:04.593756 10563 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:04.609515 10996 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.593242 11149 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.656858  8365 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:17:04.623039 11004 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.505309 11132 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.645280  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:04.649909  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 118764us
I20260709 13:17:04.635196 10991 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:17:04.648173  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 146384us
I20260709 13:17:04.645249 10990 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.651552 10682 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.661829  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:04.653789 11162 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.646747 11137 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:04.649153 11072 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.647599 11082 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:04.665946  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:04.678516  8361 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:04.656394 10996 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.671067 11165 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:04.651643 11135 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:04.659149 11149 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.676749  8364 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:04.675993  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:04.677843 10563 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.633947 10932 consensus_queue.cc:237] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.669868 11107 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:04.674101 11164 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:04.684212 10997 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.676175 11137 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.715196  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.693295 11149 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.688335 10942 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:04.681872 11155 consensus_queue.cc:1059] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:17:04.689638 11161 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:17:04.687459 10958 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:04.697381  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.705248  8287 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:04.674477 10992 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.679629 11070 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:04.686617 11105 raft_consensus.cc:3055] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:04.687268  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:04.678611 11027 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.699759 10979 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.703989  8361 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:04.676463 11162 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:04.851351  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.761116  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:04.736789  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:17:04.912580  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:04.885829  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:05.089613  8293 raft_consensus.cc:606] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:05.080814  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.941970  8928 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:17:04.876499  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:05.092623  8369 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:05.001700  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.777732  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:04.731712  8219 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:04.737056  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.814616  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:04.842036  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 151907us
I20260709 13:17:05.091300  8363 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:04.720131  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:04.947021 11081 consensus_meta.cc:287] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.783s	user 0.010s	sys 0.000s
I20260709 13:17:04.729130 10993 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:05.106985  8216 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.101830  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 386) took 1154 ms. Trace:
W20260709 13:17:05.084947 11158 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:17:04.728120 11093 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.744740 11126 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.085762 11121 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.725911 10941 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:04.744263 11153 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:17:05.140419  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:05.141199  8295 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:05.141795  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.142220  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:05.142887 11111 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:05.143059  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.143731 11111 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.144073  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:05.144629  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.146997  8186 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:04.726295 10991 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:05.144600 11111 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.148612  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.149258 11111 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.102216  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.149219 10996 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.149433  8369 raft_consensus.cc:2410] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:17:05.150568  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.110510  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.045367 11131 raft_consensus.cc:3055] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:04.940886 10971 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.111523  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:04.907882 11090 raft_consensus.cc:3055] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:05.152108  8361 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:05.152220 11090 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.153203 11090 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.154165 11090 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.716782 11157 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.420s
I20260709 13:17:04.738062 10599 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:04.949824 11132 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:05.151417 11131 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:05.156185 11131 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.151675 10971 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.107064 10993 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:05.160455 10993 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.161777 10993 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.917620 10980 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.166152 11157 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:05.166819 11157 raft_consensus.cc:697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:04.732753 10997 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.747807 11073 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.070567 11070 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:05.168253  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.168493 11070 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.108721  8287 rpcz_store.cc:276] 0709 13:17:03.947724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.948091 (+   367us) service_pool.cc:224] Handling call
0709 13:17:04.704935 (+756844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.071028 (+366093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.101609 (+ 30581us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b5400426b50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:05.101761 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739838720}
W20260709 13:17:04.747080 11147 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:17:04.910122 11098 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.169991 11098 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.120105  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:05.119995  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:04.734545 10853 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:05.172346  8294 raft_consensus.cc:2410] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:05.172266 10853 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:04.738409 11156 log.cc:927] Time spent T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:05.173594  8292 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:05.173712  8287 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:05.071450 11105 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.174567  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1398) took 1032 ms. Trace:
I20260709 13:17:05.174680  8289 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.174983 11105 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.175990 11105 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:05.113983 11164 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:05.085606 10989 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:04.911536 11118 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.629s	user 0.001s	sys 0.007s
I20260709 13:17:05.103828 11155 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.104156 10867 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.133898  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:05.103606 10960 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.915726 11004 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.213526  8288 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:04.700630 11135 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.140527  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:05.220708  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 209437us
I20260709 13:17:05.142166  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:05.140427  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.222676  8363 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:04.739034 11154 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:05.106606 11107 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.105844  8183 connection.cc:256] RPC call timeout handler was delayed by -1.6519228590000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:17:05.149068 10991 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:05.229048  8183 connection.cc:256] RPC call timeout handler was delayed by -1.4521228589999282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:17:05.229434  8183 connection.cc:256] RPC call timeout handler was delayed by -1.3072228589999213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 13:17:05.229779  8183 connection.cc:256] RPC call timeout handler was delayed by -1.1776228589999391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 13:17:05.151410 10996 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.746127 10988 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:04.916785 10713 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:05.180397 11150 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:05.128418 11093 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.174934  8292 rpcz_store.cc:276] 0709 13:17:04.142005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.378157 (+236152us) service_pool.cc:224] Handling call
0709 13:17:05.174375 (+796218us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400127fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:05.174517 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816285056}
I20260709 13:17:05.147167 11121 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:05.187914  8361 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:05.167920 11157 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.193849  8366 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:05.167107  8369 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:05.077766  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 391526us
I20260709 13:17:05.262130  8258 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.190233 10960 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:04.906888 11168 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.262s
I20260709 13:17:05.233004  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:05.235260 10989 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:05.224261 10867 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.272181 10992 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:05.273325 10960 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.275683 10713 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:05.276132 10713 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:05.276513 10713 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:05.277642 11140 consensus_meta.cc:287] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.005s
I20260709 13:17:05.278069 11140 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.279793 11121 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.267498 10971 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.287175  8922 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
W20260709 13:17:05.287362  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.287611  8922 pending_rounds.cc:85] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 4
I20260709 13:17:05.287890  8922 pending_rounds.cc:107] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:17:05.288168  8922 raft_consensus.cc:2889] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:05.259837 10988 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:17:05.288182 11130 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.811s	user 0.013s	sys 0.000s
W20260709 13:17:05.238040 10998 consensus_meta.cc:287] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.002s
I20260709 13:17:05.189817 11155 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.233227  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.189684 11118 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.296253 10867 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.297010  8218 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:05.297288 10941 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.243698  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.298470  8295 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:05.239277 11107 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:04.728276 11082 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.301354 11107 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.301586 11175 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:05.302589 10682 consensus_meta.cc:287] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.001s
I20260709 13:17:05.303059 10682 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.303495  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.304513  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.305234  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.306633  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:05.249212 11137 consensus_meta.cc:287] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.507s	user 0.004s	sys 0.004s
W20260709 13:17:05.249656 10990 consensus_meta.cc:287] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.579s	user 0.018s	sys 0.003s
I20260709 13:17:05.243716  8288 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:17:05.256397  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.259328  8292 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.260290  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.257609  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:05.260773  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.308876  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.311692  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:05.311702  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 51476.8us
I20260709 13:17:05.266160  8287 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:05.189636 11164 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.317462  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:05.318048  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:05.269454  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.289645 11130 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.113638 11081 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.245710 11004 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.246454 10979 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.306664  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.263192  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.311968  8369 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
W20260709 13:17:05.319640  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 50262.8us
I20260709 13:17:05.398823  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.321614  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:05.400738  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 79247.2us
W20260709 13:17:05.359230 11122 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.927s	user 0.016s	sys 0.003s
W20260709 13:17:05.374954  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 56965.3us
I20260709 13:17:05.365440 10958 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.299903 11098 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.361836  8367 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:17:05.308353 10992 raft_consensus.cc:2764] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:05.416435  8366 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:05.304658 11175 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.348145 10941 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.307550 11140 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.373625  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:05.316284 11107 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:05.323644 11168 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.351362  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.402277  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.414384 10932 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.311539 11137 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.410359  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.375705 11161 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.417701  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:05.365728 10853 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.411983  8919 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:05.417384  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.408416 11162 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.418762 11004 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.449190  8364 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:05.414616 10867 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:05.449836  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 48250us
W20260709 13:17:05.477792  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 75572us
I20260709 13:17:05.511735  8369 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:05.506012  8363 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:05.414510 11084 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:17:05.482215 11168 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:05.507196 10833 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.511476  8366 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:05.512068  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:05.404711 11170 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:05.418156 11122 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.419400 11132 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:17:05.526907  8213 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:05.448748 11172 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:17:05.512194  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:05.511552 10867 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.516367  8291 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:05.540516  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.415068 10988 consensus_queue.cc:1059] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:17:05.476795 10941 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:17:05.510519  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 92887us
I20260709 13:17:05.544119  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:05.484501 10932 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:05.505048 11107 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.516536 10992 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:05.514582  8360 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:05.528803  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.550359  8217 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:17:05.542356 10867 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.551280  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.512535 11091 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.552121 11091 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.549839 10941 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.556434 10941 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.557488 11131 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.559237 10992 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:05.560213 10992 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.561841  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.563222  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.563396 11162 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.529594  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.564273  8214 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:05.565219  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.529963  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.566304  8212 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:05.533327  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.567305  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.515762  8364 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:05.533845 10853 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.534293 11098 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.519881 11168 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.536408  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.594918  8261 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:05.537038 11081 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.537391 11122 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:05.600370  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.605811  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:05.606513  8368 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.537737 11093 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:05.537891  8366 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:05.538113  8218 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:05.611413  8927 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:05.612357  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:05.612866  8923 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:05.527046  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:05.531718  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.538785  8362 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:05.614341  8216 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:05.541347  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.527055 11111 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.528740 11130 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:05.542610 10713 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.548307  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.548794 10988 raft_consensus.cc:3055] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:05.549180  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:05.626241  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:05.626971  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 77862.5us
I20260709 13:17:05.569296  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:05.629433  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 60215.2us
I20260709 13:17:05.630303  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.571542  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.573161  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2097) took 1186 ms. Trace:
I20260709 13:17:05.631616  8291 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.632424  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.577476  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:05.643815  8924 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:05.579905  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:05.645601  8920 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:05.580693  8889 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:05.646561  8368 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:17:05.646697  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 66081.6us
I20260709 13:17:05.581434  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.582187  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.648000  8363 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:05.583137  8183 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.598078  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:05.514648 11004 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:05.601411  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.602187  8295 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.602834  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:05.657757  8292 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:05.609396  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.614558  8215 raft_consensus.cc:2393] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:05.614887  8211 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:05.546972 11155 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.549948 10932 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.664192  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.538547 10960 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:17:05.600982 11105 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.631558  8367 rpcz_store.cc:276] 0709 13:17:04.386981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.429149 (+ 42168us) service_pool.cc:224] Handling call
0709 13:17:04.429445 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.415752 (+986307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.572938 (+157186us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b540010d454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:05.573109 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116260096}
I20260709 13:17:05.628228  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:05.649088  8287 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
W20260709 13:17:05.675768  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 47643.3us
I20260709 13:17:05.677805  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:05.659904  8258 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.610435 11096 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.662431  8217 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:05.680146  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:05.618265 11073 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.596902 11082 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.620968 11111 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.678184  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.618494 11162 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:05.599593 10971 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:17:05.679446  8258 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.601830 10989 consensus_queue.cc:1059] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:17:05.612414 10942 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 13:17:05.662817  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 79753.6us
I20260709 13:17:05.731241 10942 raft_consensus.cc:3055] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:05.731670  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.733191  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.733881 10996 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:05.681771  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.734508 10996 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.684703  8928 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:05.734879  8295 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.626307 10988 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.657150 11140 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:05.738816 11140 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.739146 10988 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.739512 11090 consensus_queue.cc:1059] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:05.684077 11105 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.740648 10979 raft_consensus.cc:3055] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:05.664357 11093 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:05.741052 10979 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.741192 11093 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:05.741489  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 62104.8us
I20260709 13:17:05.741681 11093 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:05.741864 10979 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:05.742326  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.742260  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.731801 10942 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:05.743253  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.743474  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.744208 11085 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.688109  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:05.744848 10988 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:05.745175  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 57152.4us
I20260709 13:17:05.746795  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:05.747273 10979 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.684639 11073 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.748314 11073 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.749341 10960 raft_consensus.cc:3055] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:05.749627 11131 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:05.749734 10960 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.750771 10997 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.750566 10960 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.751699 10960 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.752022  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.752445  8361 raft_consensus.cc:2410] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:05.752915 11090 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:05.682082 11127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.036s	sys 0.048s
W20260709 13:17:05.753842 11127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.036s	sys 0.049s
I20260709 13:17:05.754393 11127 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:05.754585  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.755336 10996 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.674737 11081 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.756222 11081 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:05.756352  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.756656 11081 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.755352 11162 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.757129 10996 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.760229 11164 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:05.760627 11164 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:05.760972 11164 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.761651  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:05.762082 10996 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:05.759900 11190 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:05.763098 10997 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:05.763441 10997 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.675812 10998 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.764250 10997 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.698043 11084 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:05.766034  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1668) took 1090 ms. Trace:
I20260709 13:17:05.766232  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.766399  8365 rpcz_store.cc:276] 0709 13:17:04.675633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.675749 (+   116us) service_pool.cc:224] Handling call
0709 13:17:05.765873 (+1090124us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54000a3a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:05.765983 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158783232}
I20260709 13:17:05.767144 11084 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.744920 11085 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.767881 10997 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.741973 11105 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.769641  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.693845  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2098) took 1306 ms. Trace:
W20260709 13:17:05.706139  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.674546 11173 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:17:05.640430 10833 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:17:05.712409 11137 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.685457 11107 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.714057 11004 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:05.714156 11070 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.003s
I20260709 13:17:05.692559 11161 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:05.778136 11105 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:05.719251 11072 consensus_meta.cc:287] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.035s	user 0.006s	sys 0.011s
I20260709 13:17:05.683593 11172 raft_consensus.cc:2764] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:05.805629  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:05.721398 11118 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.696204 11111 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:05.722183  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.809127  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:05.810451  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:05.722029  8291 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:05.729223 11181 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:17:05.729851 11180 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:17:05.730154  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.698194 11082 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:05.660336 10991 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:05.826435  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.780603 11161 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:05.687347 10992 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:05.684360 10682 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.695257 11130 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:17:05.738199 11135 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.743821 10942 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.770299  8362 rpcz_store.cc:276] 0709 13:17:04.387249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.389787 (+  2538us) service_pool.cc:224] Handling call
0709 13:17:05.693669 (+1303882us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003651d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:05.693771 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2640032512}
I20260709 13:17:05.703025 10713 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.767315  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:05.775633  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:05.838259  8920 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:05.777487  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:05.779681  8183 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:05.714677 10993 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.009s
I20260709 13:17:05.781113  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.841769  8216 raft_consensus.cc:2410] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:17:05.842854  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:05.750602  8295 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:05.790539  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.792841  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:05.845144  8214 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:05.846006  8211 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:17:05.798229  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:05.803769  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:05.847311  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 43620.6us
I20260709 13:17:05.848266 11135 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.849051 11135 consensus_queue.cc:1059] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:05.805163  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:05.849807 11135 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:05.850261  8218 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.805330  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:05.805557  8926 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:17:05.840014  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60436.3us
I20260709 13:17:05.806031  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:05.854010  8217 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:05.806372  8927 raft_consensus.cc:2376] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7. Re-sending same reply.
I20260709 13:17:05.854569  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.855225 10990 raft_consensus.cc:3055] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:05.740937 11140 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.855598 10990 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:05.855708  8921 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:05.820320  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:05.802224 11070 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.856459 10990 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.857290  8289 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.857641 10990 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:05.801412 10867 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.769238 11168 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.860118 10867 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:05.860612  8369 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:05.825480  8361 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:05.681685 11096 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.861574 11168 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:05.861347 11082 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.862824 11135 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:05.817950 11085 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.863619 11085 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.864830 11190 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:05.834626  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:05.865388 11190 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:05.865514  8360 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:05.810436 11072 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.866850  8290 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:05.866398 11190 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.837383  8219 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:05.750092 11131 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:05.855731  8183 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:05.868374 11131 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.857021  8220 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:05.821120  8365 raft_consensus.cc:2368] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7.
I20260709 13:17:05.824424  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:05.828347  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:05.870333  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 45980.6us
I20260709 13:17:05.871622  8186 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:05.877380  8213 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:05.883560  8218 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:05.829248 10991 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:05.896400  8922 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:05.831128 10992 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:05.876735 11157 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:05.935186  8889 leader_election.cc:336] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.639s (SENT)
I20260709 13:17:05.922909 10682 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.923708 11093 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.924444 10991 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:05.897023 11112 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.886061 10998 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.831612 11161 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.908560  8289 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:05.885408  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 87235.2us
I20260709 13:17:05.830180 11105 consensus_queue.cc:1059] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:17:05.960013  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:05.878252 11118 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:05.887370 11140 raft_consensus.cc:2764] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:17:05.924533 11149 consensus_meta.cc:287] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.000s
I20260709 13:17:05.915644 10932 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:05.969022  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 201770us
I20260709 13:17:05.973877  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:05.978729  8889 leader_election.cc:336] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.580s (SENT)
I20260709 13:17:05.998678  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:05.999836  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.001222  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:05.940742 10992 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:05.895560 11081 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:05.896915 11168 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.916079 11073 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.008826 11175 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:06.016178 11127 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:06.016794 11175 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:06.017379 11162 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:06.017535 11073 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:05.980136 11118 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.017724 11175 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:05.993700  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.018867  8293 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.977248 11112 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:05.897567 10989 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:17:06.024020  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:06.024363 10989 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:06.024643  8923 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.003337 10993 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.005245  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 474) took 1862 ms. Trace:
I20260709 13:17:06.007357 11096 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.009793  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.014072  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.014292  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.034933  8214 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:06.035347  8213 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:06.035983  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.036820  8214 raft_consensus.cc:2393] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:06.015072  8220 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.015684  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:06.024771 10989 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:06.067961  8926 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:17:06.018260 11118 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:05.996416 11177 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.520s	user 0.002s	sys 0.002s
I20260709 13:17:06.016089  8217 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:06.021912  8216 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:06.023221 10990 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:06.002549 11130 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.031119  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:06.088433  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.088598 11118 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.090685 11118 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.090862 11131 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.061264  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.064777  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.120661  8211 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:06.031623  8293 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:06.060459 11112 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.037050  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:06.017763 11162 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:06.069103  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.073733 10989 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.074594 10713 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.075706  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 206494us
W20260709 13:17:06.128715  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 59694.4us
I20260709 13:17:06.129345  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:06.129940  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.036511 10979 raft_consensus.cc:3055] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:06.132373  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:06.022214 10971 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:17:06.034050  8919 rpcz_store.cc:276] 0709 13:17:04.142472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.144112 (+  1640us) service_pool.cc:224] Handling call
0709 13:17:04.152377 (+  8265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.508404 (+1356027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.005012 (+496608us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001e78d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:06.005182 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676914560}
I20260709 13:17:06.078480  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.001996 11149 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.079901 11164 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.138499 11168 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.149216 11027 raft_consensus.cc:3055] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:06.149554  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.149770 11027 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:06.150192  8217 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.081132  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.151397  8295 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:06.152424  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.152263 11027 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.081329 11081 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.127981 10991 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.149241 11149 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.133690 10713 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.153473 11027 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.084331  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.156111 10713 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.086380  8360 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:06.156347  8216 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:17:06.157279  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.091859  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.093771  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.154575  8368 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:06.158533  8216 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:17:06.158695  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.158783  8219 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.161320  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.094822 10932 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.096248 11090 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.096141 11111 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.098623  8926 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEARNER]: Advancing to term 7
I20260709 13:17:06.104938 11072 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.106705  8220 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:06.112628  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:06.188486  8925 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:06.113428  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.114066  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:06.115502  8889 leader_election.cc:336] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.803s (SENT)
I20260709 13:17:06.189574  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:06.190420  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 74934.9us
W20260709 13:17:06.163231  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.191808  8889 leader_election.cc:336] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.831s (SENT)
W20260709 13:17:06.192124  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.192319  8889 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:06.064926  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.121994  8927 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:06.120617  8213 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:06.193751  8214 raft_consensus.cc:2368] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:06.124356  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.127082  8923 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:06.025610 11121 consensus_queue.cc:1059] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:17:06.133482  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:06.132779 10979 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:06.134879  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:06.135013  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:06.205907  8365 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.135279 10989 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.135378 10960 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:06.136796 11162 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.132383  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.212879  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.213886  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.214665  8211 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:06.177973  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:06.180792  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 89024.5us
I20260709 13:17:06.189046  8288 raft_consensus.cc:2376] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8. Re-sending same reply.
I20260709 13:17:06.195331  8361 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:06.220382  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:06.197671  8219 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:06.201551  8217 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:06.149267 11164 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:06.204630  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.205812  8295 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:06.226675  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.136023  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:06.207022  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:06.228569  8926 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:06.229070  8889 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.230405 11004 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:06.230765 11004 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.163733 11107 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.234701  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:06.235116  8214 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:17:06.219514  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.221556  8213 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:06.185832 10713 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.228000  8367 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:06.245231  8293 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:06.205032 10990 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.232621  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.233883  8212 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:06.234536 11004 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.241101 10993 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:06.231303  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.242265  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:06.255915  8295 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:06.231824 11175 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:06.242959 11122 consensus_queue.cc:1059] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:06.244557  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.232299  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:06.268306  8214 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:06.268816 11111 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.269493 11111 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:06.269403  8183 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:06.269711  8214 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:06.258034 11082 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.270838  8183 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:06.271092  8214 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.246563  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.243459 11107 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.272307 10998 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:06.272694 10998 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.273023 10998 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.274145 11107 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.274752 11107 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.275081 11107 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.275398 11107 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.246552  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:06.276654  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.278373  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:06.279156 11195 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.467s	user 0.000s	sys 0.004s
I20260709 13:17:06.246572  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.205435 11135 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.280692  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.280797  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.255398 10993 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.281775 10993 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.282465  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.282524  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.283176  8292 raft_consensus.cc:2376] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8. Re-sending same reply.
I20260709 13:17:06.283492  8293 raft_consensus.cc:2410] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:06.257296  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:06.266721 11175 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:06.231272 10960 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:06.245400 11162 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.211300 10992 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.301198  8365 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:06.284013  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.285287  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.288262  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.297500  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:06.285462  8258 leader_election.cc:400] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:06.306087  8293 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:06.306324  8258 leader_election.cc:403] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:06.270094 11111 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.307741 11111 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.308851  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:06.309991  8365 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:06.311394  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:06.307093  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.315321  8293 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.314181  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1954) took 1596 ms. Trace:
I20260709 13:17:06.314764  8287 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.314026  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.317795  8214 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:06.236861 11130 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:17:06.315797  8286 rpcz_store.cc:276] 0709 13:17:04.717460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.717577 (+   117us) service_pool.cc:224] Handling call
0709 13:17:06.313996 (+1596419us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400059bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:06.314129 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313388416}
I20260709 13:17:06.345504  8363 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:06.318895  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:06.317677  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.303692  8217 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:17:06.346400  8365 raft_consensus.cc:2368] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
W20260709 13:17:06.325106  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 96099.3us
I20260709 13:17:06.248625 11072 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:17:06.284231 11081 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:06.284802 11194 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:06.295076 11175 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.294835 11132 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:06.341804 10682 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:06.290032 10990 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:06.284360 11073 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.314523 11190 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:17:06.346536  8288 raft_consensus.cc:2376] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8. Re-sending same reply.
I20260709 13:17:06.347381  8889 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.347330  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.362994  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:06.340543 10988 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.290596 11164 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:06.287840 11121 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:17:06.376507  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.354595 11081 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.284533 10713 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:17:06.343191 11131 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:06.393441  8889 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.396898  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1968) took 1136 ms. Trace:
I20260709 13:17:06.389364  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.401041  8289 rpcz_store.cc:276] 0709 13:17:05.260388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.260554 (+   166us) service_pool.cc:224] Handling call
0709 13:17:06.396738 (+1136184us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b540005c3d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:06.396846 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257118464}
I20260709 13:17:06.401300  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:06.402878  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.404134  8289 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:06.387370  8293 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:06.287745 10979 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.399533  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:06.402024  8294 raft_consensus.cc:2376] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6. Re-sending same reply.
I20260709 13:17:06.406044  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.407459  8289 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:06.387554 11205 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:17:06.408388  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.411305  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:06.415226  8294 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:06.345150 11161 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:06.416198  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 74770.6us
I20260709 13:17:06.415756  8293 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [5.3-8.5]
I20260709 13:17:06.389768 11190 consensus_queue.cc:1243] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:06.419503  8294 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:06.422461 11082 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.422291  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:06.387076 11132 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:06.422111  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.430441  8286 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:06.427385  8294 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:06.421347  8293 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.423254 11199 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:06.399163 10971 consensus_queue.cc:1059] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:17:06.612869 10992 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:06.605671 11194 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:06.395273 10960 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:06.602771  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 239840us
I20260709 13:17:06.398733 11164 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.424309 10998 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.488948  8366 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.405097 11081 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.410080 11130 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:06.412549 10990 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.413522 11073 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:17:06.611155  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:06.396773 11213 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.405263 11135 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:06.556576 11224 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.455727  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 171147us
I20260709 13:17:06.425371  8261 leader_election.cc:400] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7.
I20260709 13:17:06.513103  8286 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:17:06.655449  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 133196us
W20260709 13:17:06.571210 11212 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:17:06.606312 11214 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:17:06.572345 11210 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:17:06.657065  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 255800us
I20260709 13:17:06.637612 11168 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.665030  8293 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:06.770293  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.770895  8293 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:17:06.742595  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:06.754870  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:06.773998  8292 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
W20260709 13:17:06.742578  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.755159  8261 leader_election.cc:403] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:17:06.715699  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.758237  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:06.777575  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:06.759506 11228 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:06.760700  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:06.762583  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:06.768110  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:06.793430  8293 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.704937 11215 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.795363  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 377241us
I20260709 13:17:06.704340 11130 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:06.712709 11164 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.667387 11199 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:06.796591  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:06.744534 11190 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:17:06.794873 10713 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.769665 11194 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.785869 11228 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:06.795480 11135 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.791225 11082 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:06.797783 11219 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7.
I20260709 13:17:06.815948 11168 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:06.816634  8291 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.817318 11130 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.818014  8186 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:06.818363 11130 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.754280 10990 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:06.819603  8363 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:06.819551  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:06.799757  8261 leader_election.cc:400] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:06.809092  8364 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:06.820986  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:06.809424  8290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 1953) took 2093 ms (client timeout 2181 ms). Trace:
W20260709 13:17:06.822244  8290 rpcz_store.cc:269] 0709 13:17:04.716285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.719849 (+  3564us) service_pool.cc:224] Handling call
0709 13:17:06.809247 (+2089398us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b540005b4d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:06.809372 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766407040}
I20260709 13:17:06.814746  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:06.824415  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:06.764107 11105 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.826617  8364 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:17:06.828075  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:06.827984  8364 pending_rounds.cc:85] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:06.828855  8364 pending_rounds.cc:107] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:17:06.829362  8364 raft_consensus.cc:2889] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.828837  8213 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
W20260709 13:17:06.818979 11004 consensus_meta.cc:287] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.527s	user 0.001s	sys 0.006s
I20260709 13:17:06.833477  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:06.813166 10989 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.005s
I20260709 13:17:06.814982 11082 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:06.827495 10993 consensus_meta.cc:287] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
W20260709 13:17:06.836750  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.848558  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:06.835412 11217 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:06.838804 11161 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:06.827564 11223 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:17:06.814381 11135 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:06.806083 10991 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:06.825758 10990 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.660919 11132 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.827543 11140 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:06.846820 11082 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:06.846295 10988 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:06.856751 10971 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.856616 10989 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.830773 11105 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.862848 11072 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:06.881403 11107 consensus_meta.cc:287] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.006s
I20260709 13:17:06.813511 11228 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.833407 11175 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.895762 11093 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.896564 11228 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.879974 11217 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:06.857113 11213 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:17:06.785073 11224 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.887390 10713 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.888331 10988 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.902362 10988 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:06.907574  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.842346 11004 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.825939 11215 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.880656 11135 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.857230 10993 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.913602  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:06.916646  8922 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:06.899165 11168 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:06.876282 11199 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.926478 11004 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:06.926906 11186 log.cc:927] Time spent T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.108s	user 0.001s	sys 0.001s
I20260709 13:17:06.928347 11091 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.928611 10990 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.928965 10993 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.930769 11085 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.938966 10990 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.941660 11084 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:06.942225 11084 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:06.898090 11107 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.942900 11135 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.948650 11107 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.948650 11135 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.949617 11070 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:06.960860 11175 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.968323 11222 raft_consensus.cc:3055] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:06.968859 11222 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:06.969729 11222 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.971022 11222 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.945745 11168 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:06.973891 11217 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:06.974475 11215 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.973402 11224 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:06.145187  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:07.033679  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 215556us
I20260709 13:17:07.039222  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:07.040940  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:07.051645  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 375) took 1492 ms (client timeout 1963 ms). Trace:
W20260709 13:17:07.052242  8212 rpcz_store.cc:269] 0709 13:17:05.559016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.567050 (+  8034us) service_pool.cc:224] Handling call
0709 13:17:07.051030 (+1483980us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54001b1f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:07.051373 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515705088}
I20260709 13:17:06.841069  8213 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.057778  8213 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:17:07.058360  8213 pending_rounds.cc:85] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 6
I20260709 13:17:07.058704  8213 pending_rounds.cc:107] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:17:07.059041  8213 raft_consensus.cc:2889] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.061902  8114 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 5, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 5 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:17:07.065459  8114 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 6, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 6 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:07.069561  8214 pending_rounds.cc:85] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 3
I20260709 13:17:07.069948  8214 pending_rounds.cc:107] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:17:07.070204  8214 raft_consensus.cc:2889] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:06.882905  8889 leader_election.cc:336] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.090s (SENT)
I20260709 13:17:06.927254  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 665) took 1348 ms. Trace:
I20260709 13:17:07.085810  8215 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:07.097069 11140 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:07.097942 11155 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.098891 11157 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:07.102483  8363 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:06.943274 11084 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.117496 10989 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:07.118973 11105 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.122179  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1410) took 1204 ms. Trace:
I20260709 13:17:07.122730  8287 rpcz_store.cc:276] 0709 13:17:05.953296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.953442 (+   146us) service_pool.cc:224] Handling call
0709 13:17:06.314599 (+361157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.316691 (+  2092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.121637 (+804946us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400059bd0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:07.121917 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829621504}
I20260709 13:17:07.125947  8217 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:17:07.122237 11027 consensus_meta.cc:287] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.967s	user 0.010s	sys 0.001s
I20260709 13:17:07.127933  8217 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:17:07.139387  8217 pending_rounds.cc:85] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 5
I20260709 13:17:07.139811  8217 pending_rounds.cc:107] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.6
I20260709 13:17:07.140302  8217 raft_consensus.cc:2917] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Aborting config change with OpId 6.6: Aborted: Op aborted by new leader
I20260709 13:17:07.141556  8217 raft_consensus.cc:2889] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.149698  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:07.150095  8892 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.150884  8922 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.152204  8926 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:07.156781 11213 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.158842  8213 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:07.110922 11155 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:07.169405 11155 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.157693 11213 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:07.198215 11111 consensus_meta.cc:287] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.890s	user 0.008s	sys 0.004s
I20260709 13:17:07.198319  8219 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:07.199123 11111 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.202617 11111 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:07.205871 11082 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.206990  8889 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:07.182432 11027 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:07.208938  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 326042us
I20260709 13:17:07.192613  8928 rpcz_store.cc:276] 0709 13:17:05.578772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.578937 (+   165us) service_pool.cc:224] Handling call
0709 13:17:05.610650 (+ 31713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.735091 (+124441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.927031 (+1191940us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b54003df754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:06.927196 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165801728}
W20260709 13:17:07.210147  8889 leader_election.cc:336] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.092s (SENT)
I20260709 13:17:07.210731  8889 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:07.211946 11091 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.163105 11140 raft_consensus.cc:697] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:07.219410  8212 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:07.244072  8922 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:07.251570  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 427109us
I20260709 13:17:07.251926  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:07.252795  8360 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:07.253592  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:07.254827 11111 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:07.255599 11111 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:07.256551 11084 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.257545 11111 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.245329 11082 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:07.273072  8892 leader_election.cc:336] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.580s (SENT)
I20260709 13:17:07.273660  8892 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:07.274628 11135 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.277364  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:07.279176 11081 consensus_meta.cc:287] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.523s	user 0.004s	sys 0.012s
I20260709 13:17:07.273131 11140 consensus_queue.cc:237] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.283747 11090 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.284500 11090 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.287289 11090 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.279107  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:07.267203  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:07.292912  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.293296 10998 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:07.294534  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:07.295109 11213 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.295432  8360 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:07.296736  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:07.310206  8211 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:07.310410  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.311106  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1687) took 1500 ms. Trace:
I20260709 13:17:07.312316  8889 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:07.279764 11081 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.314738  8364 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:07.315933 11096 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.317608 11096 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:07.320369  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.320441  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.321039  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 501413us
I20260709 13:17:07.322932 10932 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:07.323498 10932 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:07.324594 11096 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:07.323709  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.324939  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1691) took 1038 ms. Trace:
I20260709 13:17:07.311580  8368 rpcz_store.cc:276] 0709 13:17:05.810958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.811311 (+   353us) service_pool.cc:224] Handling call
0709 13:17:05.811759 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.158891 (+347132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.310436 (+1151545us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400354154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:07.310854 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787927296}
I20260709 13:17:07.326020  8369 rpcz_store.cc:276] 0709 13:17:06.285952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.800567 (+514615us) service_pool.cc:224] Handling call
0709 13:17:06.800979 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:06.861619 (+ 60640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.861684 (+    65us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:06.868242 (+  6558us) log.cc:844] Serialized 52 byte log entry
0709 13:17:06.953114 (+ 84872us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b480015c258. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f 00007f3202428f37 00007f320243d55c 00007f320243d508 00007f320243d488 00007f320243d443 00007f320243c6ec 00007f3201366a96
0709 13:17:07.261038 (+307924us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:07.290768 (+ 29730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.308668 (+ 17900us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.324417 (+ 15749us) raft_consensus.cc:1685] finished
0709 13:17:07.324441 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.324729 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23656,"raft.queue_time_us":35364,"raft.run_cpu_time_us":2089,"raft.run_wall_time_us":112902,"spinlock_wait_cycles":10515840,"thread_start_us":104809,"threads_started":2,"wal-append.queue_time_us":314938}
I20260709 13:17:07.331768 11135 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:07.332283 11135 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.332773 11215 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.331018  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:07.332206  8892 leader_election.cc:336] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.531s (SENT)
I20260709 13:17:07.332793 11135 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.328245 11081 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.308882 11213 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.348642 11213 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.352317 11027 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.341208  8368 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:07.350773 10998 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.350008  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 479) took 1573 ms. Trace:
I20260709 13:17:07.357396  8924 rpcz_store.cc:276] 0709 13:17:05.776272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.776375 (+   103us) service_pool.cc:224] Handling call
0709 13:17:05.776640 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:05.776854 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:05.917382 (+140528us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.349082 (+1431700us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b1800338800. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fcfb94bc 00007f31fa30748b 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb123a
0709 13:17:07.349341 (+   259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.349427 (+    86us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:07.349521 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.349610 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.349810 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191456,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":1192,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"spinlock_wait_cycles":5964672,"thread_start_us":176545,"threads_started":2,"wal-append.queue_time_us":156271,"wal-append.run_cpu_time_us":1324,"wal-append.run_wall_time_us":1032298}
I20260709 13:17:07.360071  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1688) took 1548 ms. Trace:
I20260709 13:17:07.360951  8366 rpcz_store.cc:276] 0709 13:17:05.811290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.815392 (+  4102us) service_pool.cc:224] Handling call
0709 13:17:05.815674 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.736203 (+920529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.359665 (+623462us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540018fe54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:07.359903 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547744128}
W20260709 13:17:07.375819  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 52262.1us
W20260709 13:17:07.382602  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 65029.1us
I20260709 13:17:07.383670  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:07.384580 11027 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.386008 11027 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:07.386780 11027 consensus_queue.cc:1243] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:07.388612  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.389428  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 57329.5us
W20260709 13:17:07.399991  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 61952.2us
W20260709 13:17:07.402818  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 148145us
I20260709 13:17:07.392401 11090 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.405124 11090 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.405812  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:07.407289 11090 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:07.408072  8183 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:07.380496 11213 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:07.401036  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:07.418229  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.407895 11090 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:07.431291 11228 consensus_meta.cc:287] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.006s
I20260709 13:17:07.460256  8889 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:07.463486  8924 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:07.464419 11213 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:07.464910 11213 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.465204  8925 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:07.465288 11213 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.431932 10960 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.469630  8186 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:07.470723  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 1988) took 1031 ms. Trace:
I20260709 13:17:07.471141  8293 rpcz_store.cc:276] 0709 13:17:06.316797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.796988 (+480191us) service_pool.cc:224] Handling call
0709 13:17:06.797844 (+   856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.798108 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:07.192247 (+394139us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.243706 (+ 51459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.249784 (+  6078us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:07.292434 (+ 42650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.334085 (+ 41651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.347689 (+ 13604us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114265,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":6251,"raft.queue_time_us":13842,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":30235,"thread_start_us":353418,"threads_started":2,"wal-append.queue_time_us":130947}
I20260709 13:17:07.475129  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1411) took 1521 ms. Trace:
I20260709 13:17:07.475502  8291 rpcz_store.cc:276] 0709 13:17:05.953700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.953833 (+   133us) service_pool.cc:224] Handling call
0709 13:17:06.816454 (+862621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.817109 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.474734 (+657625us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540005b4d0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:07.474966 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983042816}
I20260709 13:17:07.478960  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 408) took 1472 ms. Trace:
I20260709 13:17:07.479310  8295 rpcz_store.cc:276] 0709 13:17:06.006251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.232378 (+226127us) service_pool.cc:224] Handling call
0709 13:17:07.478598 (+1246220us) spinlock_profiling.cc:243] Waited 6.53 ms on lock 0x7b5400389354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:07.478763 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15012736}
I20260709 13:17:07.481360  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1415) took 1526 ms. Trace:
I20260709 13:17:07.481730  8292 rpcz_store.cc:276] 0709 13:17:05.955044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.283779 (+328735us) service_pool.cc:224] Handling call
0709 13:17:07.481028 (+1197249us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400002dd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:07.481209 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420308864}
I20260709 13:17:07.483188  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1363) took 1344 ms. Trace:
I20260709 13:17:07.483577  8211 rpcz_store.cc:276] 0709 13:17:06.138340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.227713 (+ 89373us) service_pool.cc:224] Handling call
0709 13:17:06.228035 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.310803 (+1082768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.482875 (+172072us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540019a354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:07.483097 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482356992}
I20260709 13:17:07.484468 10932 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.485877 10932 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.489928  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1700) took 1121 ms. Trace:
I20260709 13:17:07.490295  8363 rpcz_store.cc:276] 0709 13:17:06.368653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.820410 (+451757us) service_pool.cc:224] Handling call
0709 13:17:06.840116 (+ 19706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.133506 (+293390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.489667 (+356161us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540010ca54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:07.489855 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560319872}
I20260709 13:17:07.491997  8214 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:07.492376 11118 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.492797 11118 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.493222 11118 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.493983 10979 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.496331  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1356) took 1708 ms. Trace:
I20260709 13:17:07.496688  8215 rpcz_store.cc:276] 0709 13:17:05.788416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.788561 (+   145us) service_pool.cc:224] Handling call
0709 13:17:07.082277 (+1293716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.120186 (+ 37909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.496154 (+375968us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001b1f50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:07.496280 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2907622272}
W20260709 13:17:07.498906 11164 consensus_meta.cc:287] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.008s
I20260709 13:17:07.499464 11164 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.501784 11164 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:07.503837  8114 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 5, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:07.511829  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1366) took 1370 ms. Trace:
I20260709 13:17:07.506544 10942 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.510447  8361 raft_consensus.cc:3055] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:07.517683  8361 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:07.511596 10853 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:07.442466 11111 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.516103  8219 rpcz_store.cc:276] 0709 13:17:06.141558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.285325 (+143767us) service_pool.cc:224] Handling call
0709 13:17:06.300030 (+ 14705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.199085 (+899055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.511537 (+312452us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b54003d4fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:07.511772 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1802334080}
I20260709 13:17:07.519553  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:07.528164 11081 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:07.528838 11081 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.530840  8215 raft_consensus.cc:2410] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:07.531037 11081 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.519897  8360 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:07.534214  8360 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:07.527277 11111 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.564435  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 164977us
W20260709 13:17:07.533787  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 125892us
I20260709 13:17:07.562300 11111 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:07.580928  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47269.2us
I20260709 13:17:07.593156 11137 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:07.593926  8925 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:17:07.594365  8925 pending_rounds.cc:85] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 5
I20260709 13:17:07.593869 11137 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.594597  8925 pending_rounds.cc:107] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:17:07.594861  8925 raft_consensus.cc:2889] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.571205 10853 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.598044  8923 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:07.598716 10853 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:07.601768  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:07.601864  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:07.602659  8922 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:07.602689  8925 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:07.615983  8889 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:07.616750  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:07.617259  8889 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.618387 11027 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:07.618691  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:07.620186  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.620604  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:07.621804  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:07.622380  8291 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:07.623239  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:07.628382  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:07.629330  8928 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:07.431280 10988 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.574383 10980 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:07.638391 10990 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.639339  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:07.639264 11135 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.636379  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:07.640586 11155 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.641705  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:07.642155 10997 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.642441 11157 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.642477 11238 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.644222  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:07.650954  8922 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.623140 10998 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.647907  8923 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:07.645619  8360 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.658818  8291 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:07.661083  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.637143 11137 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:07.664973  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.674075  8360 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.681175  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:07.692018 11137 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.694191 11238 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.696914 11238 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:07.697415  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.683040  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:07.686825  8293 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:07.687763 10997 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.713629  8367 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:07.714732 10997 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:07.716327 10980 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.719578 10980 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:07.723619  8363 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:17:07.729465  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.730394  8218 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.710448 10998 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.686268 11157 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.704994 11084 consensus_queue.cc:1059] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:17:07.726095 11027 raft_consensus.cc:697] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:07.744902  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:07.748725  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:07.751204  8364 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:07.734969 11194 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.748131  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:07.753686  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 133648us
W20260709 13:17:07.758495  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 127170us
I20260709 13:17:07.760852  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:07.744226 11091 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.775595 10988 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.776793 11155 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:07.782189 11257 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:17:07.784485 10941 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:07.785969  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.773586 11213 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.792519 11027 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.793594 11213 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.793900  8361 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.794924  8361 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.796555 10980 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.797559  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:07.797868  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 124430us
I20260709 13:17:07.801373 10998 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:07.802847  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:07.803402  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:07.804821  8920 raft_consensus.cc:2393] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:07.805513 10960 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:07.806437 11157 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.798585 10942 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:07.799103 11135 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:07.799597 11218 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:07.820067  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.799113  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.819329  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:07.840531  8360 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:17:07.840986  8360 pending_rounds.cc:85] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 4
I20260709 13:17:07.849907  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:07.851735  8892 leader_election.cc:336] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.779s (SENT)
I20260709 13:17:07.852198  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:07.814574 11096 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.815196 10942 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.854620  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:07.856566  8183 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:07.855306  8360 pending_rounds.cc:107] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:07.859160  8360 raft_consensus.cc:2889] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:07.859211  8362 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:17:07.861534  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.847637  8922 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:07.868646  8369 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:07.857916 10942 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:07.841084 11155 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:17:07.873641  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:07.870906  8186 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:07.816584 11194 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.860877 11135 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:07.876571  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 90724.9us
I20260709 13:17:07.865900 11140 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.842867 10988 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:17:07.888803  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 89788.7us
W20260709 13:17:07.899801  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 82698.7us
I20260709 13:17:07.866451 10980 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.858237 11096 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.881299 11140 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.874964 10979 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:07.909941  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:07.893728 10998 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:07.908123  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:07.913975  8212 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:07.890694 11111 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.913587 10979 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:07.920229  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:07.921554 10853 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:07.913928 10998 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.909839 11140 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.925144 11265 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.932518 11265 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:07.930083 11218 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:17:07.935763  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1532) took 1881 ms. Trace:
I20260709 13:17:07.936180  8216 rpcz_store.cc:276] 0709 13:17:06.029994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.197050 (+167056us) service_pool.cc:224] Handling call
0709 13:17:06.197259 (+   209us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:06.225398 (+ 28139us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:06.646149 (+420751us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b180023b900. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa321455 00007f3200e093c7 00007f31fd41b9a7 00007f31fd42b0bf 00007f31fd42b038
0709 13:17:06.827060 (+180911us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.328342 (+501282us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:07.449134 (+120792us) log.cc:844] Serialized 52 byte log entry
0709 13:17:07.450089 (+   955us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.677488 (+227399us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.882862 (+205374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.898093 (+ 15231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.910707 (+ 12614us) raft_consensus.cc:1685] finished
0709 13:17:07.910750 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.910939 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38337,"prepare.queue_time_us":365283,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":1704,"raft.queue_time_us":48680,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":18624,"spinlock_wait_cycles":7913344,"thread_start_us":602063,"threads_started":4,"wal-append.queue_time_us":524166}
I20260709 13:17:07.930855  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:07.931529  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:07.918951 10960 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.930722 10867 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:07.947649  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.951789  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:07.941322  8214 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:07.958061  8218 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:07.929378 10998 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:07.951437 11217 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.954706 11164 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:07.974162  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 54090.3us
I20260709 13:17:07.977017 10980 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:07.948974 10960 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.952693 11269 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:17:07.971277 11111 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:07.979450  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 127726us
W20260709 13:17:07.980822  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.927680 11084 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:17:07.961140 11107 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.983490 10960 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.004354  8361 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:17:08.011888  8361 pending_rounds.cc:85] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 2
I20260709 13:17:07.983982 11164 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:17:08.016379  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1534) took 1985 ms. Trace:
W20260709 13:17:08.016610 11275 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:17:08.017385  8211 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:08.018177  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.019078 11265 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.019922  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.020337  8361 pending_rounds.cc:107] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:17:08.020678  8361 raft_consensus.cc:2889] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.021395  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1689) took 1736 ms. Trace:
I20260709 13:17:08.021688  8361 rpcz_store.cc:276] 0709 13:17:06.285362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.285612 (+   250us) service_pool.cc:224] Handling call
0709 13:17:06.285978 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.510102 (+1224124us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400264e20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd4131c0 00007f31fd414231 00007f31fd410d8f 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c
0709 13:17:07.793472 (+283370us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b4c00227940. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fb6dda20 00007f31fb6eea29 00007f31fb6b4644 00007f31fb6dbf2d 00007f31fb6dbb93 00007f31fd40c18b 00007f31fd40ccb5 00007f31fd407f30 00007f31fd4097de 00007f31fd413b49 00007f31fd414416
0709 13:17:08.021148 (+227676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.021342 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249967360}
W20260709 13:17:08.022367 11172 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:17:08.011301 11194 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.024192 11217 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:08.024551  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:08.024804 11194 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:08.025180  8365 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.025424 11194 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.027458 11164 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:07.985040 11218 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:17:08.027922 11164 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:07.983839 10853 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:17:08.027690 11194 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:08.005620  8892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.200s (SENT) [suppressed 28 similar messages]
I20260709 13:17:08.059296  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.060200  8292 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:07.985016 10867 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.028982 11164 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.061251  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.016857  8220 rpcz_store.cc:276] 0709 13:17:06.030492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.204699 (+174207us) service_pool.cc:224] Handling call
0709 13:17:06.231227 (+ 26528us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:06.234504 (+  3277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.234535 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:06.235227 (+   692us) log.cc:844] Serialized 52 byte log entry
0709 13:17:07.475230 (+1240003us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b1800060040. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:17:07.691351 (+216121us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:07.850724 (+159373us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.862629 (+ 11905us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.862803 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.873292 (+ 10489us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.935023 (+ 61731us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b1800060040. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:08.012548 (+ 77525us) raft_consensus.cc:1685] finished
0709 13:17:08.012569 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.016178 (+  3609us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24989,"prepare.queue_time_us":85447,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":63,"raft.queue_time_us":9695,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":164,"spinlock_wait_cycles":20649088,"thread_start_us":352878,"threads_started":2,"wal-append.queue_time_us":1697229}
W20260709 13:17:08.070871  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 149075us
I20260709 13:17:08.071930 11269 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.084395  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60711.6us
I20260709 13:17:08.067215 11194 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.076644 11091 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.085896 11164 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.103863 11194 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.103698 11269 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.106211 11194 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.107081 11269 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.112082 11111 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.112748 11111 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.113517 11269 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.114203 11269 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.114705 11111 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.112109 11091 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.119001 11091 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.119060 11221 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:08.119663 11221 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:08.101227  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 95621.7us
I20260709 13:17:08.100358  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:08.120927  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.122547 10941 consensus_queue.cc:1059] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:08.123052  8293 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:08.084533 10942 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.102556 10988 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:17:08.093400 11282 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:08.132759  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.131520  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:08.134078  8365 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:08.135576  8361 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:08.156483  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.141968 11118 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
I20260709 13:17:08.142118 11221 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.143038 11269 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:08.143095  8892 leader_election.cc:336] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.894s (SENT)
I20260709 13:17:08.145315 10942 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.141981 11140 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:17:08.145924  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46527.7us
I20260709 13:17:08.146533 10996 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.149945  8288 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:08.150585 11112 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:08.151798  8291 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:08.152318  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.153635  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.134708 11107 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.183275 10980 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.183652 11291 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:17:08.183895 10980 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.184499  8293 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:08.185292 11281 raft_consensus.cc:3055] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:08.185678 11281 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:08.186076 10980 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.186543 11281 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.181092 11107 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.190582 11107 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.170482 11091 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:08.176941 11221 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:08.213233  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 70153.3us
I20260709 13:17:08.220158  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:08.200222 11091 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.216355 11112 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.218145 10979 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.168900 11118 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.177134 10998 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.218396 11222 raft_consensus.cc:3055] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:17:08.220638  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 49930.7us
W20260709 13:17:08.216002 11090 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.009s	sys 0.009s
I20260709 13:17:08.187951 11281 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.191236 10867 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.223853 11091 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.266920 11269 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.265596  8295 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:08.266259  8289 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:08.265583  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.266306  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.263373 10980 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.262109 10853 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.268918  8922 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:08.266355 11112 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.261430  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:08.268337 11140 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.299199  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:08.300571 10853 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.302937 10853 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.303445 10980 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.305570 10980 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.276489  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:08.308964 11269 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.310089  8114 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:08.311333 11269 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:08.280700 11090 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.009s	sys 0.009s
I20260709 13:17:08.314745  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:08.314810  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.311798  8114 catalog_manager.cc:5697] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 3, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 3 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:08.312163  8293 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.323294  8211 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:08.324378  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.275875 11222 raft_consensus.cc:740] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:08.364897  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:08.365568  8360 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:08.372238  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 95813.5us
I20260709 13:17:08.376696  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.377683  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:08.315511 10979 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.288977 11118 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.386932  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.388821  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:08.392091  8363 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.383781  8366 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:08.378780  8114 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 5, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 5 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:08.313439 10867 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.401414  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:08.411917  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:08.412810  8928 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:08.421878  8362 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:08.420657  8361 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:08.401582 11269 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:08.437654  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.416461 11194 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:08.439843  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.416764 11027 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.446766  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.447005  8117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46484 (request call id 259) took 17044 ms (client timeout 15000 ms). Trace:
I20260709 13:17:08.448804  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:08.449508  8928 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:08.450142 11298 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:08.452139  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.453722  8369 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:08.454146 10932 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.454640 11272 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:17:08.454782 10932 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.455370 11272 consensus_queue.cc:1243] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:08.435982  8114 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 5, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 5 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:08.458884  8362 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:08.459231  8362 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:08.460199  8215 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:08.461746 10932 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:08.462553 11253 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.872s	user 0.003s	sys 0.000s
I20260709 13:17:08.462954 11297 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.463284 11264 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:08.463724  8367 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
W20260709 13:17:08.466653 11276 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.436s	user 0.001s	sys 0.003s
W20260709 13:17:08.447464  8117 rpcz_store.cc:269] 0709 13:16:51.402841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.403342 (+   501us) service_pool.cc:224] Handling call
0709 13:16:51.776590 (+373248us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b5400030838. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031d0173 00007f32032ce37e 00007f320178f2a4 00007f320178f232 00007f320178f161 00007f320178f0dc 00007f320178e392 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:08.443919 (+16667329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:04.887509 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:04.968765 (+ 81256us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:04.968809 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:17:04.968824 (+    15us) tablet.cc:662] Decoding operations
0709 13:17:05.259593 (+290769us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:05.264626 (+  5033us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:05.266412 (+  1786us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:17:05.284690 (+ 18278us) tablet.cc:701] Row locks acquired
0709 13:17:05.284711 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:05.284849 (+   138us) write_op.cc:270] Start()
0709 13:17:05.284956 (+   107us) write_op.cc:276] Timestamp: P: 1783603025284807 usec, L: 0
0709 13:17:05.284980 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:05.285655 (+   675us) log.cc:844] Serialized 6666 byte log entry
0709 13:17:05.674238 (+388583us) op_driver.cc:464] REPLICATION: finished
0709 13:17:05.812753 (+138515us) write_op.cc:301] APPLY: starting
0709 13:17:05.812817 (+    64us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:05.813058 (+   241us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:05.813149 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:05.814278 (+  1129us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:05.814474 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:17:05.814505 (+    31us) write_op.cc:312] APPLY: finished
0709 13:17:05.814752 (+   247us) log.cc:844] Serialized 119 byte log entry
0709 13:17:05.814952 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:05.815122 (+   170us) write_op.cc:454] Released schema lock
0709 13:17:05.815175 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:05.815691 (+   516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:05.815730 (+    39us) write_op.cc:454] Released schema lock
0709 13:17:06.110218 (+294488us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd40e32a 00007f31fd393f14 00007f31fd393ec3 00007f31fd393e38 00007f31fd393df3 00007f31fd3930dc 00007f31fd3bce16 00007f31fd3a4cbb 00007f31fd38f39d 00007f31fd392d75
Metrics: {"mutex_wait_us":3724,"reported_tablets":40,"spinlock_wait_cycles":17959296,"child_traces":[["op",{"apply.queue_time_us":128802,"apply.run_cpu_time_us":2781,"apply.run_wall_time_us":2826,"num_ops":17,"prepare.queue_time_us":160711,"prepare.run_cpu_time_us":13879,"prepare.run_wall_time_us":537061,"raft.queue_time_us":257916,"raft.run_cpu_time_us":30073,"raft.run_wall_time_us":516185,"replication_time_us":334186,"spinlock_wait_cycles":10904320,"thread_start_us":432069,"threads_started":4,"wal-append.queue_time_us":27923,"wal-append.run_cpu_time_us":23631,"wal-append.run_wall_time_us":1501915}]]}
I20260709 13:17:08.446686  8360 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:08.434906 11135 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:08.512923  8363 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:08.473713  8114 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 4, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 4 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:08.513900  8361 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:17:08.481072 10998 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.472010 11194 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:08.483371 11140 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.519071  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.519083  8219 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:08.425695 10979 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.484308 11107 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:08.486707 10996 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:08.417276 11222 consensus_queue.cc:260] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.488564  8364 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:08.488739  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:08.489692  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:08.490231  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.530668  8295 raft_consensus.cc:2410] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:08.490336  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:08.491015  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:08.495394  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.496845  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:08.498363  8362 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.441025 11269 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:08.533195  8212 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:08.539963  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.540774  8367 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:08.504650  8293 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:08.517696  8928 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:08.543447  8218 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:08.518030  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:08.520565  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.477190 11265 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.487577  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:08.524329  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.519351 11140 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.526336 11194 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.512504 11264 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.442382 10867 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.555765 10979 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.556520 10867 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.558382  8218 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:08.530725 11135 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.564713 11135 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.568902 11264 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.569113  8288 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:08.569531 11264 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:08.552774 11265 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.573009 11265 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:08.573799 11269 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.577950 11289 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:08.578413 11289 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:08.581943  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.496332  8214 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:17:08.546985  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 59483.3us
I20260709 13:17:08.549223 11090 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:08.548118  8291 raft_consensus.cc:2410] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:08.548533  8362 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.550652  8368 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:08.472592 11027 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.604214  8363 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:08.605882  8363 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:08.505331 11297 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.524595 10960 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.600941 11090 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.558425 11140 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:08.665303  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 242723us
I20260709 13:17:08.685308  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:08.685629  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.546767 11091 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.715184  8220 raft_consensus.cc:2368] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8.
W20260709 13:17:08.721644  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.655457 10998 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.579479 11289 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.656199 11090 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.725620  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.727823  8292 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:08.728634  8924 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:08.687332 11164 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.725484  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.686503 10979 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:08.732904  8294 raft_consensus.cc:1217] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-8.8]   Dedup: 4.6->[6.7-8.8]
I20260709 13:17:08.737902  8294 pending_rounds.cc:85] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 6
I20260709 13:17:08.738867  8294 pending_rounds.cc:107] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:08.739288  8294 raft_consensus.cc:2889] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.738269  8363 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:08.725499  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.740423  8291 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.721344 11222 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:08.754230  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.755636  8288 raft_consensus.cc:2393] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:08.757589  8363 pending_rounds.cc:85] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 1
W20260709 13:17:08.758882  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 279449us
I20260709 13:17:08.760280  8363 pending_rounds.cc:107] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:17:08.761169  8363 raft_consensus.cc:2889] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.727053 11155 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:08.763782  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.763775  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.765417  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:08.766022  8292 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.771055  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:08.728924 10998 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.772135  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:08.777146  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:08.774140  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:08.784968  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:08.787771  8218 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:08.759732 11164 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.767164 10979 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.790375 11265 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:08.789482 11289 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.787417 11297 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.791006 11027 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:08.789746 11217 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:08.821868  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:08.822657  8211 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.820858  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.834625  8261 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:08.839677 11091 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:08.840633 11164 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:08.841130  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.844107  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.845328  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.847294 10998 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.851481  8362 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:08.853968  8287 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
W20260709 13:17:08.856406  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 359625us
I20260709 13:17:08.857862  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:08.867502  8211 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:08.873528 11307 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:08.873953 10996 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.853030 11311 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:08.874840 10996 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:08.852170 11217 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:08.878763 11217 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:08.889534 10979 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.890677  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:08.890944 10996 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:08.894656  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:08.874046 11307 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.923818  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:08.834544 11297 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:17:08.931839  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:08.934752  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.001454  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:08.895567  8286 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
W20260709 13:17:08.946063  8889 leader_election.cc:336] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.844s (SENT)
I20260709 13:17:09.050617  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:09.051177  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:09.051374  8928 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:08.931695  8291 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:09.051542  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.052501  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:09.001464  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:09.002048  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:09.045737  8292 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:08.961526  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.063900  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:09.066702  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:09.064352 10996 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:09.068732 10996 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.069345  8923 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:09.070470  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:09.070799 10996 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.071103  8925 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.072440  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:09.072532  8919 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:09.074039  8922 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:09.075374  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:09.075968  8286 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:09.076831  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:09.076918  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:09.077512  8923 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
W20260709 13:17:09.078110  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 132092us
I20260709 13:17:09.079571  8926 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:09.080224 11264 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.081136 11297 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:09.081662 11297 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:09.082837 11297 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.084220 11081 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:09.084995 11081 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:09.086243 11081 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.007611 11082 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.088820 10988 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.075419  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:09.101003  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 210411us
I20260709 13:17:09.102181  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:09.050730 11307 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.106840 11090 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.109969  8215 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:09.088585  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 156850us
I20260709 13:17:09.088568 11082 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.001765 10998 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:09.119913  8928 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:09.080349  8925 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:09.128150  8183 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:09.146250  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.146577  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:09.147527  8292 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.126454 10998 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.128736 11297 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.141537 10932 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.150892 10996 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:09.172516 10996 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:09.172612  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:09.173561  8294 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:09.174813  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:09.173599 10996 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.153733 10998 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.147395 11309 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:17:09.175491  8294 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:09.171036  8183 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:09.195490  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:09.201694  8183 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:09.196245  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:09.202771  8294 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:09.200760  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:09.203702  8361 raft_consensus.cc:2368] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6.
I20260709 13:17:09.204917  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:09.211361  8292 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:09.209383  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:09.216929  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:09.152202 11265 raft_consensus.cc:697] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:09.215545  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:09.218035  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:09.222491  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 143742us
I20260709 13:17:09.219211  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.220592  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.224032  8362 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:09.225171  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.228060  8211 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:09.229389  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.230124  8211 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:09.211874 10988 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:09.207126 11222 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.232867  8217 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:17:09.249065  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:09.249781  8217 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:09.250124 11082 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.250696  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.253242 11096 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.233024  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.233394  8219 raft_consensus.cc:2368] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8.
I20260709 13:17:09.233851  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:09.211679 11140 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:09.232424 11308 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.237795  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:09.237902 10998 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.238684  8292 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:09.260152  8362 raft_consensus.cc:2368] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:09.261140  8292 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:09.192165 11307 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.257234  8290 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:09.225847 11274 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.261611  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.264600  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.194105 11309 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:09.221832 11270 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.227075 11155 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:09.269178  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:09.236168 10988 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.272202  8211 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:09.272148  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.273847  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.257979 11269 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:09.277640  8217 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:09.357800  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.365479  8286 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:09.357905  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.367419  8211 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
W20260709 13:17:09.368582  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 89916.1us
I20260709 13:17:09.370424  8362 raft_consensus.cc:2410] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:09.373993  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.271905 11157 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.378612  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 154920us
I20260709 13:17:09.379382  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:09.296734 10988 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.383157  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:09.379194  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:09.385964  8258 leader_election.cc:400] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8.
I20260709 13:17:09.386421  8258 leader_election.cc:403] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:09.387893  8361 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:09.366384 11213 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:09.365262 11090 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:09.265574 11308 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.397816  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:09.393879  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:09.377606 11155 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:09.402598  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:09.406029  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.407068  8216 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:17:09.369689 10932 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:17:09.412436  8889 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:09.413833 11274 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.414299 11112 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:09.376269 11221 consensus_queue.cc:1059] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:09.390530 11027 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.421862  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:09.374866 11269 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.406091 11082 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8.
I20260709 13:17:09.433502  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.422588 11274 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.444487  8361 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:09.425525 11090 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.446549  8216 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:09.430413 11315 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:09.440137 11289 consensus_meta.cc:287] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.003s
I20260709 13:17:09.384389 11265 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.438889 11238 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:09.404125 11157 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.409339 11213 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.429340 11112 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.441980 11309 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:09.481163  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.513648  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:09.514918  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 117193us
I20260709 13:17:09.445958 11274 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:09.526899  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 105111us
I20260709 13:17:09.451223 11315 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.448873 11027 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:09.528980  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 126466us
I20260709 13:17:09.531128  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:09.531513  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:09.530813  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.559656  8928 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:09.559962  8291 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:09.562528  8925 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:09.529871  8183 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:09.520457 11264 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.525002 11309 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:09.527904 10998 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.573522  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:09.565339  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:09.578136  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:09.578176  8364 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:09.579378  8922 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:09.561882 11218 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.529955 11027 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.585042 11027 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.565868 11321 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:09.590268 11118 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:09.590730 11118 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.590529 11321 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.591100 11118 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.586668  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:09.525043 11238 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:09.529879 11315 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.576542 10867 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.614269  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:09.614542  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.616721  8922 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:09.603143 11307 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.604548 10996 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.584976 11218 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.610574 10867 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.612520 10998 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.626961  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:09.629467 11329 log.cc:927] Time spent T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:17:09.629796 10996 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.630293  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:09.564275 11155 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.631111 11218 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:09.631646 11157 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.631732  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:09.631829  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.649770  8361 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 3.
I20260709 13:17:09.632369  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.651235  8364 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:09.592630 11264 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.659169  8366 raft_consensus.cc:2368] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:09.636854 10867 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.671114  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:09.675069 11213 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:09.675638 11213 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:09.682112  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:09.693482  8921 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:09.659943 11339 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:09.669654 11311 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.645493 10998 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.678361 11321 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:09.709142  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:09.682591 11309 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:09.704668 11269 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.703106 11349 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.690312 11308 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.715824  8186 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:09.722148 11337 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:17:09.723417 11112 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.728686 11309 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.729585  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:09.729736 11027 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.712795 11345 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.730695  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:09.737965 11140 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.762380  8212 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:09.762727  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 132525us
I20260709 13:17:09.763661 11349 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:09.764338 11349 consensus_queue.cc:1243] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer d03eaa3ce81042f9b114cd00a7f41b17 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:09.741585  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:09.739343 11118 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.689356 11213 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.758440  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:09.748864 11157 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:09.751240 11264 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.683027 11238 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.771915  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:09.773221  8186 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:09.701949 11311 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.777349  8213 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:09.765086 11331 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.700433 11339 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.771422 11157 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.774075 11343 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:09.778195 11155 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:09.782593 11331 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.782356 11264 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:09.788496 11157 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.787783 11140 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:09.791400 11343 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.804425 11264 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:09.805440 11264 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:09.808292 11140 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:09.768829 11345 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.792382 11155 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:09.798709 11331 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.822310  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:09.863267  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2024) took 1029 ms. Trace:
I20260709 13:17:09.861379  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:09.825376  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.864245  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.825879  8212 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
W20260709 13:17:09.864816  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.797816 11349 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:17:09.863737  8287 rpcz_store.cc:276] 0709 13:17:08.833837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.725307 (+891470us) service_pool.cc:224] Handling call
0709 13:17:09.862824 (+137517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.862990 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.863016 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.863053 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.863080 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.863127 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.863218 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.810531 11343 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.821255 11311 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.817363 11155 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.871650  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:09.883349  8364 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:09.884466  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.885066  8361 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:09.884591  8287 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:09.886216  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:09.886026  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1441) took 1025 ms. Trace:
I20260709 13:17:09.886831  8218 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:09.887036  8287 rpcz_store.cc:276] 0709 13:17:08.860515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.873478 (+1012963us) service_pool.cc:224] Handling call
0709 13:17:09.884391 (+ 10913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.885762 (+  1371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.885970 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.887833  8926 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:09.889349  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.889956  8361 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:17:09.891629 11353 log.cc:927] Time spent T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:17:09.877020 11118 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.897579 11213 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:09.809432 11140 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:09.892622  8287 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:09.907153  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:09.923173 11027 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:10.122516 11343 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.163105 11343 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:10.025513  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.163919  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1442) took 1258 ms. Trace:
I20260709 13:17:10.164410  8287 rpcz_store.cc:276] 0709 13:17:08.905521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.891179 (+985658us) service_pool.cc:224] Handling call
0709 13:17:09.892461 (+  1282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.163649 (+271188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.163861 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.887750 11321 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:10.168668 11321 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:10.169696 11321 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:10.172613 11274 consensus_meta.cc:287] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.001s
I20260709 13:17:10.026082 11349 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:10.173153 11274 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.173483 11349 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:10.147495 10988 consensus_meta.cc:287] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.754s	user 0.004s	sys 0.007s
W20260709 13:17:10.119140 11315 consensus_meta.cc:287] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.505s	user 0.002s	sys 0.007s
I20260709 13:17:10.039624  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2022) took 1164 ms. Trace:
I20260709 13:17:10.175326 11274 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.180017  8286 rpcz_store.cc:276] 0709 13:17:08.833323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.076587 (+243264us) service_pool.cc:224] Handling call
0709 13:17:09.997383 (+920796us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540005c154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:09.997548 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644441856}
W20260709 13:17:10.188614  8293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1426) took 1928 ms (client timeout 1791 ms). Trace:
W20260709 13:17:10.189136  8293 rpcz_store.cc:269] 0709 13:17:08.260001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.265309 (+  5308us) service_pool.cc:224] Handling call
0709 13:17:10.188413 (+1923104us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54001284d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:10.188539 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61357312}
I20260709 13:17:09.938299 11331 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:09.992198  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:10.131178 11157 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:10.163292  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.200932  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:10.030699  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 220536us
I20260709 13:17:09.940795 11345 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:10.200992  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.232746  8216 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:09.993562 11313 log.cc:927] Time spent T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.944s	user 0.000s	sys 0.005s
W20260709 13:17:09.994748 11312 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.158s	user 0.015s	sys 0.000s
I20260709 13:17:10.192198 11118 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.975585 11090 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.232522  8364 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:10.231760 11270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.002s	sys 0.008s
I20260709 13:17:10.194053 10932 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:10.175511 11349 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:10.255623  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1373) took 1766 ms (client timeout 1623 ms). Trace:
W20260709 13:17:10.256510  8220 rpcz_store.cc:269] 0709 13:17:08.488989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.490119 (+  1130us) service_pool.cc:224] Handling call
0709 13:17:10.255398 (+1765279us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001b3d54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:10.255547 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356543872}
I20260709 13:17:09.941118 10867 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.259824  8220 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.261889  8220 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.263986  8220 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:10.265198 11157 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:10.265137  8212 raft_consensus.cc:1217] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[4.2-6.3]   Dedup: 6.3->[]
I20260709 13:17:10.265861  8212 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:17:10.175920 10988 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.178220 11315 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.272224  8295 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
W20260709 13:17:10.253795 11270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.003s	sys 0.008s
I20260709 13:17:10.251684 11118 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.285497 11345 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:10.290030  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 396) took 1520 ms. Trace:
I20260709 13:17:10.297358  8215 rpcz_store.cc:276] 0709 13:17:08.769819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.778418 (+  8599us) service_pool.cc:224] Handling call
0709 13:17:10.285530 (+1507112us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54000366d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:10.289967 (+  4437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745293696}
I20260709 13:17:10.290269  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.286415 11359 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:10.194087 11155 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:10.291365  8295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1432) took 1548 ms (client timeout 1627 ms). Trace:
W20260709 13:17:10.300549  8295 rpcz_store.cc:269] 0709 13:17:08.742957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.991830 (+1248873us) service_pool.cc:224] Handling call
0709 13:17:10.291307 (+299477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.267804 10932 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.244387 11363 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.299466  8361 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:10.300007  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 149969us
I20260709 13:17:10.306270  8214 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:10.307842  8922 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:10.308689  8218 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:10.302456 10867 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.468529  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:10.472877  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 202069us
I20260709 13:17:10.476807  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1728) took 1753 ms. Trace:
I20260709 13:17:10.480851  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:10.482349  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:10.272012 11090 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.496623  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.499053 10932 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:10.434607 11157 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:17:10.500847  8361 raft_consensus.cc:2410] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:17:10.499152  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.477291  8363 rpcz_store.cc:276] 0709 13:17:08.723771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.756860 (+ 33089us) service_pool.cc:224] Handling call
0709 13:17:08.757305 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:08.762523 (+  5218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.762555 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:08.763055 (+   500us) log.cc:844] Serialized 52 byte log entry
0709 13:17:08.839155 (+ 76100us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:09.056478 (+217323us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.236751 (+1180273us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180041c0e0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f3200e093c7 00007f31fd41b9a7 00007f31fd42b0bf 00007f31fd42b038
0709 13:17:10.240727 (+  3976us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.471195 (+230468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.471280 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.476553 (+  5273us) raft_consensus.cc:1685] finished
0709 13:17:10.476580 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.476742 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1109685,"prepare.queue_time_us":1410180,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":7164,"raft.queue_time_us":7560,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":13195,"spinlock_wait_cycles":98577152,"thread_start_us":260928,"threads_started":2,"wal-append.queue_time_us":368878,"wal-append.run_cpu_time_us":2155,"wal-append.run_wall_time_us":1027124}
I20260709 13:17:10.471752 11349 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:10.308573 11363 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:10.521777  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.522068  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1575) took 1261 ms. Trace:
W20260709 13:17:10.522431  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.522873  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.525022  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 51335.5us
I20260709 13:17:10.522409  8218 rpcz_store.cc:276] 0709 13:17:09.247886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.889128 (+641242us) service_pool.cc:224] Handling call
0709 13:17:09.923450 (+ 34322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.309109 (+385659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.508886 (+199777us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400092254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:10.509138 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885453184}
I20260709 13:17:10.492643 11335 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.529706  8363 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:10.530254  8363 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:10.500347 11137 raft_consensus.cc:3055] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:10.514425 11359 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.535955  8360 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:10.541013  8361 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:10.543255 11362 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:17:10.543671 11321 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.534186 11137 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:10.525971 11349 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.538901 11331 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.544104 11321 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.533939 11335 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.571022  8288 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:10.563272  8363 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:10.575073  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 45142.1us
W20260709 13:17:10.577479  8288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1433) took 1818 ms (client timeout 1740 ms). Trace:
W20260709 13:17:10.577849  8288 rpcz_store.cc:269] 0709 13:17:08.758813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.467175 (+1708362us) service_pool.cc:224] Handling call
0709 13:17:10.577408 (+110233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.580519 11358 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:10.581094 11358 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.583348 11358 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:10.584318  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1576) took 1314 ms. Trace:
I20260709 13:17:10.584676  8216 rpcz_store.cc:276] 0709 13:17:09.269457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.939913 (+670456us) service_pool.cc:224] Handling call
0709 13:17:09.940323 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.241068 (+300745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.584103 (+343035us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54001b1a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:10.584263 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672075520}
I20260709 13:17:10.588631  8186 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:10.592072 11270 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.592587 11270 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.592919 11270 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.596840 11157 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:10.598703 11157 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:10.604969 11327 log.cc:927] Time spent T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.182s	user 0.003s	sys 0.000s
I20260709 13:17:10.605918 11270 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.541759 11359 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.544113 11374 consensus_queue.cc:1059] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:17:10.614334  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 91958.2us
I20260709 13:17:10.616732  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:10.617733  8363 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.577003 11321 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.613586 11315 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.577927 11213 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:10.619550 11118 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.632879 11358 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:10.633461 11358 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:10.634441 11338 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.944s	user 0.000s	sys 0.003s
I20260709 13:17:10.634347 11358 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.632922 11374 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.618953 11155 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.636849 10998 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.636683 11374 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.619407 11027 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:10.638157  8921 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:17:10.637952 11027 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.638784 11374 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:10.639292 11374 raft_consensus.cc:3055] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:10.639580 11374 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:10.640837 11357 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.805s	user 0.001s	sys 0.000s
I20260709 13:17:10.645190 11335 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.645686  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:10.637964  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 681) took 2418 ms (client timeout 1807 ms). Trace:
W20260709 13:17:10.646960  8924 rpcz_store.cc:269] 0709 13:17:08.219424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.261160 (+ 41736us) service_pool.cc:224] Handling call
0709 13:17:10.637724 (+2376564us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540065f754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:10.637868 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008341760}
I20260709 13:17:10.648478  8220 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:10.628314 10988 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:10.649830  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:10.649598 11213 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.650575  8215 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:10.651870  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:10.652693  8218 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:10.652251 11137 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.652364 11374 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.653604 11137 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.653542  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:10.654008 11374 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.654451  8219 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:10.655237  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:10.657807  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.658366  8365 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
W20260709 13:17:10.659456 11330 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.133s	user 0.008s	sys 0.003s
I20260709 13:17:10.651779 11213 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:10.665930 11355 log.cc:927] Time spent T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.782s	user 0.000s	sys 0.009s
I20260709 13:17:10.667274  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 418) took 2230 ms. Trace:
I20260709 13:17:10.667452  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2020) took 1834 ms. Trace:
I20260709 13:17:10.668352  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.669181  8186 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:10.667812  8292 rpcz_store.cc:276] 0709 13:17:08.832804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.373459 (+540655us) service_pool.cc:224] Handling call
0709 13:17:09.385081 (+ 11622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.396070 (+ 10989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.396115 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.410389 (+ 14274us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.443348 (+ 32959us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.443389 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.443461 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.666634 (+1223173us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b24002ab048. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa1aa9c4 00007f31fa1a8acb 00007f31fa363dc9 00007f31fa363a55 00007f31fa362fb0 00007f31fcfd9488 00007f31fcfd9be8 00007f31fcfb1398 00007f31fcfac76a 00007f31fcfabbb6
0709 13:17:10.667172 (+   538us) raft_consensus.cc:1685] finished
0709 13:17:10.667190 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.667392 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7184,"raft.queue_time_us":5879,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":17907,"spinlock_wait_cycles":33870720,"thread_start_us":32530,"threads_started":1,"wal-append.queue_time_us":36942}
I20260709 13:17:10.669224  8369 raft_consensus.cc:2410] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:10.672231 10988 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:10.672654 10988 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:10.673027 10988 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.677009 10998 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.677536 10998 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.679646 10998 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:10.680138  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.680398  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1574) took 1432 ms. Trace:
I20260709 13:17:10.680509 11090 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:10.680763  8217 rpcz_store.cc:276] 0709 13:17:09.247561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.250474 (+  2913us) service_pool.cc:224] Handling call
0709 13:17:10.680221 (+1429747us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b540019a854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:10.680344 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60302080}
I20260709 13:17:10.683195 11363 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:10.684971 11359 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:10.689109  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.696919 11339 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:17:10.697553 10932 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.698086 10932 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:10.701004  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.702728 10853 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.703174 10853 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.689695  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2016) took 1889 ms. Trace:
W20260709 13:17:10.713831  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.717137  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 71521.1us
I20260709 13:17:10.719044  8363 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:10.714617  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:10.721359  8363 pending_rounds.cc:85] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:10.718204  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:10.722067  8921 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:10.667637  8289 rpcz_store.cc:276] 0709 13:17:08.436698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.436964 (+   266us) service_pool.cc:224] Handling call
0709 13:17:08.456716 (+ 19752us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:08.479192 (+ 22476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.479225 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:08.489720 (+ 10495us) log.cc:844] Serialized 52 byte log entry
0709 13:17:09.678927 (+1189207us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800397420. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:17:09.765524 (+ 86597us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:09.765561 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.765607 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.665358 (+899751us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:10.667045 (+  1687us) raft_consensus.cc:1685] finished
0709 13:17:10.667066 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.667198 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2431,"raft.queue_time_us":22940,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":22190,"spinlock_wait_cycles":34425472,"thread_start_us":86371,"threads_started":1,"wal-append.queue_time_us":1324652}
I20260709 13:17:10.724196  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:10.721607  8363 pending_rounds.cc:107] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:17:10.725225  8363 raft_consensus.cc:2889] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:10.729346 11274 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.729279 10998 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:10.729650  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:10.729924 11274 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.730304 11274 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.730926 11309 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:10.731348 11309 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:10.731720 11309 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.733129 10996 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:10.733676  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1377) took 2079 ms. Trace:
W20260709 13:17:10.734203 11342 log.cc:927] Time spent T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.003s	user 0.002s	sys 0.000s
I20260709 13:17:10.734045  8214 rpcz_store.cc:276] 0709 13:17:08.654795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.729297 (+1074502us) service_pool.cc:224] Handling call
0709 13:17:10.733466 (+1004169us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b5400199e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:10.733591 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261195520}
I20260709 13:17:10.736030  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2019) took 1903 ms. Trace:
W20260709 13:17:10.736323  8291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1437) took 1949 ms (client timeout 1615 ms). Trace:
W20260709 13:17:10.736820  8291 rpcz_store.cc:269] 0709 13:17:08.786749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.052217 (+265468us) service_pool.cc:224] Handling call
0709 13:17:10.736178 (+1683961us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5400425254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:10.736262 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921644288}
I20260709 13:17:10.736370  8290 rpcz_store.cc:276] 0709 13:17:08.832555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.265240 (+432685us) service_pool.cc:224] Handling call
0709 13:17:09.265621 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.276556 (+ 10935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.276589 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.369099 (+ 92510us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.621128 (+252029us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.621183 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.621269 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.733911 (+1112642us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b24002ab048. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa1aa9c4 00007f31fa1a8acb 00007f31fa363dc9 00007f31fa363a55 00007f31fa36309d 00007f31fcf9510e 00007f31fcfac88c 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221
0709 13:17:10.735759 (+  1848us) raft_consensus.cc:1685] finished
0709 13:17:10.735780 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.735974 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9854,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12407,"spinlock_wait_cycles":60642688,"thread_start_us":204795,"threads_started":1,"wal-append.queue_time_us":305985}
I20260709 13:17:10.645709 11335 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.740176 10932 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.719923 11308 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.740751 10932 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:10.741164 10932 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:10.741533 10932 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.742213  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.742744  8362 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.739912 11335 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.743983  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.746618  8369 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:10.747336  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 399) took 1525 ms. Trace:
I20260709 13:17:10.709036  8294 rpcz_store.cc:276] 0709 13:17:08.800805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.267261 (+466456us) service_pool.cc:224] Handling call
0709 13:17:09.366390 (+ 99129us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:09.389220 (+ 22830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.389264 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:09.401009 (+ 11745us) log.cc:844] Serialized 78 byte log entry
0709 13:17:09.520825 (+119816us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.618480 (+ 97655us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.620338 (+  1858us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.620534 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.620629 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.862047 (+241418us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b18000736c0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa2f22a6 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f
0709 13:17:10.260668 (+398621us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b480027e7d8. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f 00007f3202428f37 00007f320243d55c 00007f320243d508 00007f320243d488 00007f320243d443 00007f320243c6ec 00007f3201366a96
0709 13:17:10.634138 (+373470us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b24002ab048. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa1aa9c4 00007f31fa1a8acb 00007f31fa363dc9 00007f31fa363a55 00007f31fa36309d 00007f31fcf9510e 00007f31fcfac88c 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221
0709 13:17:10.689416 (+ 55278us) raft_consensus.cc:1685] finished
0709 13:17:10.689443 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.689625 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4015,"prepare.queue_time_us":245592,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2700,"raft.queue_time_us":11123,"raft.run_cpu_time_us":3907,"raft.run_wall_time_us":656539,"spinlock_wait_cycles":39681536,"thread_start_us":172596,"threads_started":2,"wal-append.queue_time_us":204320}
I20260709 13:17:10.747856  8213 rpcz_store.cc:276] 0709 13:17:09.221747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.221872 (+   125us) service_pool.cc:224] Handling call
0709 13:17:09.238796 (+ 16924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.781379 (+542583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.747052 (+965673us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400378054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:10.747258 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230157696}
I20260709 13:17:10.712813 11027 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.745458 10988 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.753841 10988 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.753719 11321 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.761502  8362 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:10.762642  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.763140  8362 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.750567  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.764498  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.764856  8363 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:10.765053  8360 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.771406  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:10.775775  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.779316  8261 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:10.779381  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.780094  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 494) took 1707 ms. Trace:
I20260709 13:17:10.780421  8364 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:10.780984  8362 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:10.778077 11217 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:10.780464  8927 rpcz_store.cc:276] 0709 13:17:09.069440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.075000 (+  5560us) service_pool.cc:224] Handling call
0709 13:17:10.775586 (+1700586us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540049a554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:10.776973 (+  1387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441811712}
I20260709 13:17:10.782436  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.783622  8362 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.788971  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.789794  8361 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:10.792208  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.793031  8364 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:10.778864 11308 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.800542  8362 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:10.801594  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.801348  8261 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:10.782383 11345 consensus_queue.cc:1059] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:10.808508 10853 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.808261 11308 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.808928 11345 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:10.809034 10853 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:10.809311 11345 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:10.809588 10853 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.812165  8360 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:10.813023  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.813544  8360 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:10.810329 11308 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:10.816002  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 86425.8us
I20260709 13:17:10.817391  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.797593 11112 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.825742  8361 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:10.822093  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:10.828385  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.829407  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.806339 11270 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:10.830490  8369 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:10.833667  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.830720  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.834182  8360 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.834421  8365 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:10.831430  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.830010  8363 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:10.835585  8364 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.818917 11381 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:10.839777  8332 leader_election.cc:400] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8.
I20260709 13:17:10.840577  8332 leader_election.cc:403] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:10.827172 10853 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:10.810153 11345 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.850834  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.851082 11309 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:10.851493  8291 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:10.851619  8364 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:10.851838 11358 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:10.846120 11385 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:10.837534 11386 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:10.878023 11386 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.878413 11386 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.880329  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.880512 11358 raft_consensus.cc:3055] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:10.880949 11358 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:10.851532 11345 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.861370  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.857787  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:10.856376 11321 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:10.862630  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 61504.3us
I20260709 13:17:10.895874  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:10.836659 11308 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:10.895733  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:10.865731  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.867971  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.869593  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.899227  8295 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:10.871122  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:10.872195  8365 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:10.900028  8287 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.873661  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:10.874534  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.875181  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.857235 11335 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:10.875758  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:10.876353  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:10.876636  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:10.902537  8220 raft_consensus.cc:2393] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:10.877027  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.877586 11385 consensus_queue.cc:1243] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer d03eaa3ce81042f9b114cd00a7f41b17 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:10.881078  8289 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:10.838181 11217 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:10.840380 11381 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:10.889688  8360 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:10.905628  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:10.906180  8360 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.890821  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.890841  8364 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:10.892927  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.893399  8186 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:10.893684  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:10.865638  8892 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:10.906428  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:10.909770  8295 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.864349 11378 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8.
I20260709 13:17:10.831132 11112 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:10.876392 11349 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:10.912755  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47242.6us
I20260709 13:17:10.902221  8927 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:10.913287  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:10.917270  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:10.918349  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:10.924796  8186 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:10.918844  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:10.937094  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:10.925808  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.935966  8364 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:10.937235  8217 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:10.914968  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.938381  8287 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:10.939163  8360 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:10.940377  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:10.939523  8186 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:10.940377  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:10.940742  8213 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:10.938630  8289 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:10.944866  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.919799 11374 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.918735 11027 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.914469 11270 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.960848  8295 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:10.929912 11315 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.944416 11118 raft_consensus.cc:2764] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:17:10.963127 11384 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:17:10.964087 11382 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:10.928627 11308 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.974848  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:10.975854  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.927491 10998 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:10.956091  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:11.021746  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 65742.3us
I20260709 13:17:11.023473  8186 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:10.945164 11155 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:10.927086 11387 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.944610 11339 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:10.957088 11284 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:11.017251  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:11.018471  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:11.001107  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:10.929795 11385 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 13:17:11.030387  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 112088us
I20260709 13:17:11.042387  8293 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:11.042387  8289 raft_consensus.cc:2410] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:11.038216 11140 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:10.980700 11270 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.960386 11388 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:17:10.941087 11358 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.087786  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.089433  8286 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:11.018422 11335 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:17:10.978307 11374 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:11.093153  8892 leader_election.cc:400] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:11.076730 10998 raft_consensus.cc:697] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:11.079643 11140 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:11.132899 11140 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.135143  8927 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:17:11.135671  8924 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:17:11.136586  8921 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:11.137962  8923 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:11.138335  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:11.138859  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:11.139371  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:11.139699  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.139946  8927 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:11.140494  8366 raft_consensus.cc:2393] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:11.139413  8923 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:11.141958  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:11.142537  8921 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.096254 11270 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.144546  8361 raft_consensus.cc:2410] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:17:11.140878  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:11.145744  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 604) took 1510 ms. Trace:
I20260709 13:17:11.145902  8927 raft_consensus.cc:2410] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:17:11.146104  8922 rpcz_store.cc:276] 0709 13:17:09.635722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.648651 (+ 12929us) service_pool.cc:224] Handling call
0709 13:17:11.145571 (+1496920us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54002c33d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:11.145690 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456703872}
I20260709 13:17:11.038534 11155 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:11.038391 10979 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:11.112598 11324 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.691s	user 0.004s	sys 0.000s
I20260709 13:17:11.117030 11112 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.119295 11339 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:11.047927 11381 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.053398 11315 consensus_queue.cc:1059] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:17:11.069980 11284 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:11.127755 11358 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.091332 11309 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:11.129583 11374 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:11.140918  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2185) took 1015 ms. Trace:
I20260709 13:17:11.150630  8921 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:11.176334  8920 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:11.152763 10979 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.154299  8924 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:11.175925  8366 rpcz_store.cc:276] 0709 13:17:10.125547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.187920 (+ 62373us) service_pool.cc:224] Handling call
0709 13:17:11.139575 (+951655us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:11.140860 (+  1285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20602624}
I20260709 13:17:11.180725  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:11.139400  8919 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:11.154177 11386 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.156769 11339 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:11.193699  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 252778us
I20260709 13:17:11.179695 10979 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.148597 10998 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.221681  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.224267 11027 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:11.224843 11027 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.226961 11027 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.230638  8186 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:11.231490  8186 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:11.232851 11090 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:11.233006 11118 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:11.233355 11090 raft_consensus.cc:697] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:11.234246 11090 consensus_queue.cc:237] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:11.238894  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.239411  8889 leader_election.cc:336] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.521s (SENT)
I20260709 13:17:11.175343 10932 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.179188 11274 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.194871 11339 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:11.236518 11381 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:11.243753  8332 connection.cc:256] RPC call timeout handler was delayed by -1.2623566780000601s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 13:17:11.264653  8332 connection.cc:256] RPC call timeout handler was delayed by -1.204756677999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:17:11.264997  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1795566779999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:17:11.265262  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1723566779999146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:17:11.265550  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1687566779999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 13:17:11.265810  8332 connection.cc:256] RPC call timeout handler was delayed by -1.1606566779998957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:17:11.266064  8332 connection.cc:256] RPC call timeout handler was delayed by -1.0670566779999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:17:11.266324  8332 connection.cc:256] RPC call timeout handler was delayed by -1.022056677999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 13:17:11.266610  8332 connection.cc:256] RPC call timeout handler was delayed by -1.0211566779998975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:17:11.217338  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 154764us
I20260709 13:17:11.215332 11323 consensus_queue.cc:1059] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:17:11.271462  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 356140us
I20260709 13:17:11.273988  8295 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:11.259074 11118 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:11.244611 10988 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:17:11.284375  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.286839  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.274940 10979 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.301667  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.242195 11155 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.308600  8183 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:11.272101 11284 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.301117 11359 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:11.314246  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.312834  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:11.319027  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.332363 11386 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.332623 10960 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.333170 11407 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.312911 11402 raft_consensus.cc:2764] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:17:11.333581 11407 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.325443 11349 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:11.334380 11359 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:11.327373 11090 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.344987 10979 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.348500 11407 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.346921 11345 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:17:11.345639 11140 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:17:11.342036 10960 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:17:11.322182 11118 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:11.363744  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 55510.6us
W20260709 13:17:11.432207  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 96293.8us
I20260709 13:17:11.454213  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:11.454957  8367 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.360328 10932 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:11.467885  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 147685us
I20260709 13:17:11.414649 11323 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:11.478044  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:11.465673 11409 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.505093  8183 connection.cc:256] RPC call timeout handler was delayed by -1.3070665459999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:17:11.485885  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:11.510794  8892 leader_election.cc:336] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.757s (SENT)
I20260709 13:17:11.511377  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.414211 11270 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.474191 11323 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:11.541971  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 56142.7us
I20260709 13:17:11.542943  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.539538  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:11.532181  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48744.3us
I20260709 13:17:11.535600  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.451664 11359 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.548132 11274 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:11.551712 11378 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:11.481958 11408 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.568501 11408 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:11.553745  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.553916  8365 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:17:11.569706  8365 pending_rounds.cc:85] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 3
I20260709 13:17:11.569988  8365 pending_rounds.cc:107] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:17:11.570384  8365 raft_consensus.cc:2889] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:11.539204  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:11.558912  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:11.571478  8211 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.559696  8215 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:11.560175  8217 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.563724 11323 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.528452 11349 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:17:11.529615 11417 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:17:11.566912 11270 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.567607  8214 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:11.567721  8287 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:11.529011 11027 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:11.573823  8367 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:11.573915  8219 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:11.586994  8287 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:11.588735 11389 log.cc:927] Time spent T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:17:11.589781  8366 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:11.604157  8211 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:11.605187  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.554884 11339 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.535157 11403 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:11.605425  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.610463  8215 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:11.535274 11112 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:11.569470 11213 raft_consensus.cc:3055] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:11.640676 11401 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.641268 11401 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.647778 11401 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:11.632141 11373 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:17:11.648177 11419 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:11.651592 11373 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:11.648437  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 452250us
I20260709 13:17:11.530009 11409 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.652622  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:11.649605  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 375777us
I20260709 13:17:11.653555 11335 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.653993 11335 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.774935  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.770964  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.775954  8360 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:11.775593  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.776505  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.663087  8925 raft_consensus.cc:1240] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:11.660643  8258 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.661501 11393 consensus_queue.cc:1059] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:17:11.655880  8261 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.812595  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:11.813447  8366 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.643591 11213 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:11.779188 11408 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.711432 11386 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:17:11.816947 11358 raft_consensus.cc:2764] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:17:11.816480 11213 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.817894 11213 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:11.818666 11386 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.819211 11386 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:11.654639 11403 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.659353 10932 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:11.824764 10932 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:11.825903 11386 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.825793 10932 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.829370 11388 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.830484  8369 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:11.833499 11398 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:11.835942  8892 leader_election.cc:336] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.913s (SENT)
I20260709 13:17:11.836400  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:11.841042 11339 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.841706 11339 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:11.843014 11315 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:11.843726 11399 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.560s	user 0.003s	sys 0.000s
I20260709 13:17:11.591403 11407 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.845996 11407 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:11.846700  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1734) took 1086 ms. Trace:
I20260709 13:17:11.847113  8365 rpcz_store.cc:276] 0709 13:17:10.760274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.912108 (+151834us) service_pool.cc:224] Handling call
0709 13:17:10.928679 (+ 16571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.579583 (+650904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.846493 (+266910us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400370854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:11.846644 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436985600}
W20260709 13:17:11.793102  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 250229us
W20260709 13:17:11.793784  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 133201us
I20260709 13:17:11.853554  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:11.856482  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 71750.8us
I20260709 13:17:11.857194  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:11.866454  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2207) took 1047 ms. Trace:
I20260709 13:17:11.643767 11112 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.868089  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.870142  8219 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:11.871042  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.871623  8216 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:17:11.872512  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.873147  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.873706  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.874521  8213 raft_consensus.cc:2410] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:11.874845 11309 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.876389  8365 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:11.866895  8368 rpcz_store.cc:276] 0709 13:17:10.818766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.925610 (+106844us) service_pool.cc:224] Handling call
0709 13:17:10.944867 (+ 19257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.960769 (+ 15902us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:11.001632 (+ 40863us) log.cc:844] Serialized 14 byte log entry
0709 13:17:11.273259 (+271627us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.277248 (+  3989us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.277375 (+   127us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:11.277411 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.277472 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.843164 (+565692us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:11.866181 (+ 23017us) raft_consensus.cc:1685] finished
0709 13:17:11.866272 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.866397 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12786,"prepare.queue_time_us":41131,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":244125,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":2591,"spinlock_wait_cycles":9260672,"thread_start_us":188392,"threads_started":1,"wal-append.queue_time_us":227017}
I20260709 13:17:11.878185  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.883983  8258 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:11.654465 11409 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:11.886124  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:11.887351  8213 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:11.662179 11387 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:11.742733  8287 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.705605 11401 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:11.730033 11027 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.890168  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:11.890987  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.892210  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.892936  8212 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:11.892767  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:11.893517  8295 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:11.886720  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:11.897377  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:11.898393 11396 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:11.896401  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:11.899277  8287 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.661285 11308 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.225s
I20260709 13:17:11.873193 11378 raft_consensus.cc:697] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:11.901899  8215 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.660080 11385 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.227s
I20260709 13:17:11.903333  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.915017  8364 raft_consensus.cc:2368] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8.
I20260709 13:17:11.915874  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:11.903817  8212 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 11. Ops: []
I20260709 13:17:11.883601 11407 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.919912  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.921278  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.922461  8367 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:11.922397  8366 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:11.921983  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:11.924198 11112 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:11.902918 11335 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:11.926299  8360 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.888839 11387 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:11.928416  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.930135  8287 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:17:11.930588  8287 pending_rounds.cc:85] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 6
I20260709 13:17:11.930804  8287 pending_rounds.cc:107] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:17:11.931041  8287 raft_consensus.cc:2889] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:11.931658  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 440) took 1060 ms. Trace:
I20260709 13:17:11.932207  8287 rpcz_store.cc:276] 0709 13:17:10.871432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.955327 (+ 83895us) service_pool.cc:224] Handling call
0709 13:17:10.955638 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.567628 (+611990us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540014f120. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd4131c0 00007f31fd414231 00007f31fd410d8f 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c
0709 13:17:11.931427 (+363799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.931610 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305908992}
I20260709 13:17:11.937223 11378 consensus_queue.cc:237] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:11.939075  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1450) took 1010 ms. Trace:
I20260709 13:17:11.939445  8286 rpcz_store.cc:276] 0709 13:17:10.929001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.942633 (+ 13632us) service_pool.cc:224] Handling call
0709 13:17:10.962591 (+ 19958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.089812 (+127221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.938859 (+849047us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001284d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:11.939010 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279673216}
I20260709 13:17:11.906502 11401 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.948562 11373 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:11.949940 11401 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:11.950178  8216 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:17:11.901767 11027 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:11.952446 10853 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:17:11.903083 11349 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:11.952953 11349 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.949942 11373 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:11.953336 11349 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.970042  8368 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:11.979349  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:11.921599 11385 consensus_queue.cc:1243] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:11.981753  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:11.984792  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.985600  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:11.928804 11321 raft_consensus.cc:2764] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:17:11.993165  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 209631us
I20260709 13:17:11.992508  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:11.971812 11118 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.999202  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:11.994143  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 338311us
W20260709 13:17:12.001431  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 165438us
I20260709 13:17:11.980304 11027 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:12.009847  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:12.011874  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:12.041353  8369 raft_consensus.cc:2410] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:12.010880 11118 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.011281 11409 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.014856 11387 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.029778 11388 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.998323 11385 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.030859 11309 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.046200  8261 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.039361  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:12.049947  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:12.050285 11090 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.052146  8186 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:12.061625  8361 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:17:12.074255  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:12.063563 11387 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:12.082751  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.083609  8928 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEARNER]: Advancing to term 8
I20260709 13:17:12.054944 11140 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:17:12.053542 11425 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:12.067482 11323 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:12.089507  8361 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:12.089479  8186 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:12.076334 11426 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:12.067993 11409 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.067745 11090 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:12.109293  8928 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:17:12.121371  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:12.121366  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1389) took 1202 ms. Trace:
I20260709 13:17:12.122277  8214 rpcz_store.cc:276] 0709 13:17:10.919325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.919522 (+   197us) service_pool.cc:224] Handling call
0709 13:17:12.121106 (+1201584us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54001d4a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:12.121279 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438249216}
I20260709 13:17:12.120844  8928 pending_rounds.cc:85] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 5
I20260709 13:17:12.126618  8928 pending_rounds.cc:107] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:17:12.126935  8928 raft_consensus.cc:2889] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.063884 11385 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:12.144227  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70746.5us
I20260709 13:17:12.144465  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:12.146117  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:12.146651  8928 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.147756  8920 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:12.117370 10960 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:12.117594 11409 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.117765 11323 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:12.085063 10998 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:17:12.190670  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.129518 11315 raft_consensus.cc:3055] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:12.193116  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.190299  8332 connection.cc:256] RPC call timeout handler was delayed by -1.0671149269999205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31770000000000004s for a response
W20260709 13:17:12.198469  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.199133  8922 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:12.184417  8928 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:12.199810  8261 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:12.185932  8287 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:12.120221  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:12.186124  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.201263  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:12.187995  8892 leader_election.cc:400] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8.
I20260709 13:17:12.202610  8892 leader_election.cc:403] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:12.150859  8361 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:12.204242  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.188474  8290 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:12.093297 11408 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:17:12.093770 11349 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.189308  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.194629 11374 raft_consensus.cc:3055] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:12.126391 11426 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:12.192152 10960 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:12.177709 11378 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.195717 11315 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:12.178390 11409 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.223253  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.223850  8286 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:12.208200  8291 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.212313  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.225468  8290 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:12.219969 11335 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:12.212937  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:12.199060  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:12.216797  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.198467 11373 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:12.218536 11309 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.211259  8919 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.216418 11429 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8.
I20260709 13:17:12.227535 11378 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.242668 11378 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:12.214077  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:12.216425 11427 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:12.244004  8919 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:12.244395 11427 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.244660 11398 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:12.214818 10932 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.265992 10932 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.266525  8214 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:17:12.235536  8360 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:12.267743  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:12.269513  8218 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.273135  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:12.236166 11388 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:12.274349  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.274480 11388 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.275085 11388 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.245908  8892 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.206347  8289 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:12.229548 11335 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:12.244838 11427 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:12.247490 11430 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:12.247751 11373 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:12.248893 11432 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:12.250193 11308 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:12.251860  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:12.282377  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 86564us
I20260709 13:17:12.252566  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.286123  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:12.253225  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.253897  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.286942  8295 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:12.254995 11309 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:12.216063 11428 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:12.256282 11118 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:12.289000  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.289069 11428 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.290128  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:12.257490  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.291105  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.291352  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.257375 11385 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:12.221154 11401 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.292227  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.258212 10960 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.292412 11335 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.293196  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.293751 11335 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.294152  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.226181 11090 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.295222 11308 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:12.295295  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.295814 11308 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:12.296373  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.218598 11213 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:12.261407 11349 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:12.262063  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.262949  8294 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:12.234167 11027 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.284423 11339 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.301915 11217 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:12.302800 11217 consensus_queue.cc:1243] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer d03eaa3ce81042f9b114cd00a7f41b17 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:12.303817  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.265161 11429 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.245078 11398 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.306470 11398 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.311664 11027 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:12.278816  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 88239.8us
I20260709 13:17:12.282305  8892 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:12.253150  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.386962  8290 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.254185  8288 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:12.288439 11137 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.296996  8289 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.297803  8287 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:12.300717  8295 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:12.390399  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.391009  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.392107  8295 raft_consensus.cc:2410] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:12.301714 10988 consensus_queue.cc:1059] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:12.304868  8292 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:12.274510 10932 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:12.218102 11374 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:12.402792 11374 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.403879 11374 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:12.404395 11425 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:12.405148  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.312695 11426 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.300478 11321 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.316013 11373 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:12.318512 11433 log.cc:927] Time spent T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.290s	user 0.000s	sys 0.004s
I20260709 13:17:12.320695 11403 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:12.323465 11386 raft_consensus.cc:3055] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:12.328751 11428 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:12.330467  8218 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.331780  8294 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:12.296710 11308 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.300285 11323 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.333204 11315 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.434885 11315 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.335638  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:12.436841  8360 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:12.341373 11358 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:12.342152 11359 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:12.287962 11409 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.401680  8292 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:12.408612  8290 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:12.408460  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 126253us
I20260709 13:17:12.439937  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:12.440811  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:12.409575  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 74759.6us
I20260709 13:17:12.411077  8889 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:12.412881  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 78142us
I20260709 13:17:12.443454  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:12.412935  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.429332  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.444198  8287 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:12.456219  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:12.414785 11429 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:12.456877  8928 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:12.426784 11217 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.460728  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 49721.4us
I20260709 13:17:12.469666  8889 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:12.412695 11425 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:12.425777 11386 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:12.477005  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 211314us
I20260709 13:17:12.477130  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.477900  8287 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:12.439149 11359 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:12.480109  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:12.485024  8211 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:12.420790 11381 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:12.460162 11137 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:12.464363 11442 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.489197  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:12.464270 11339 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:12.468701 11213 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:12.550802  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:12.473696 11428 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:12.542707  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:12.482713 11429 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:12.465202 11427 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:12.571455  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 110473us
I20260709 13:17:12.572408  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:12.573557  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.543637 11339 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:12.575722  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.476584 11118 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:17:12.578004 11385 consensus_queue.cc:1059] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:12.578668 11137 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:12.578013 11349 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:12.581934 11425 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.549882 11213 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:12.587306  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.480489 11373 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:17:12.588896 11358 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.589306 11274 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:12.593226 11349 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:12.593827 11155 raft_consensus.cc:3055] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:12.593686 11398 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.594826  8294 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:17:12.651062  8294 pending_rounds.cc:85] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 5
I20260709 13:17:12.651341  8294 pending_rounds.cc:107] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:17:12.651654  8294 raft_consensus.cc:2889] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.594558 11359 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.596175 11409 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:12.563813 11428 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:12.599916  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.606295  8293 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:12.641155  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 53943.7us
I20260709 13:17:12.641726  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:12.665345  8360 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.665490  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.666775  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:12.641788  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 171132us
I20260709 13:17:12.482254 11217 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.668111  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:12.587066 11339 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:12.670140  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 269365us
I20260709 13:17:12.643008 11213 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.677224  8286 raft_consensus.cc:2368] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7.
I20260709 13:17:12.652621 11385 consensus_queue.cc:1243] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:12.652211 11378 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:12.681411  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:12.690317  8360 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:12.650735 11155 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:12.694569  8294 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:12.698901  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:12.699692  8928 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:12.700237  8919 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.704823  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:12.648546 11429 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:12.705482  8928 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.675452 11381 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.675380 11359 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.717432  8928 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:12.720361  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:12.720513  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:12.681928 11137 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.663460 11274 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.586061 11388 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.584035 11386 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:12.743498  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:12.702826 11323 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:12.700616 11358 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.699954 11027 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.782773  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:12.783372  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.783797  8928 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
W20260709 13:17:12.777886  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.781005  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:12.700989 11442 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:17:12.871224  8291 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:12.848856  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.980576  8365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.002s	sys 0.006s
I20260709 13:17:12.894829  8289 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:12.980086  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 267245us
W20260709 13:17:12.983930  8365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.002s	sys 0.006s
W20260709 13:17:12.791723  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.044914  8925 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:13.033082  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.784196 11385 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.916168 11429 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.731091 11449 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.409s
I20260709 13:17:12.907589 11428 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:13.044413  8287 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
W20260709 13:17:13.032645  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 251709us
I20260709 13:17:12.908207 11427 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.147800  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.185057  8286 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:17:12.957808 11315 consensus_meta.cc:287] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.004s
I20260709 13:17:12.786629 11323 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:12.984135 11459 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.090142  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:13.182906  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:13.254944  8289 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:13.255101  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 72268.5us
W20260709 13:17:13.096566  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 52525.6us
I20260709 13:17:12.896126 11155 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:12.914932 11274 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.147105 11385 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.252110 11308 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:13.242493 11374 consensus_meta.cc:287] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.838s	user 0.017s	sys 0.000s
I20260709 13:17:12.784821 11137 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:13.293413 11137 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:13.225613 11323 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.296983 11387 raft_consensus.cc:3055] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:13.297395 11387 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:13.298233 11387 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:13.299279 11387 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.299221 11449 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:13.258899 11459 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:13.313171 11339 consensus_meta.cc:287] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 13:17:13.313685 11339 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.322384  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:13.323573  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.324724  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.217514  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:12.985268 11027 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:13.341163  8361 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:13.092944 11309 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.913806 11217 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:12.788314 11349 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.041631 11398 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.255950  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:13.357836  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 101962us
I20260709 13:17:13.182955 11450 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:13.237836 11454 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:17:13.226140 11315 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.237221 11458 log.cc:927] Time spent T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:17:13.193758  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.260834  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:13.365670  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:13.366273  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 105506us
I20260709 13:17:13.366725  8361 raft_consensus.cc:2410] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:13.365094  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.367511  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:13.264789 11465 log.cc:927] Time spent T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:13.264868  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:13.265663  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:13.268790  8287 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:13.269555 11401 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.269486  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.371928  8368 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:13.370260  8294 raft_consensus.cc:2376] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9. Re-sending same reply.
I20260709 13:17:13.270303  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:13.270615  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.271277  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.373250  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:13.373633  8360 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:13.271802 11456 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:13.272490 11155 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:13.275041 11466 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:17:13.257720 11388 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.278656  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:13.393792  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 115208us
I20260709 13:17:13.394419  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:13.282708 11358 raft_consensus.cc:3055] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:13.285372  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2026) took 1034 ms. Trace:
I20260709 13:17:13.397516  8294 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:13.397660  8291 rpcz_store.cc:276] 0709 13:17:12.251399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.251618 (+   219us) service_pool.cc:224] Handling call
0709 13:17:13.285167 (+1033549us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400387a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:13.285311 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345468800}
W20260709 13:17:13.286015 11359 consensus_meta.cc:287] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.001s
W20260709 13:17:13.257423 11213 consensus_meta.cc:287] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:17:13.289981 11385 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:13.326574  8289 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:12.784723 11378 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.432s
I20260709 13:17:13.342585  8367 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 11. Ops: []
I20260709 13:17:13.414865  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.386849 11137 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.343978 11027 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.389396 11429 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.355553 11459 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:13.341099 11339 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:13.238756 11448 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:17:13.373677  8366 pending_rounds.cc:85] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 3
W20260709 13:17:13.272243 11445 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260709 13:17:13.373261  8292 raft_consensus.cc:2368] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 6. Current term is 7.
I20260709 13:17:13.382215  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:13.383641  8920 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.440194  8921 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:13.440485  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.386329  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:13.388334  8114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 188) took 25206 ms (client timeout 15000 ms). Trace:
I20260709 13:17:13.388206  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.363088 11393 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.443101  8186 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:13.394694  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:13.394984  8925 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.400501  8261 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:13.444536  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44103.7us
I20260709 13:17:13.445236  8261 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:13.403650  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:13.445554  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:13.406426  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1600) took 1077 ms. Trace:
I20260709 13:17:13.371627 11217 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.371773 11398 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.370767 11335 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.450742  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:13.412484  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.343225  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:13.416430  8367 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:13.418440  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.453116  8291 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:13.388099 11401 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.386924 11449 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:17:13.397065 11358 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:13.436697  8366 pending_rounds.cc:107] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:17:13.389003 11468 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.370005 11315 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.393270 11456 raft_consensus.cc:697] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:13.411911 11428 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.412256 11442 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.489517 11442 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:13.489964 11442 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.490293 11466 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:13.490788 11466 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:13.492003  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.439033  8889 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:13.439265  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.442701  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:13.442775  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:13.443168  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2242) took 1107 ms. Trace:
I20260709 13:17:13.447345  8286 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 5: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:13.447731  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 53118.1us
I20260709 13:17:13.448182  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.448448  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.449131  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:13.364064 11450 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.446244  8212 rpcz_store.cc:276] 0709 13:17:12.329528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.350007 (+ 20479us) service_pool.cc:224] Handling call
0709 13:17:12.350277 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:12.350487 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:12.350790 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 13:17:12.562282 (+211492us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.281588 (+719306us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b180023b240. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa324522 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:13.405994 (+124406us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b180023b240. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287 00007f31fd42c208
0709 13:17:13.406131 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:13.406174 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:13.406215 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.406275 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.406374 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":854370,"prepare.queue_time_us":604,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":875155,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":19111,"spinlock_wait_cycles":32812032,"thread_start_us":192937,"threads_started":1,"wal-append.queue_time_us":236163}
W20260709 13:17:13.502933  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 63976.5us
I20260709 13:17:13.456113 11274 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:13.441422  8114 rpcz_store.cc:269] 0709 13:16:48.206819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:48.207014 (+   195us) service_pool.cc:224] Handling call
0709 13:17:13.388263 (+25181249us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:08.875947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:08.876654 (+   707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:08.876700 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:17:08.876718 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:08.877635 (+   917us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:08.877706 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:08.877733 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:17:08.878564 (+   831us) tablet.cc:701] Row locks acquired
0709 13:17:08.878608 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:17:08.878793 (+   185us) write_op.cc:270] Start()
0709 13:17:08.878934 (+   141us) write_op.cc:276] Timestamp: P: 1783603028878722 usec, L: 0
0709 13:17:08.878950 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:17:09.109013 (+230063us) log.cc:844] Serialized 3231 byte log entry
0709 13:17:09.705526 (+596513us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd40ce28 00007f3200e47581 00007f3200e46d58 00007f3200e4b9f1 00007f3200e4b9a9 00007f3200e4b939 00007f3200e4b901 00007f3200e4ab2d 000000000038f354 000000000038f199
0709 13:17:09.808483 (+102957us) op_driver.cc:464] REPLICATION: finished
0709 13:17:09.928206 (+119723us) write_op.cc:301] APPLY: starting
0709 13:17:09.928338 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:09.928596 (+   258us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:09.928664 (+    68us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:09.929969 (+  1305us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:09.930338 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:17:09.930399 (+    61us) write_op.cc:312] APPLY: finished
0709 13:17:09.930807 (+   408us) log.cc:844] Serialized 65 byte log entry
0709 13:17:09.931028 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:09.931185 (+   157us) write_op.cc:454] Released schema lock
0709 13:17:09.931259 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:09.931707 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:09.931745 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1202178,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":114018,"apply.run_cpu_time_us":3548,"apply.run_wall_time_us":8860,"num_ops":8,"prepare.queue_time_us":308412,"prepare.run_cpu_time_us":24844,"prepare.run_wall_time_us":829782,"raft.queue_time_us":73514,"raft.run_cpu_time_us":51243,"raft.run_wall_time_us":69105,"replication_time_us":929359,"spinlock_wait_cycles":281091328,"thread_start_us":464068,"threads_started":4,"wal-append.queue_time_us":313940,"wal-append.run_cpu_time_us":10934,"wal-append.run_wall_time_us":1508596}]]}
I20260709 13:17:13.464144 11270 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.457242  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:13.458712  8261 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:13.459467  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:13.535480  8289 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.535781  8219 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:13.420320  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.461889  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2246) took 1082 ms. Trace:
I20260709 13:17:13.462009  8368 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:13.463713  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.466795  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:13.466909  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:13.538069  8213 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.537148  8365 rpcz_store.cc:276] 0709 13:17:12.379641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.379765 (+   124us) service_pool.cc:224] Handling call
0709 13:17:12.422123 (+ 42358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.427655 (+  5532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.427693 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.428240 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.045280 (+617040us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:13.045343 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.045442 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.461686 (+416244us) raft_consensus.cc:1685] finished
0709 13:17:13.461709 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.461838 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12860,"raft.queue_time_us":14727,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10621,"spinlock_wait_cycles":677504,"thread_start_us":558872,"threads_started":1,"wal-append.queue_time_us":711200}
I20260709 13:17:13.467196  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:13.475121  8363 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:13.475993  8366 raft_consensus.cc:2889] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.476215  8925 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:13.414672 11213 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.447599 11396 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.543354  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:13.543406  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 84768.2us
I20260709 13:17:13.544552  8261 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:13.545614  8186 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:13.480628  8291 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.481073  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:13.546905  8928 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:17:13.450608 11385 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.493530  8287 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:17:13.456799  8218 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:13.462648 11398 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.506862  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:13.554353  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 47572.2us
I20260709 13:17:13.555316  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:13.506500 11456 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.475605 11388 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.507293  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:13.507880 11466 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:13.571419  8291 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:17:13.571810  8291 pending_rounds.cc:85] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 6
I20260709 13:17:13.572142  8291 pending_rounds.cc:107] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:13.572369  8291 raft_consensus.cc:2889] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.572652  8291 pending_rounds.cc:107] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:13.508423 11468 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.570519  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:13.510248 11450 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.513886 11428 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.515559 11401 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.516263 11331 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:13.516917 11118 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:13.498649  8362 rpcz_store.cc:276] 0709 13:17:12.335439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.335547 (+   108us) service_pool.cc:224] Handling call
0709 13:17:12.335859 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:12.406091 (+ 70232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:12.406121 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:12.406702 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 13:17:12.659584 (+252882us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:12.659619 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:12.659682 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:13.442982 (+783300us) raft_consensus.cc:1685] finished
0709 13:17:13.443000 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:13.443114 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63233,"raft.queue_time_us":63415,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":252512,"threads_started":1,"wal-append.queue_time_us":318001}
W20260709 13:17:13.521150 11457 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.812s	user 0.003s	sys 0.000s
I20260709 13:17:13.525743  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:13.527451  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.588605  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.436997 11429 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.536796  8294 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:13.556852 11387 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.572789  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:13.569476  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.570693  8220 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:13.572870  8291 raft_consensus.cc:2889] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.574340  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:13.464444 11335 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.575019  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:13.547880 11270 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.610011  8220 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:13.587103  8289 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:13.557003 11393 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.604315  8216 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:13.568166 11427 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.602833  8218 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:13.607439  8217 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:13.574332 11468 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.562979 11480 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:13.613420  8286 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.628589  8215 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:13.625322  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 940908us
I20260709 13:17:13.631233  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:13.590620 11321 raft_consensus.cc:3055] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:13.606967 11466 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.634982  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:13.640558  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 81698.4us
I20260709 13:17:13.613824 11270 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:13.655361  8889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.501s (SENT) [suppressed 25 similar messages]
I20260709 13:17:13.658699  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:13.625317 11427 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.578951 11323 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.628342 11468 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.604796 11331 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.586745 11358 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:13.645368 11403 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:13.642513 11321 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:13.685278  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.646360 11480 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:13.689041 11444 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.665701 11427 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.670614 11393 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.662225 11466 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.753369  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.681705 10853 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:17:13.763511 11315 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:13.768332  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 111285us
I20260709 13:17:13.696081 11378 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.696964 11393 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:17:13.785308  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 150429us
I20260709 13:17:13.792635 11373 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.793171 11373 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:13.795133 11373 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:13.795564 11373 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.795981 11373 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:13.804594 11358 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.809077  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.810328  8368 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:13.812320  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:13.813097  8369 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:13.816431  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.816962 11443 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.817687 11443 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.821281  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.822433  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.707784 11403 raft_consensus.cc:697] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:13.852872  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:13.852613 11403 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.854624 11331 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:13.854172  8922 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:13.726729 10932 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:13.857065  8289 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:13.857350  8364 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:13.755698 11217 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:13.859694  8364 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:13.859709  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.861286  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.695775 11444 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:17:13.862387  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:13.866181  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:13.867436  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:13.867592  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:13.878947  8218 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:13.807886 11373 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:13.823010  8367 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:13.874504  8290 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:13.862444  8216 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:13.786341 11396 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.787214 11393 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:13.886435  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.784655 11481 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.884529 11331 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:13.878984 10932 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.903887 10932 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:13.860574 11213 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.825556 11378 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:13.955034  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.892397 11401 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:13.904722 11481 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:13.971117  8216 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:13.942065 11482 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.976006  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 189841us
W20260709 13:17:13.983968  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 328600us
I20260709 13:17:13.996021  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:14.002084  8213 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:13.884732 11217 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.959728 11398 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.012370  8219 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.953008 11443 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.948805 11335 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:14.019824  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.020604  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:13.965610 11429 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:13.974817 11213 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:14.031111  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:13.960441 11428 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:13.877761 11321 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.915681 11396 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:13.979596 11481 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:14.017856 11490 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.270s	user 0.002s	sys 0.000s
I20260709 13:17:13.983366 11401 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:14.144591  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.036599 11443 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.033519 11381 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.032644 11449 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.121333 11373 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:14.256927  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 265642us
I20260709 13:17:14.258666  8919 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:17:14.338773  8369 consensus_meta.cc:287] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.525s	user 0.019s	sys 0.014s
I20260709 13:17:14.039745 11429 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.012214 11482 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.364377 11466 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.244431 11323 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:14.365734 11482 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:13.906133 11480 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.366185 11429 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.368251 11429 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:14.368765 11477 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:14.369212 11477 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.369552 11477 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.373337  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:14.374327 11155 consensus_meta.cc:287] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.978s	user 0.009s	sys 0.001s
W20260709 13:17:14.252159 11413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.014s	sys 0.024s
W20260709 13:17:14.306066  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.340484  8369 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:14.108338 11213 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.343855  8215 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:14.312080 11381 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.312644 11374 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:17:14.342625 11373 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:14.349155 11500 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:17:14.349545 11491 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.329s	user 0.000s	sys 0.000s
I20260709 13:17:14.354737 11476 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:14.356151 11472 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:14.342975 11479 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.570s	user 0.000s	sys 0.001s
W20260709 13:17:14.361043  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.361083  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1753) took 1037 ms. Trace:
I20260709 13:17:14.365643  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:14.339789  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 615) took 1637 ms. Trace:
I20260709 13:17:14.380506  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:14.376009 11501 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.388255  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:14.390897 11466 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.402920  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:14.577140  8212 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
W20260709 13:17:14.520701  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.584870 11385 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:14.585237 11213 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:14.310165 11321 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.580284  8919 rpcz_store.cc:276] 0709 13:17:12.702037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.702190 (+   153us) service_pool.cc:224] Handling call
0709 13:17:12.702572 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.225840 (+1523268us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400516e20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd4131c0 00007f31fd414231 00007f31fd410d8f 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c
0709 13:17:14.339485 (+113645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.339725 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645159296}
W20260709 13:17:14.375321 11284 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.022s	sys 0.036s
I20260709 13:17:14.581100  8366 rpcz_store.cc:276] 0709 13:17:13.323545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.373066 (+ 49521us) service_pool.cc:224] Handling call
0709 13:17:13.373372 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:13.551550 (+178178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.551595 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:13.552257 (+   662us) log.cc:844] Serialized 52 byte log entry
0709 13:17:13.788368 (+236111us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:13.788409 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.788473 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.360874 (+572401us) raft_consensus.cc:1685] finished
0709 13:17:14.360893 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.361026 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5680,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":14131,"thread_start_us":204205,"threads_started":1,"wal-append.queue_time_us":476731}
I20260709 13:17:14.585474 11385 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:14.384716 11413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.014s	sys 0.025s
I20260709 13:17:14.574625 11466 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:14.471212 11442 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.981s	user 0.010s	sys 0.000s
W20260709 13:17:14.437561  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 44387us
W20260709 13:17:14.594835  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.549446 11486 log.cc:927] Time spent T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.792s	user 0.003s	sys 0.000s
W20260709 13:17:14.424265 11494 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:17:14.425215 11497 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.114s	user 0.002s	sys 0.005s
I20260709 13:17:14.550704  8288 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:14.650691  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2065) took 1385 ms. Trace:
I20260709 13:17:14.651067  8288 rpcz_store.cc:276] 0709 13:17:13.265744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.268146 (+  2402us) service_pool.cc:224] Handling call
0709 13:17:14.550071 (+1281925us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:17:14.550298 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.650445 (+100147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.650637 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50736896}
W20260709 13:17:14.617748  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.005s	sys 0.013s
W20260709 13:17:14.481532 11027 consensus_meta.cc:287] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.041s	user 0.007s	sys 0.003s
W20260709 13:17:14.652244  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.005s	sys 0.013s
I20260709 13:17:14.626516  8213 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4.
W20260709 13:17:14.429143 11309 consensus_meta.cc:287] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.074s	user 0.014s	sys 0.000s
I20260709 13:17:14.590399 11444 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:14.594668 11284 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.024s	sys 0.039s
I20260709 13:17:14.589243 11373 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.344234 11449 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.589624 11381 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:14.672691  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 1.12657e+06us
I20260709 13:17:14.673817  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:14.311183 11443 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.677559 11443 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:14.508271 11323 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.678159 11323 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:14.679735  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.680171  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.680207 11323 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:14.652582  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 610408us
I20260709 13:17:14.681531  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2255) took 1088 ms. Trace:
I20260709 13:17:14.682502  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:14.628115 11358 consensus_meta.cc:287] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.011s
I20260709 13:17:14.684209 11358 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:14.684753 11358 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.686713 11358 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:14.687211 11358 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:14.632156 11508 log.cc:927] Time spent T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:17:14.688794  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1468) took 1275 ms. Trace:
I20260709 13:17:14.689309  8292 rpcz_store.cc:276] 0709 13:17:13.413589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.544341 (+130752us) service_pool.cc:224] Handling call
0709 13:17:13.544711 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.545107 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.545140 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.558180 (+ 13040us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.870772 (+312592us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:13.870811 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.870873 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.688543 (+817670us) raft_consensus.cc:1685] finished
0709 13:17:14.688572 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.688724 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3703,"raft.queue_time_us":5708,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":11806,"thread_start_us":300192,"threads_started":1,"wal-append.queue_time_us":414331}
I20260709 13:17:14.595466 11378 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:14.692391 11378 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.692843 11378 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.613885 11428 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:14.694774 11466 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.695308 11466 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:14.653229 11487 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:17:14.695988 11466 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:14.640303 11409 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.006s	sys 0.018s
W20260709 13:17:14.696803 11409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.006s	sys 0.018s
I20260709 13:17:14.697330 11385 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.697710  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1756) took 1369 ms. Trace:
I20260709 13:17:14.698311  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2258) took 1088 ms. Trace:
I20260709 13:17:14.698709  8361 rpcz_store.cc:276] 0709 13:17:13.610107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.611364 (+  1257us) service_pool.cc:224] Handling call
0709 13:17:13.611631 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.611845 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.611880 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.625748 (+ 13868us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.859224 (+233476us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:13.859272 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.859352 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.698126 (+838774us) raft_consensus.cc:1685] finished
0709 13:17:14.698149 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.698262 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":174938,"threads_started":1,"wal-append.queue_time_us":470965}
I20260709 13:17:14.698107  8360 rpcz_store.cc:276] 0709 13:17:13.328117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.388180 (+ 60063us) service_pool.cc:224] Handling call
0709 13:17:13.388548 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.487478 (+ 98930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.487510 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.487953 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.636422 (+148469us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:13.636479 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.636570 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.549077 (+912507us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b24002c5118. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa1aa9c4 00007f31fa1a8acb 00007f31fa363dc9 00007f31fa363a55 00007f31fa36309d 00007f31fcf9510e 00007f31fcfac88c 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221
0709 13:17:14.697424 (+148347us) raft_consensus.cc:1685] finished
0709 13:17:14.697445 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.697652 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1294,"raft.queue_time_us":29390,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":14494,"spinlock_wait_cycles":68085632,"thread_start_us":159125,"threads_started":2,"wal-append.queue_time_us":129707}
I20260709 13:17:14.700714  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 451) took 1194 ms. Trace:
I20260709 13:17:14.701090  8287 rpcz_store.cc:276] 0709 13:17:13.506042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.568601 (+ 62559us) service_pool.cc:224] Handling call
0709 13:17:13.568957 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.573695 (+  4738us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.573723 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.576317 (+  2594us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.714987 (+138670us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:13.715042 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.715139 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.700500 (+985361us) raft_consensus.cc:1685] finished
0709 13:17:14.700523 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.700663 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4354,"raft.queue_time_us":5116,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":10445,"thread_start_us":104460,"threads_started":1,"wal-append.queue_time_us":807162}
I20260709 13:17:14.628607 11401 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:14.592343 11501 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.706084 11501 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.706336  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:14.707187  8919 raft_consensus.cc:2410] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:17:14.707417 11270 consensus_meta.cc:287] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.037s	user 0.006s	sys 0.012s
I20260709 13:17:14.707945  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:14.709937  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:14.710664  8919 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:14.710822  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:14.653316 11403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.000s	sys 0.029s
I20260709 13:17:14.696481 11466 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.670439 11449 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.727802  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:14.695024 11428 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:14.657743 11456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.012s	sys 0.018s
I20260709 13:17:14.711581  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:14.712033  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.712222  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:14.659672  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1609) took 1201 ms. Trace:
I20260709 13:17:14.403075 11429 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.253s
I20260709 13:17:14.590749 11476 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.698050 11385 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.681895  8363 rpcz_store.cc:276] 0709 13:17:13.593081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.593186 (+   105us) service_pool.cc:224] Handling call
0709 13:17:13.593546 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.593727 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.593747 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.594136 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 13:17:13.924974 (+330838us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:13.925012 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:13.925112 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.681330 (+756218us) raft_consensus.cc:1685] finished
0709 13:17:14.681349 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.681478 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53504,"thread_start_us":282988,"threads_started":1,"wal-append.queue_time_us":493390}
I20260709 13:17:14.729668  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:14.783762  8921 raft_consensus.cc:2410] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:14.687623 11358 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.664263 11309 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:14.713164 11481 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.003s
W20260709 13:17:14.714336 11403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.000s	sys 0.029s
W20260709 13:17:14.714329 11491 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:14.639573 11442 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.748701  8212 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
W20260709 13:17:14.782567 11388 consensus_meta.cc:287] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.184s	user 0.012s	sys 0.000s
W20260709 13:17:14.731308 11468 consensus_meta.cc:287] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.045s	user 0.014s	sys 0.005s
I20260709 13:17:14.748842  8211 rpcz_store.cc:276] 0709 13:17:13.457918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.460832 (+  2914us) service_pool.cc:224] Handling call
0709 13:17:13.461132 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:13.461361 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:13.486356 (+ 24995us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.363634 (+877278us) spinlock_profiling.cc:243] Waited 981 us on lock 0x7b180043a800. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb123a 00007f31fd41ba2a
0709 13:17:14.659264 (+295630us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.659321 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:14.659369 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.659442 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.659560 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24808,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":5924,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":1041,"spinlock_wait_cycles":2256128,"thread_start_us":289567,"threads_started":1}
W20260709 13:17:14.765875  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.803944  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.714155 11396 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:14.748554 11456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.012s	sys 0.018s
W20260709 13:17:14.808228  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 75743.8us
I20260709 13:17:14.659070 11027 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.665105 11444 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.707795 11270 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.616197 11472 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:14.803254  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 129463us
I20260709 13:17:14.753134 11323 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.805002  8293 raft_consensus.cc:2410] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:17:14.805191  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 122741us
I20260709 13:17:14.694787 11378 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:14.786103 11339 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:14.809942 11468 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.837055 11339 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.794271 11481 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.839144 11339 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:14.836256  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:14.839937 11481 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.840442 11378 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.842090  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:14.826948  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 237170us
I20260709 13:17:14.809176 11217 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.833189  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:14.851243 11386 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.851334  8261 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:14.852084 11456 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.852998 11456 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.854806  8217 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:14.855556 11270 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.855743  8261 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:14.856724 11456 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:14.846709 11378 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:14.858527 11378 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.859016 11378 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:14.862037 11505 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.380s	user 0.001s	sys 0.002s
I20260709 13:17:14.863276  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1472) took 1004 ms. Trace:
I20260709 13:17:14.866182 11274 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:14.863651  8286 rpcz_store.cc:276] 0709 13:17:13.858390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.858498 (+   108us) service_pool.cc:224] Handling call
0709 13:17:13.858781 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.863632 (+  4851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:13.863661 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:13.864964 (+  1303us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.003472 (+138508us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:14.003513 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.003590 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.861502 (+857912us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:14.862987 (+  1485us) raft_consensus.cc:1685] finished
0709 13:17:14.863009 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.863214 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":5867,"spinlock_wait_cycles":3770112,"thread_start_us":138161,"threads_started":1,"wal-append.queue_time_us":448273}
I20260709 13:17:14.870162 11381 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.835125 11315 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.872530 11315 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.858711 11476 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:14.876127  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2061) took 1611 ms. Trace:
I20260709 13:17:14.876304  8216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:14.877463  8216 raft_consensus.cc:606] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:14.812698 11309 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:14.840580  8219 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.844281 11323 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.878261 11309 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.880899  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 514) took 1501 ms. Trace:
I20260709 13:17:14.812492 11396 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.881333  8928 rpcz_store.cc:276] 0709 13:17:13.379162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.379298 (+   136us) service_pool.cc:224] Handling call
0709 13:17:13.379615 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:13.547370 (+167755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.880644 (+1333274us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54001e78d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:14.880837 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384029440}
I20260709 13:17:14.881785 11396 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:14.884770 11358 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:14.885661  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 515) took 1505 ms. Trace:
I20260709 13:17:14.886548 11442 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:17:14.886023  8924 rpcz_store.cc:276] 0709 13:17:13.380235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.380367 (+   132us) service_pool.cc:224] Handling call
0709 13:17:13.399068 (+ 18701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:13.626654 (+227586us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:13.653607 (+ 26953us) log.cc:844] Serialized 14 byte log entry
0709 13:17:13.755953 (+102346us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:14.353795 (+597842us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b1800453820. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:14.357373 (+  3578us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b2c00047618. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fbd0aa11 00007f31fbd1a372 00007f31fd44ca01 00007f31fd41143a 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:17:14.357776 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.357898 (+   122us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:14.357931 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.358740 (+   809us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540046c3d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:14.358778 (+    38us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.696442 (+337664us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b1800453820. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa324522 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:14.885371 (+188929us) raft_consensus.cc:1685] finished
0709 13:17:14.885403 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.885590 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43645,"prepare.queue_time_us":137305,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":760,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":13739,"spinlock_wait_cycles":666659200,"thread_start_us":113220,"threads_started":2,"wal-append.queue_time_us":263580}
W20260709 13:17:14.888401 11427 consensus_meta.cc:287] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.183s	user 0.009s	sys 0.003s
I20260709 13:17:14.888808 11427 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:14.891868 11393 consensus_meta.cc:287] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.954s	user 0.008s	sys 0.011s
I20260709 13:17:14.892294 11393 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:14.803417  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:14.804953 11388 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.841746 11444 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.843025  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:14.833108  8923 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.846081 11513 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.846201 11477 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:14.845459  8183 connection.cc:256] RPC call timeout handler was delayed by -1.8099289330000374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3054s for a response
I20260709 13:17:14.876538  8293 rpcz_store.cc:276] 0709 13:17:13.264463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.264580 (+   117us) service_pool.cc:224] Handling call
0709 13:17:14.875893 (+1611313us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54002bcad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:14.876066 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3299531648}
W20260709 13:17:14.934864  8183 connection.cc:256] RPC call timeout handler was delayed by -1.681406620999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3295s for a response
W20260709 13:17:14.935393  8183 connection.cc:256] RPC call timeout handler was delayed by -1.671506620999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3306s for a response
W20260709 13:17:14.935815  8183 connection.cc:256] RPC call timeout handler was delayed by -1.6164289329999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3269s for a response
W20260709 13:17:14.936299  8183 connection.cc:256] RPC call timeout handler was delayed by -1.3130154089999451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:17:14.936697  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0488135260000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:17:14.937067  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0380135259999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 13:17:14.937767  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:14.877977  8216 raft_consensus.cc:614] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:14.833818  8291 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:14.938122  8115 catalog_manager.cc:5697] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 3 to 7, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 7 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:14.940781  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1474) took 1080 ms. Trace:
I20260709 13:17:14.941254  8291 rpcz_store.cc:276] 0709 13:17:13.860607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.860716 (+   109us) service_pool.cc:224] Handling call
0709 13:17:13.860951 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.939136 (+1078185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.940485 (+  1349us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54001270d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:14.940691 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191097728}
I20260709 13:17:14.857998  8261 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:14.943507  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 85575.5us
I20260709 13:17:14.944336  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:14.904161  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:14.910286  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 67323.5us
W20260709 13:17:14.906777 11349 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.002s	sys 0.014s
I20260709 13:17:14.978598  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:14.979832  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:14.946643  8212 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:14.977771  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:14.940828  8115 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 3 to 7, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.908748 11339 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:14.986546  8115 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:14.956722 11217 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:15.015941  8115 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.018519  8115 catalog_manager.cc:5697] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.986482 11476 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:15.007670 11418 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:15.020438 11466 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.020573 11418 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.021049 11418 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.021793 11477 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.020375  8115 catalog_manager.cc:5697] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.022303 11506 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:15.023293  8115 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 6 to 7, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 7 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:17:14.982858 11349 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.002s	sys 0.014s
I20260709 13:17:15.025291  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.030552  8360 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:14.981839 11444 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.975533 11481 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.982282 11385 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.976889 11381 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.045079  8926 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:15.034047  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:15.034636  8291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:17:15.048146  8291 raft_consensus.cc:606] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:15.048619  8291 raft_consensus.cc:614] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:15.013518 11339 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.034826  8115 catalog_manager.cc:5697] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 6 to 7, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.007437 11374 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:15.051548  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:15.052672  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:15.054405  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.056572  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.060287  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:15.055665  8287 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:14.983567 10988 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:17:14.983964 11388 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:17:15.057374  8292 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:14.986624 11449 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:17:15.026144 11393 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:14.981619 11403 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:17:14.981490 11503 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:17:15.086643  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.087586  8293 raft_consensus.cc:2393] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:15.073889  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.086292  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:15.088658  8287 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:15.026108 11501 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:17:15.094040  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:15.068723 11452 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:15.063509 11451 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.097868  8889 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:15.039134 11466 consensus_queue.cc:1059] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:15.062214 11374 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:15.141196  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:15.141512  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:15.066637 11492 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:15.095849  8115 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 5 to 6, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 6 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.107798  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:15.141830  8217 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:15.037294 11506 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:17:15.105106  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:15.163555  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 58514.9us
I20260709 13:17:15.067940 11270 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:17:15.170184  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:15.171744  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:15.066195 11217 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:15.138312 11385 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:15.148924 11374 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.218104  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:15.184523  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:15.138651 11393 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.139547 11429 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:15.096109 11442 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
W20260709 13:17:15.231623  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 220472us
I20260709 13:17:15.182188 11466 consensus_queue.cc:1243] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:15.237610  8115 catalog_manager.cc:5697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 2 to 5, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.220660 11513 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:15.176100 11401 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:15.283965 11533 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:15.302743  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:15.303385  8928 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:15.304080  8366 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:15.313323  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:15.312594  8115 catalog_manager.cc:5697] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 2 to 5, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.316406  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:15.317747  8183 leader_election.cc:336] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.702s (SENT)
I20260709 13:17:15.319566  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:15.318970  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.320780  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.321527  8365 raft_consensus.cc:2410] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:15.322974  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.324361  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.325651  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.326383  8367 raft_consensus.cc:2410] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:15.327422  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:15.328130  8364 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.330010  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:15.331159  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:15.230439 11385 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.335371  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:15.285696 11388 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:15.272111 11401 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.356564  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.380869  8360 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:15.381436 11321 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:15.284844 11533 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.243597 11393 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.381768 11401 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.330307 11349 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:15.359267  8924 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:15.240309 11476 consensus_queue.cc:1059] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 13:17:15.368158  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 225257us
I20260709 13:17:15.357219  8115 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.388564  8364 raft_consensus.cc:2410] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:15.389367  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:15.333628 11466 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:15.272845 11513 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.392840  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:15.381985 11381 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.419217 11552 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:15.485024 11552 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.485409 11552 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.328156 11217 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.394268 11349 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:15.395578 11339 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.490903 11528 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.443341 11548 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:15.413611  8115 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 3 to 5, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.532123  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:15.535000  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 141910us
I20260709 13:17:15.533368  8292 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:15.413267 11381 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:15.537712  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 150614us
I20260709 13:17:15.564088  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:15.507313 11442 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.611004  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.383087 11321 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.611645  8292 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:15.609921  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:15.611969  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:15.537256 11548 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:15.612737  8926 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:15.552224 11373 consensus_meta.cc:287] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.836s	user 0.006s	sys 0.005s
I20260709 13:17:15.629065  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:15.615332  8360 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:15.490778 11531 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:15.496963 11385 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:15.610667  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46714.4us
I20260709 13:17:15.618716  8921 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:15.613188  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.411798 11466 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.506749 11528 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.619321  8364 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:15.492908 11526 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:17:15.498035 11538 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:17:15.491676 11527 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:17:15.485524 11533 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:15.628320 11388 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:15.658180  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.657780  8360 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:17:15.492290 11534 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:17:15.631498  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:15.632781  8924 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:15.487905 11027 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.632943  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.666397  8289 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:15.633481  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.667480  8292 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.633764  8115 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 2 to 5, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.637562  8288 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:15.638738 11274 consensus_queue.cc:1059] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:15.639719 11522 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:15.497289 11513 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.490135 11393 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.502693 11418 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.676401 11548 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.678076 11418 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.642134  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.679046  8290 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:15.679809  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.680176 11528 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.680408  8290 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.682070 11349 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.682723 11393 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.683034 11558 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:15.683250 11393 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.683538 11558 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.682106 11388 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.494328 11545 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:15.685966 11545 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.686309 11545 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.645700  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.599740 11552 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.648170 11537 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.688674  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.674453  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.673225 11522 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.685591 11558 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:15.688540  8212 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:15.636807 11373 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.629317 11442 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:15.672353 11386 consensus_meta.cc:287] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.814s	user 0.011s	sys 0.000s
I20260709 13:17:15.685376 11393 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:15.705654  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.696419  8292 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:15.707259  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.708319  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.708457  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.698707  8290 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:15.709270  8360 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:15.701272  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.692619  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:15.711313  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.703601  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.697815 11522 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.742712 11468 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.726481  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.692885 11401 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.727149  8362 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:15.727469  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.728662 11373 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.730194 11442 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.707170 11553 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.732156 11323 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.736719 11396 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.738510 11495 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:15.738281 11545 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.739039  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.706346  8926 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:15.745556  8290 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:15.778753  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.746038  8288 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.746592  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.780174  8360 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:15.750337  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.781122  8295 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:15.751936 11381 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:15.753763 11553 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.754444  8292 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:15.785463  8294 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:15.786020  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.786185  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.786898  8292 raft_consensus.cc:2376] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9. Re-sending same reply.
I20260709 13:17:15.787354  8364 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:17:15.787704  8364 pending_rounds.cc:85] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:15.757817 11401 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.758458  8928 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:15.759742 11552 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.768126 11321 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:15.769299 11374 consensus_meta.cc:287] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
W20260709 13:17:15.770141 11378 consensus_meta.cc:287] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.911s	user 0.007s	sys 0.003s
I20260709 13:17:15.773679  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.782058  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:15.791874 11545 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:15.783950  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.700625 11537 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.787907  8364 pending_rounds.cc:107] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:17:15.776607 11495 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:15.789243  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:15.796707  8360 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:15.791029  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.790935 11374 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:15.793489  8261 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:15.795403  8290 raft_consensus.cc:2410] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:15.800993  8364 raft_consensus.cc:2889] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.787943  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.804169  8292 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:15.805110  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.785358 11396 consensus_queue.cc:1059] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:17:15.806671 11456 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.807904 11396 raft_consensus.cc:3055] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:15.808322 11396 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:15.808411 11309 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:15.808578  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.809238  8295 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:15.794896 11545 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.791893 11378 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:15.814584 11378 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:15.816192  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 721) took 1110 ms. Trace:
I20260709 13:17:15.823976  8288 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:15.805796  8292 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:15.926044  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.816650  8925 rpcz_store.cc:276] 0709 13:17:14.705461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.707280 (+  1819us) service_pool.cc:224] Handling call
0709 13:17:14.707513 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.858187 (+150674us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:15.139223 (+281036us) log.cc:844] Serialized 14 byte log entry
0709 13:17:15.616474 (+477251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:15.616521 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:15.616565 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.640218 (+ 23653us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18003f37c0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:15.815936 (+175718us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540064e454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:15.815980 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.816119 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":427681,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":11397,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4058,"spinlock_wait_cycles":353133184,"thread_start_us":741916,"threads_started":3,"wal-append.queue_time_us":270623}
W20260709 13:17:15.939112  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 145640us
I20260709 13:17:15.939949  8261 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:15.947503  8367 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:15.952451  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 621) took 2499 ms. Trace:
I20260709 13:17:15.953039  8923 rpcz_store.cc:276] 0709 13:17:13.433823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.433931 (+   108us) service_pool.cc:224] Handling call
0709 13:17:13.443444 (+  9513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.910203 (+1466759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.933334 (+1023131us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400174654. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:15.933579 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3153033984}
I20260709 13:17:15.956687  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:15.957409  8288 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:16.003775  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:15.996284 11274 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:15.939705 11396 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.089735  8289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:17:16.090478  8289 raft_consensus.cc:606] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:16.090848  8289 raft_consensus.cc:614] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:16.058287 11274 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.107321  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:16.109210  8295 raft_consensus.cc:2410] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:16.110296  8288 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:16.110884 11274 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:16.132416  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 156077us
I20260709 13:17:16.111930 11396 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:16.049644 11495 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:16.133611  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:16.140727  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:16.134974  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:16.136255  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:16.136809  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:16.137033 11374 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:16.140550  8295 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:16.133342  8288 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:16.145011  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:16.145715  8925 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:16.149048  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:16.152293 11452 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:16.156944 11506 consensus_queue.cc:1243] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:16.158227  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:16.158285  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 840468us
I20260709 13:17:16.162268  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1624) took 1448 ms. Trace:
W20260709 13:17:16.166426  8183 leader_election.cc:336] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.712s (SENT)
I20260709 13:17:16.167019  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:16.166430  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:16.142762 11545 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.159413 11501 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:16.143057 11562 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.134218 11552 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.161875  8889 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:16.161960  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.162719  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.163552  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.194084  8211 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:16.193598  8889 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:16.166704  8215 rpcz_store.cc:276] 0709 13:17:14.713498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.713633 (+   135us) service_pool.cc:224] Handling call
0709 13:17:14.713924 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.803724 (+ 89800us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:14.834479 (+ 30755us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.867759 (+ 33280us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b1800402fa0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:15.103851 (+236092us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.150768 (+1046917us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b1800402fa0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287 00007f31fd42c208
0709 13:17:16.150918 (+   150us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.151370 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.151497 (+   127us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:16.151529 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.151596 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.162018 (+ 10422us) raft_consensus.cc:1685] finished
0709 13:17:16.162045 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.162199 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1063767,"prepare.queue_time_us":30671,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":8209,"raft.queue_time_us":1149962,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":42074,"spinlock_wait_cycles":25707648,"thread_start_us":261483,"threads_started":1,"wal-append.queue_time_us":392438}
I20260709 13:17:16.159265  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:16.140239 11466 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:16.170676  8258 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:16.171820  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:16.172430  8927 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:16.172125 11452 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:16.173148  8926 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:16.197743  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:16.182858  8286 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:16.161307  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.195240  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:16.202421  8213 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:16.202832  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:16.203471  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.195961  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:16.196681  8214 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.200314  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.204239  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:16.204509  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.204679  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.204154  8220 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.205096  8295 raft_consensus.cc:2410] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:16.208171  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:16.193202 11495 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.210865  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.206453 11561 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:16.209887 11468 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:16.195676 11213 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:16.146320 11309 consensus_queue.cc:1059] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:17:16.204140 11401 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:16.223726  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:16.224334  8286 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.203676 11552 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.230233 11552 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:16.206650 11442 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:16.232194 11442 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:16.233100 11442 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.220372 11358 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:16.236492 11358 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:16.237330 11358 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:16.238796 11542 raft_consensus.cc:3055] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:16.239291 11542 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:16.246697 11472 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:16.215902 11468 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.247388 11468 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.248003 11315 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:16.206774 11393 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:16.169267 11522 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.193385 11545 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:16.261337  8286 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:16.264254  8220 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:16.263852  8214 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:16.270644  8286 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.252655 11393 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.274385 11393 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.264986 11506 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:16.199025 11562 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.282918  8291 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.284204 11562 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:16.270897 11526 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:16.292295  8291 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:16.296111  8286 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:16.297998 11545 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:16.302256  8289 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:16.308418 11522 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:16.308578  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1405) took 1257 ms. Trace:
I20260709 13:17:16.311864  8212 rpcz_store.cc:276] 0709 13:17:15.051190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.051331 (+   141us) service_pool.cc:224] Handling call
0709 13:17:16.308402 (+1257071us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54001b3354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:16.308523 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1462858496}
W20260709 13:17:16.312805  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 109149us
I20260709 13:17:16.322367 11213 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:16.325311 11427 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:16.325547  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2269) took 1316 ms. Trace:
I20260709 13:17:16.325956  8363 rpcz_store.cc:276] 0709 13:17:15.009593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.009730 (+   137us) service_pool.cc:224] Handling call
0709 13:17:15.010063 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.010307 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:15.233780 (+223473us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.321456 (+1087676us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b180038f440. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa324522 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:16.325010 (+  3554us) spinlock_profiling.cc:243] Waited 985 us on lock 0x7b180038f440. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287 00007f31fd42c208
0709 13:17:16.325237 (+   227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.325288 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:16.325332 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.325394 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.325495 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2374,"prepare.queue_time_us":380233,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":937202,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":18451712,"thread_start_us":377876,"threads_started":2,"wal-append.queue_time_us":449462}
W20260709 13:17:16.328418  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.328354  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1411) took 1188 ms. Trace:
I20260709 13:17:16.329627  8216 rpcz_store.cc:276] 0709 13:17:15.140199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.140376 (+   177us) service_pool.cc:224] Handling call
0709 13:17:15.355793 (+215417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.176676 (+820883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.176719 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.177278 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.255009 (+ 77731us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:16.255045 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.255116 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.328167 (+ 73051us) raft_consensus.cc:1685] finished
0709 13:17:16.328186 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.328302 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":820361,"raft.queue_time_us":820608,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":77337,"threads_started":1,"wal-append.queue_time_us":143066}
I20260709 13:17:16.341101  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:16.342029  8366 raft_consensus.cc:2393] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:16.342474  8363 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:16.344606  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:16.345371  8364 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
W20260709 13:17:16.352706  8889 leader_election.cc:336] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.501s (SENT)
I20260709 13:17:16.353413  8889 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:16.359668  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 152124us
I20260709 13:17:16.339139 11213 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:17:16.339534 11428 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:16.360991 11472 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:16.499954  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2279) took 1171 ms. Trace:
I20260709 13:17:16.516119  8368 rpcz_store.cc:276] 0709 13:17:15.328447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.329184 (+   737us) service_pool.cc:224] Handling call
0709 13:17:15.381111 (+ 51927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.381315 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:15.417618 (+ 36303us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.499543 (+1081925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.499598 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:16.499652 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.499724 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.499883 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1091006,"prepare.queue_time_us":121909,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":21021,"threads_started":1}
I20260709 13:17:16.355962 11315 consensus_queue.cc:1059] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:17:16.412348 11373 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.359913 11309 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:17:16.387310 11546 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:16.412587 11513 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:16.449160 11381 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
W20260709 13:17:16.588333  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 371824us
I20260709 13:17:16.400483 11274 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.617817 11482 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.618165 11524 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:16.634580  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1771) took 1312 ms. Trace:
I20260709 13:17:16.635360  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1412) took 1470 ms. Trace:
I20260709 13:17:16.619982  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:16.621447  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:16.635896  8217 rpcz_store.cc:276] 0709 13:17:15.165106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.165372 (+   266us) service_pool.cc:224] Handling call
0709 13:17:16.635113 (+1469741us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400035cd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:16.635298 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3199105408}
I20260709 13:17:16.637007  8360 raft_consensus.cc:2410] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:16.623291  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:16.637926  8364 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:16.623369  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:16.640969  8292 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:17:16.624311  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 271611us
I20260709 13:17:16.642942  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:16.643857  8928 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:16.635076  8362 rpcz_store.cc:276] 0709 13:17:15.322304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.322407 (+   103us) service_pool.cc:224] Handling call
0709 13:17:15.361639 (+ 39232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.745178 (+383539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.634327 (+889149us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540010e354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:16.634523 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837923584}
I20260709 13:17:16.722394 11321 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:16.723304 11321 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:16.726219 11321 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:16.551445 11569 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:16.728189  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 73979.1us
W20260709 13:17:16.728549  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 85221.9us
I20260709 13:17:16.646833  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:16.771451  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:16.772377  8927 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:16.785638 11571 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:16.551510 11373 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:16.771418 11468 consensus_meta.cc:287] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.005s
W20260709 13:17:16.870142  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.640136 11482 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.618786 11513 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:16.795544 11386 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.022s	sys 0.013s
I20260709 13:17:16.848767  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2076) took 1153 ms. Trace:
I20260709 13:17:16.898769  8290 rpcz_store.cc:276] 0709 13:17:15.695300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.783634 (+ 88334us) service_pool.cc:224] Handling call
0709 13:17:16.848498 (+1064864us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5400127fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:16.848694 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5317888}
I20260709 13:17:16.852793  8364 raft_consensus.cc:2410] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:17:16.558787 11546 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.758098 11569 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:17:16.818095  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 1.19725e+06us
I20260709 13:17:16.844774 11427 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.905463  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:16.860074 11571 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.772076 11404 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:17:16.757004 11524 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:16.838665 11315 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:17:16.898697 11386 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.023s	sys 0.013s
I20260709 13:17:16.919250  8292 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:16.926544  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:16.915369 11574 log.cc:927] Time spent T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Append to log took a long time: real 0.289s	user 0.000s	sys 0.003s
I20260709 13:17:16.932396  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.938448  8217 raft_consensus.cc:2393] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:17:16.939239  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 322906us
I20260709 13:17:16.939790  8928 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:16.934036  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:16.940028  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 175057us
I20260709 13:17:16.911219 11571 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.939818  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:16.941954  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:16.893587 11468 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:16.924794 11323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.027s	sys 0.028s
I20260709 13:17:16.944658  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:16.945164  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:16.942833  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:16.948269  8923 raft_consensus.cc:2393] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 4: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:16.949443  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:16.946645  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.923741 11525 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:16.956092  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:16.947934 11323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.028s	sys 0.028s
I20260709 13:17:16.957877  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:16.979518  8293 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:16.982409  8334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.014s	sys 0.051s
W20260709 13:17:16.982968  8334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.015s	sys 0.051s
I20260709 13:17:16.914111 11427 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:16.948983 11466 raft_consensus.cc:2764] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:17.067315  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.181777  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.090667  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.079620  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:16.988335  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:17.236076  8217 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:17.089635  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:16.983994  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.104516  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:17.237726  8212 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.237797  8293 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:16.942169 11577 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:17.241470  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 137066us
I20260709 13:17:17.236682  8287 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:16.991269  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.241827  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:16.958169 11514 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:17.254606  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:16.945039 11559 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:17.079984 11581 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:17:17.145584 11585 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:17:17.260725  8927 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:17.263190  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:17.213920 11393 consensus_meta.cc:287] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.939s	user 0.008s	sys 0.004s
I20260709 13:17:16.953529 11525 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:17.200352 11495 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.982s	user 0.001s	sys 0.009s
I20260709 13:17:17.263681  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:17.258764  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 317858us
I20260709 13:17:17.253535 11321 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:17.261831 11514 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:17.280566  8286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.002s	sys 0.026s
I20260709 13:17:17.271780  8212 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:17.173672 11274 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.085016 11309 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:17.064668 11476 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:17.137363 11386 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.069278 11374 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:17.300263  8287 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.309307 11514 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.181957 11586 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:17.084868 11503 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.200s
I20260709 13:17:17.279508 11466 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:17.314054  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 387554us
I20260709 13:17:17.292989 11373 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.309448 11427 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.367564  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:17.372303  8927 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:17.262476 11577 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.304608 11524 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:17.310068 11482 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.305543 11582 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:17.349136 11546 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.030182 11569 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.286388 11393 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.349653 11374 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:17.285845 11525 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.358137 11466 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.396731 11466 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:17.397068 11578 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:17:17.397956 11584 log.cc:927] Time spent T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:17:17.398728 11592 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:17:17.382194 11427 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:17:17.358685 11586 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:17.277799 11559 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.345304 11476 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.386363 11582 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.387678 11524 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.404292 11524 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:17.406324 11537 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:17.406471 11524 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:17.407086 11597 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:17:17.409993 11542 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.411481 11542 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.412387 11559 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:17.413244 11586 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.414321 11586 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.404841 11582 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.402139 11577 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:17.418624 11553 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:17.306628  8216 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
W20260709 13:17:17.453775  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 153555us
I20260709 13:17:17.454371  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 475) took 1101 ms. Trace:
I20260709 13:17:17.455024  8289 rpcz_store.cc:276] 0709 13:17:16.352325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.623509 (+271184us) service_pool.cc:224] Handling call
0709 13:17:16.623820 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.676240 (+ 52420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.676293 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.676909 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.901528 (+224619us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:16.901581 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.901669 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.453432 (+551763us) raft_consensus.cc:1685] finished
0709 13:17:17.453541 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.454066 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":93216,"thread_start_us":224148,"threads_started":1,"wal-append.queue_time_us":307978}
W20260709 13:17:17.305428  8286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.003s	sys 0.027s
I20260709 13:17:17.458789  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:17.285640  8295 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.002s	sys 0.020s
I20260709 13:17:17.368592  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:17.463689  8295 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.003s	sys 0.020s
W20260709 13:17:17.466270  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 97710.2us
I20260709 13:17:17.460950  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2089) took 1699 ms. Trace:
I20260709 13:17:17.467983  8286 rpcz_store.cc:276] 0709 13:17:15.761449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.297040 (+535591us) service_pool.cc:224] Handling call
0709 13:17:16.297421 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.335696 (+ 38275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.335740 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.336972 (+  1232us) log.cc:844] Serialized 26 byte log entry
0709 13:17:17.458907 (+1121935us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:17.459689 (+   782us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.460200 (+   511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.460364 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.460418 (+    54us) raft_consensus.cc:1685] finished
0709 13:17:17.460431 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.460714 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37525,"raft.queue_time_us":37854,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8626,"thread_start_us":934313,"threads_started":1,"wal-append.queue_time_us":995290}
I20260709 13:17:17.469228  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:17.378194  8928 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:17.379482 11274 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.310747 11321 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.327190 11309 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.471338  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:17.472847  8292 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:17:17.473759 11506 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:17.474385 11373 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.388033 11468 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:17.347081 11386 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:17.504309  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 479678us
I20260709 13:17:17.521868  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:17.523123 11427 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:17.523661 11427 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:17.524343 11427 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:17.524712  8293 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:17.525882 11309 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:17.526894 11552 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:17.526895 11393 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.460966  8289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8942278c55614601a1290e32997fe007"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:17:17.531105  8289 raft_consensus.cc:606] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:17.531629  8289 raft_consensus.cc:614] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:17.518736 11374 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.534942 11476 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:17.536379  8289 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:17:17.537354  8289 raft_consensus.cc:606] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:17.539932  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:17.542555 11373 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.504783  8923 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:17:17.509013  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 245198us
W20260709 13:17:17.500869  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.002s	sys 0.001s
I20260709 13:17:17.509682 11608 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.511170 11599 consensus_queue.cc:1059] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:17.512424 11274 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.549144 11608 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:17.551561 11608 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.401409 11472 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:17.552264 11472 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:17.553200  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.553718 11472 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.555307 11472 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.513861  8211 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:17.557202  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 100044us
I20260709 13:17:17.513960 11589 raft_consensus.cc:1064] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:17:17.514365  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:17.562319  8291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 468) took 1417 ms (client timeout 1863 ms). Trace:
I20260709 13:17:17.557301  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:17.562809  8291 rpcz_store.cc:269] 0709 13:17:16.144579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.166231 (+ 21652us) service_pool.cc:224] Handling call
0709 13:17:17.561818 (+1395587us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400388954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:17.562063 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263661952}
I20260709 13:17:17.514869  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.563977  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.511684  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.515501  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.516865 11321 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:17.517524 11506 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.518198 11213 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:17.518675 11571 consensus_meta.cc:287] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
W20260709 13:17:17.568140  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.003s	sys 0.001s
I20260709 13:17:17.565016  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.523466 11386 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:17.630611  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 47370.1us
I20260709 13:17:17.632014  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:17:17.565510  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.669824  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 725913us
W20260709 13:17:17.630116  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.676227  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 473) took 1473 ms. Trace:
I20260709 13:17:17.676677  8295 rpcz_store.cc:276] 0709 13:17:16.202530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.349568 (+147038us) service_pool.cc:224] Handling call
0709 13:17:16.349894 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.350136 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:17.464524 (+1114388us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.675612 (+211088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.675688 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:17.675801 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.675930 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.676165 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7022,"prepare.queue_time_us":634490,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":5199,"thread_start_us":1176707,"threads_started":2}
I20260709 13:17:17.678608 11388 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.679375 11388 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.680330  8213 raft_consensus.cc:2376] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 4. Re-sending same reply.
I20260709 13:17:17.680922  8287 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:17.681460  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.682233 11388 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:17.682430  8213 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:17.682521 11373 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.683454  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.683607  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:17.684128  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.684667  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.687677  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.687985 11315 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:17.693722  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1777) took 1353 ms. Trace:
I20260709 13:17:17.697423 11090 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:17.698029 11090 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:17.698185  8290 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:17:17.694203  8367 rpcz_store.cc:276] 0709 13:17:16.340466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.340613 (+   147us) service_pool.cc:224] Handling call
0709 13:17:16.340920 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.341110 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:16.359601 (+ 18491us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.692595 (+1332994us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.692964 (+   369us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.693064 (+   100us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:17.693192 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.693314 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.693475 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1141767,"prepare.queue_time_us":70490,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":30575,"raft.queue_time_us":1563,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":61768,"thread_start_us":190380,"threads_started":1,"wal-append.queue_time_us":555985}
I20260709 13:17:17.701763 11358 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:17.701229  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:17.704885  8295 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:17.706066 11381 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.706842 11381 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.697350 11533 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:17.720585  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.726554  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:17.726321 11533 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.726598  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.727371  8286 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:17.728010  8367 raft_consensus.cc:2410] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:17:17.730386 11525 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.732306 11577 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.732992 11577 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.735528  8295 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:17.735805 11309 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:17.662495 11514 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.736498 11309 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.738600 11309 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.738809 11393 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:17.740302 11388 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:17.740727 11388 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:17.699263 11090 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.749755 11274 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.753443  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:17.742043 11388 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.756548  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:17.757367  8367 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:17.757913 11090 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:17.758234  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 74766.7us
I20260709 13:17:17.759261  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:17.761168 11381 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.748397 11427 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.764535 11388 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.764811  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.766975 11569 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.761178  8294 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:17.773002  8286 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:17.783310  8214 raft_consensus.cc:2393] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:17.738538 11514 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.743379 11577 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.786775  8214 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:17.787155 11571 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.794656  8211 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:17.796015  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.797363  8215 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:17.797360 11571 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.805146  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:17.808799  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.809789  8362 raft_consensus.cc:2410] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:17.811331 11381 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.812836  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.814072  8367 raft_consensus.cc:2410] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:17.814400  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.815660  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.816773  8365 raft_consensus.cc:2410] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:17:17.818215  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 420) took 3477 ms. Trace:
I20260709 13:17:17.818132  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.820443  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.818781  8218 rpcz_store.cc:276] 0709 13:17:14.340646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.340859 (+   213us) service_pool.cc:224] Handling call
0709 13:17:14.343445 (+  2586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:14.706817 (+363372us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:14.707104 (+   287us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.198214 (+1491110us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.209696 (+ 11482us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.211162 (+  1466us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.211291 (+   129us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:16.211325 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.817500 (+1606175us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54003d45d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:17.817585 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:17.817739 (+   154us) raft_consensus.cc:1685] finished
0709 13:17:17.817752 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.817990 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1056576,"prepare.queue_time_us":73028,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3483,"raft.queue_time_us":1059928,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":5707,"spinlock_wait_cycles":834804480,"thread_start_us":444982,"threads_started":2,"wal-append.queue_time_us":537604,"wal-append.run_cpu_time_us":9594,"wal-append.run_wall_time_us":2021489}
I20260709 13:17:17.821977  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:17.823263  8362 raft_consensus.cc:2410] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:17.824255 11466 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.826719 11466 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:17.832372  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 73273.5us
I20260709 13:17:17.806800 11608 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.831352 11617 raft_consensus.cc:3055] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:17.836926  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.840864 11617 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:17.851552  8369 raft_consensus.cc:3055] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:17.853881  8362 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:17.856024  8213 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.791849 11506 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:17.861428  8369 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:17.806186 11090 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.852756  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:17.845232 11466 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:17.886533  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.887076 11466 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.887923  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:17.889061  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.889618 11466 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:17.890472 11524 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.839411 11427 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.858508 11481 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:17.920070  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:17.893813 11525 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:17.926645  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 85160.2us
I20260709 13:17:17.877288 11090 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.936931  8360 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:17.938308 11524 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:17.901742 11481 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:17.927042 11442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.625s	user 0.000s	sys 0.037s
I20260709 13:17:17.948949  8360 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:17.953645 11513 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:17.954854 11608 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:17.956190 11466 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:17.956928 11466 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:17.958222 11466 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:17.960352  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.960486  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 85071.3us
I20260709 13:17:17.948171 11315 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:17.962003 11514 consensus_queue.cc:1059] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:17.963439 11514 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:17.860304 11617 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.969012 11090 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:17.969122 11617 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.968827 11481 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:17.956282 11574 log.cc:927] Time spent T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Append to log took a long time: real 0.054s	user 0.000s	sys 0.004s
W20260709 13:17:17.946739 11442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.711s	user 0.000s	sys 0.038s
W20260709 13:17:17.977164 11542 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.565s	user 0.014s	sys 0.001s
I20260709 13:17:17.983487  8213 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:17.963459  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:17.841249 11589 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.963858 11514 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:17.985844 11514 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.987226 11514 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:17.987128  8369 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:17.993171  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 64082.5us
I20260709 13:17:17.996548 11580 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:17.997040 11580 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.997213 11315 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:17.997519 11580 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.998684 11315 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:17.999894  8369 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.000748 11374 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.001950  8364 raft_consensus.cc:2393] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:18.002880 11374 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:18.011034 11582 consensus_meta.cc:287] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.006s
I20260709 13:17:18.011499 11582 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:17.958248 11553 raft_consensus.cc:3055] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:18.023377  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 75595.5us
W20260709 13:17:18.021697 11401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.647s	user 0.029s	sys 0.036s
I20260709 13:17:18.013674 11582 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:18.054927  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.055280  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2277) took 2815 ms. Trace:
I20260709 13:17:18.023964 11553 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:18.058749 11553 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.060003 11553 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.061219 11321 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:18.050204  8889 leader_election.cc:336] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 2.103s (SENT)
W20260709 13:17:18.049510 11401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.826s	user 0.030s	sys 0.036s
I20260709 13:17:18.057024  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.069604  8928 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 4.
I20260709 13:17:18.069818 11481 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:18.071756  8183 connection.cc:256] RPC call timeout handler was delayed by -1.9254089780001777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4175s for a response
W20260709 13:17:18.072131  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.072289  8183 connection.cc:256] RPC call timeout handler was delayed by -1.403095452000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 13:17:18.072638  8183 connection.cc:256] RPC call timeout handler was delayed by -1.3931954520001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:17:18.073596 11477 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:17:18.082518 11580 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.088140 11401 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:18.088563  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2079) took 2392 ms. Trace:
I20260709 13:17:18.089078  8288 rpcz_store.cc:276] 0709 13:17:15.696227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.143987 (+447760us) service_pool.cc:224] Handling call
0709 13:17:16.848665 (+704678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.861201 (+ 12536us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:16.861244 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.861303 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:16.861351 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.861440 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.088089 (+1226649us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400127fd0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:18.088384 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12101,"raft.queue_time_us":12747,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":24501,"spinlock_wait_cycles":1619145472}
I20260709 13:17:18.089664 11401 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.093374  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:18.098470  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.099218  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.099799  8928 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:18.104839  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1770) took 2782 ms. Trace:
I20260709 13:17:18.105329  8369 rpcz_store.cc:276] 0709 13:17:15.322031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.322144 (+   113us) service_pool.cc:224] Handling call
0709 13:17:15.322386 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.828395 (+2506009us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b5400265320. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd4131c0 00007f31fd414231 00007f31fd410d8f 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c
0709 13:17:17.986605 (+158210us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4c00163940. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fb6dda20 00007f31fb6eea29 00007f31fb6b4644 00007f31fb6dbf2d 00007f31fb6dbb93 00007f31fd40c18b 00007f31fd40ccb5 00007f31fd407f30 00007f31fd4097de 00007f31fd413b49 00007f31fd414416
0709 13:17:18.048758 (+ 62153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.048794 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.054022 (+  5228us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:18.054222 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.064437 (+ 10215us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.104780 (+ 40343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7352,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11002,"spinlock_wait_cycles":2195464448}
I20260709 13:17:18.111729 11580 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:18.113026  8183 connection.cc:256] RPC call timeout handler was delayed by -1.3535954520000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:17:18.113446  8183 connection.cc:256] RPC call timeout handler was delayed by -1.351795452000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 13:17:18.113780  8183 connection.cc:256] RPC call timeout handler was delayed by -1.3157954519999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:17:18.113855 11090 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:18.114112  8183 connection.cc:256] RPC call timeout handler was delayed by -1.3157954519999748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:17:18.114694 11593 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:18.114912  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.115370  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.115631  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.115218 11593 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:18.115769  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.115996 11577 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.116576 11577 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.117432  8186 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.118448 11418 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:18.119155 11309 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:18.119990 11418 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:18.119820 11309 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.120231 11270 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:18.120585 11418 raft_consensus.cc:697] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:18.121356 11605 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:18.121778 11418 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.122009 11605 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.114410 11090 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.115396 11374 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:18.114420  8183 connection.cc:256] RPC call timeout handler was delayed by -1.2851954519999254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:17:18.126204  8183 connection.cc:256] RPC call timeout handler was delayed by -1.2239954520000538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
W20260709 13:17:18.126554  8183 connection.cc:256] RPC call timeout handler was delayed by -1.1582954519999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
I20260709 13:17:18.120620 11618 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:18.118672 11577 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:18.056329  8361 rpcz_store.cc:276] 0709 13:17:15.239531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.239679 (+   148us) service_pool.cc:224] Handling call
0709 13:17:15.355763 (+116084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.355958 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:15.616845 (+260887us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.567063 (+1950218us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b1800411fa0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f3200e093c7 00007f31fd41b9a7 00007f31fd42b0bf 00007f31fd42b038
0709 13:17:17.795668 (+228605us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.993609 (+197941us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.014738 (+ 21129us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:18.046198 (+ 31460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.053926 (+  7728us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.054939 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":737883,"prepare.queue_time_us":1437502,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":68,"raft.queue_time_us":730650,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":24413,"spinlock_wait_cycles":84856576,"thread_start_us":523971,"threads_started":4,"wal-append.queue_time_us":287057,"wal-append.run_cpu_time_us":1014,"wal-append.run_wall_time_us":1004250}
I20260709 13:17:18.158962 11217 raft_consensus.cc:2764] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:18.161182 11090 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:18.163194  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.167261 11605 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:18.122043 11309 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:18.168334 11618 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.170786 11618 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:18.172140  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 126050us
I20260709 13:17:18.117496 11593 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:18.175037  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:18.178392  8889 connection.cc:256] RPC call timeout handler was delayed by -1.16422549899994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 13:17:18.198421  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:18.199712  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1491) took 1275 ms. Trace:
I20260709 13:17:18.150736 11477 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:17:18.200273  8292 rpcz_store.cc:276] 0709 13:17:16.924259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.924438 (+   179us) service_pool.cc:224] Handling call
0709 13:17:16.924797 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.500767 (+575970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.177611 (+676844us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54002e9ad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:18.199631 (+ 22020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258236800}
I20260709 13:17:18.219987 11501 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:18.220419 11533 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:18.220646 11501 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:18.233955  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 50363.5us
I20260709 13:17:18.236693  8360 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:18.239774 11533 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:18.194667 11593 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:17:18.227461 11618 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:18.252785  8924 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:18.252914  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.253793  8360 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 3.
W20260709 13:17:18.254827  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.266235  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1417) took 1324 ms. Trace:
I20260709 13:17:18.266680  8216 rpcz_store.cc:276] 0709 13:17:16.933271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.933391 (+   120us) service_pool.cc:224] Handling call
0709 13:17:18.247642 (+1314251us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b5400093154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:18.257135 (+  9493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161374976}
I20260709 13:17:18.268234  8360 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:18.272079 11495 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:18.272627 11495 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:18.258617 11618 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.274096 11501 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:18.277066 11634 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:18.277508 11618 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:18.278697  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 68949.8us
I20260709 13:17:18.278113  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.280719  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.281514 11217 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.282734  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:18.283336  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.283507  8369 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:18.284802  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:18.285144  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:18.285537  8362 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:18.285836  8369 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:18.287138  8369 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:18.287994  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.287695  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:18.275192 11495 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.290319 11495 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.292114  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.292990  8361 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:18.299624  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.300406  8367 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
W20260709 13:17:18.270666 11631 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:18.299736 11321 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:18.303740  8362 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:18.305871 11477 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.306854 11577 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.306537 11477 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:18.308455  8892 leader_election.cc:336] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.115s (SENT)
I20260709 13:17:18.308959 11571 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:18.309422 11571 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:18.310408 11571 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.311758 11571 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.312973  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.340593  8367 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:18.314535  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:18.316474  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.341645  8365 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.341956  8369 raft_consensus.cc:2410] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:18.315805  8361 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:18.319418  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.320290 11577 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.320716 11618 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:18.320997  8363 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:18.322098  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:18.304382 11632 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:17:18.328830  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.332150 11533 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:18.335721  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:18.336278 11321 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.337471  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:18.342620  8368 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:18.361955  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.365732  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:18.367420  8892 leader_election.cc:336] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.168s (SENT)
I20260709 13:17:18.371335 11428 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:18.360074 11533 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:18.383253  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 47652.4us
I20260709 13:17:18.384125  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:18.385435  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.386294 11451 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.386960 11451 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.348165 11577 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.388438  8366 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:18.389223  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.390023 11577 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:18.392994 11477 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:18.393429  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.394116 11593 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.394922 11593 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.395773  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:18.391906  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 111309us
I20260709 13:17:18.396561  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.381664  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.401428  8365 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:18.402014  8216 raft_consensus.cc:2410] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:18.398854  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:18.407794  8926 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.379384 11428 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:18.353323 11618 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.421969  8258 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.419221  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 631) took 2277 ms. Trace:
I20260709 13:17:18.419632 11492 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:18.421694  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:18.417346  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.422866  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.424654 11428 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.428231  8928 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:18.432631  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.433399  8365 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:18.433923  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:18.435101  8362 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:18.435940  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:18.436352  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.436673  8365 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:18.437376  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:18.437498  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.438336  8287 raft_consensus.cc:2410] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:18.438870  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.438230  8363 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:18.440016  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:18.440335  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.444960  8287 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:18.446785  8291 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:18.447188  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:18.447882  8293 raft_consensus.cc:2368] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10.
I20260709 13:17:18.449357  8290 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:18.450616  8289 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 9. Ops: []
I20260709 13:17:18.451610  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:18.457031  8288 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:18.422884  8924 rpcz_store.cc:276] 0709 13:17:16.141871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.142125 (+   254us) service_pool.cc:224] Handling call
0709 13:17:16.147139 (+  5014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.253413 (+2106274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.397467 (+144054us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b540059f6d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:18.419126 (+ 21659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4836356352}
W20260709 13:17:18.461952  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.440398  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:18.466501  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.468243  8362 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:18.470357  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 73960.6us
I20260709 13:17:18.476095  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.477922  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.478183  8365 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
W20260709 13:17:18.479189  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.479756  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:18.492381  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.493144  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.503599  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.478504  8365 pending_rounds.cc:85] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 4
I20260709 13:17:18.507587  8287 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:17:18.456457 11492 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:18.510700  8925 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:18.511449  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.507943  8287 pending_rounds.cc:85] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 6
I20260709 13:17:18.513574  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:18.516541  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 110027us
I20260709 13:17:18.506908  8365 pending_rounds.cc:107] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:17:18.512336  8287 pending_rounds.cc:107] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:18.517849  8287 raft_consensus.cc:2889] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.517410  8365 raft_consensus.cc:2889] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.506163 11553 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:18.523046  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.466482  8117 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 6 to 7, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:17:18.524966  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:18.526505  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.527235  8360 raft_consensus.cc:2410] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:18.510578 11492 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.508296 11386 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.530504  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.538758  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:18.539023  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:18.539570  8213 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.541087  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.544512  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.546908  8925 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:18.548846  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.564424  8217 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:18.565194  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.565987  8220 raft_consensus.cc:2410] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:18.567994  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.568879  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.569566  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.570044  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.570781  8211 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:18.571626  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.572435  8214 raft_consensus.cc:2410] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:18.572357  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:18.572971  8219 raft_consensus.cc:2376] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9. Re-sending same reply.
I20260709 13:17:18.577100  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:18.580356  8367 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:18.587011 11321 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.595692  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.577144  8361 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:17:18.590519  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 83294us
I20260709 13:17:18.599285  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:18.603049  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.532246 11553 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:18.606001  8212 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:18.607056  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:18.611461  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.611845  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.606334  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.617282  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.617951  8928 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:18.604156  8117 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 5 to 6, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 6 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:17:18.621466  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 79102.7us
I20260709 13:17:18.624095  8217 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:18.627172  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.630689  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.632522  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:18.641170  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.643967  8213 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:18.653026  8117 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:18.663672  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.664626  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:18.660583  8889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 2.109s (SENT) [suppressed 31 similar messages]
W20260709 13:17:18.668107  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.627205 11309 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:17:18.669587  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.656797 11418 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:18.656390 11401 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.682142  8117 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 8, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 8 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.681536  8287 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:18.689556  8186 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:18.689651  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:18.690548  8287 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:18.692386  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.693616  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:18.694861  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:18.695498  8287 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.696940  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:18.697688  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.673463 11618 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:18.698840  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.696316  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.697494  8289 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:18.698840  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:18.701177  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:18.703613  8219 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:18.701218  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:18.704730  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 81543.7us
I20260709 13:17:18.705525  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.671356 11617 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:17:18.709348  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:18.709438  8290 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:18.711180  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.703719 11577 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:18.719364  8292 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:18.720904  8290 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:18.721788  8924 raft_consensus.cc:2410] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:18.702749 11418 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:18.713969 11593 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:18.721539  8117 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 7, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:18.722998  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:18.688547 11401 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.730510  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:18.733045  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 79679.5us
W20260709 13:17:18.719759  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.737535  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:18.737815 11418 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.738714  8186 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:18.722724 11404 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:18.740147 11409 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:18.740245 11404 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:18.740660 11409 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:18.741128 11409 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.741268 11404 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.742627 11404 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.740209 11451 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:18.735452  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:18.745242  8292 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.747118  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:18.732668 11593 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.750643  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:18.751936  8183 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:18.754946  8926 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:18.759493  8186 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:18.757944  8117 catalog_manager.cc:5697] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:18.761543  8258 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.774910 11533 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.776217 11315 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:18.778215  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:18.778973 11501 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:18.779083 11492 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.779686 11501 raft_consensus.cc:2764] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:18.780143 11617 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:18.780570 11617 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:18.780743  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:18.780965 11617 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.781749  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:18.782514  8927 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:18.783233  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:18.783802  8364 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:18.784493  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:18.784646 11548 consensus_queue.cc:1059] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:18.735323 11495 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:17:18.785713 11548 raft_consensus.cc:3055] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:18.785859 11495 consensus_queue.cc:1243] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:18.786098 11548 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:18.784494  8292 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:18.787540  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:18.787657  8261 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:18.789354  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:18.786399 11404 raft_consensus.cc:3055] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:18.745823 11577 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:18.801580  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:18.803366  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 71713.7us
I20260709 13:17:18.751752 11571 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:18.793675 11404 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:18.762406 11593 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:18.757987 11553 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:18.813287  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.761873 11321 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:18.766997 11514 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.814585  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 53134.2us
I20260709 13:17:18.815008  8287 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:18.819319  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:18.818288  8117 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.794329 11386 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.822808  8290 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.825657  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.804273 11618 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:18.810827 11495 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:18.788487 11451 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:17:18.808596 11571 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:18.833942 11645 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:17:18.834161  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:18.834496 11642 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:17:18.834372  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:18.834384  8115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46474 (request call id 260) took 22350 ms (client timeout 15000 ms). Trace:
I20260709 13:17:18.829260 11217 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.824410 11514 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.835650 11492 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:18.835915  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:18.863154 11577 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.864208 11217 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.866295 11217 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:18.866878 11217 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.867013 11514 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:18.848134 11404 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.852222 11548 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:18.880674 11548 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.885520 11617 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.886677  8220 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:18.887531 11617 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:18.816879 11477 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:18.856458  8117 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:17:18.857512  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.857676  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:18.863722  8293 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.837692 11401 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:18.871537  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:18.874032 11428 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.874523 11533 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:18.875173 11404 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.875600  8258 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.876271 11315 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.877486  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.830021 11618 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:18.899520  8117 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 5, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 5 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:18.904232 11477 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:18.904758 11501 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:18.905315  8926 raft_consensus.cc:2410] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:18.908841  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.879910 11409 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:18.923684  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 98090.7us
I20260709 13:17:18.925302  8293 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:18.921675  8117 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:18.917788  8258 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.934156  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.949096  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.948850  8117 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.914551 11618 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.928930  8290 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:18.916987 11477 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:18.918268 11428 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.914440 11553 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:18.966246  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.965231  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:18.962512 11533 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.958721 11386 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.969439  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:18.967437 11309 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:18.958482 11605 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:17:18.923312 11315 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:18.860523  8115 rpcz_store.cc:269] 0709 13:16:56.441799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.442475 (+   676us) service_pool.cc:224] Handling call
0709 13:17:18.768725 (+22326250us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:16.108329 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:16.152876 (+ 44547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:16.152938 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:17:16.152959 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:16.154215 (+  1256us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:16.154276 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:16.154313 (+    37us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:17:16.155557 (+  1244us) tablet.cc:701] Row locks acquired
0709 13:17:16.155578 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:16.155742 (+   164us) write_op.cc:270] Start()
0709 13:17:16.155862 (+   120us) write_op.cc:276] Timestamp: P: 1783603036155690 usec, L: 0
0709 13:17:16.155884 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:16.273478 (+117594us) log.cc:844] Serialized 5538 byte log entry
0709 13:17:17.423719 (+1150241us) op_driver.cc:464] REPLICATION: finished
0709 13:17:17.835344 (+411625us) write_op.cc:301] APPLY: starting
0709 13:17:17.835536 (+   192us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:17.835930 (+   394us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:17.836096 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:17.845865 (+  9769us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:17.846237 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:17:17.846282 (+    45us) write_op.cc:312] APPLY: finished
0709 13:17:17.846810 (+   528us) log.cc:844] Serialized 101 byte log entry
0709 13:17:17.847069 (+   259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:17.847367 (+   298us) write_op.cc:454] Released schema lock
0709 13:17:17.847449 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:17.847997 (+   548us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:17.851287 (+  3290us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7316,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":374971,"apply.run_cpu_time_us":7858,"apply.run_wall_time_us":14964,"num_ops":14,"prepare.queue_time_us":358175,"prepare.run_cpu_time_us":30259,"prepare.run_wall_time_us":522778,"raft.queue_time_us":272979,"raft.run_cpu_time_us":3926,"raft.run_wall_time_us":89683,"replication_time_us":1267639,"thread_start_us":859818,"threads_started":4,"wal-append.queue_time_us":352199}]]}
I20260709 13:17:18.920776 11571 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:18.981578  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 175595us
I20260709 13:17:18.981797  8117 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 6, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 6 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:18.986379  8117 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 6, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 6 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:19.006009  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.017989 11495 raft_consensus.cc:697] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:19.022814  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 53456.1us
I20260709 13:17:19.001288 11553 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:19.013943 11477 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:19.040825  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.040910  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.063117  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.029487 11571 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:19.066339  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.078940  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.093473  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:19.094126  8360 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.094025  8117 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 6, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 6 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:17:19.092929  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 283210us
W20260709 13:17:19.099529  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.102139  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 66967.5us
W20260709 13:17:19.106343  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.108034  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.111296  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.113060  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.135845  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 68592.3us
I20260709 13:17:19.137857  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:19.145166  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.095202 11617 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:19.142474  8117 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 8, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:19.151489 11315 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:19.102108 11652 consensus_queue.cc:1059] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:19.152895 11418 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:19.153290 11418 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:19.156687 11651 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:19.138695 11409 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:19.162976 11650 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:17:19.145200 11495 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.164304 11657 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.166131  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:19.166972 11657 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.167419 11657 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:19.167832 11657 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:19.188632  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 223447us
I20260709 13:17:19.187767  8360 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:19.225889 11649 log.cc:927] Time spent T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
W20260709 13:17:19.228534  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.232169 11418 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.234062  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.261974 11666 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.235721  8292 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:19.262737 11492 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.262499 11666 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.243449  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.263669  8293 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:19.263507 11492 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:19.245235  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.184005 11657 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.266047 11666 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:19.266606  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 44313.7us
I20260709 13:17:19.267252 11418 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.267339  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.267644 11657 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:19.268244 11657 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:19.268738 11657 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:19.269631 11386 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.269841 11217 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.269309  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.251633  8360 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:19.254570  8186 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:19.255810  8361 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:19.244585  8290 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:19.264169 11428 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:19.262728  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:19.267766 11501 raft_consensus.cc:3055] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:19.277014  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:19.269575 11657 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.283107  8365 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:19.280030 11571 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:19.275389 11670 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.275485 11593 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.291838 11664 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.282559 11501 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:19.298130 11664 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.298619 11501 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.299193 11593 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:19.297338 11670 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.300400  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.283035 11477 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:19.299901 11501 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.292562 11321 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.296753 11492 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:19.321012 11656 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:19.321494  8366 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:19.322544  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:19.322763 11656 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.323114  8365 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:19.323215 11656 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.323613  8183 leader_election.cc:400] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10.
I20260709 13:17:19.326989 11660 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:19.328485 11533 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.329874 11618 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:19.331440 11217 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.332878  8292 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:19.333384 11656 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.334915  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:19.335558  8364 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:19.337311 11670 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.338371 11492 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:19.339169  8365 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:19.339298 11492 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.344726 11664 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:19.347193  8293 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:19.283407 11428 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.351765  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:19.352999  8363 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
W20260709 13:17:19.352389  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.354015 11428 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.313736 11571 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:19.355202 11571 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.360009  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.360211  8292 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:19.361431  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:19.361572  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.362349  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.359052  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.362926  8287 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:19.363104  8293 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:19.365607  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:19.366358  8364 raft_consensus.cc:2393] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:19.368484  8186 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:19.368592 11501 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:19.369271 11451 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:19.369364  8186 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:19.369844 11451 raft_consensus.cc:697] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:19.370193  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:19.371143 11659 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.371556 11659 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.371721 11670 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.371974 11659 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.372125 11670 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.372538 11670 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.372718 11321 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:19.374464 11618 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.375540  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:19.370721 11451 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:19.379323  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60300us
I20260709 13:17:19.380273  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:19.381125  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.391331 11501 consensus_queue.cc:1243] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:19.391739  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.392782  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.394187 11321 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.394560 11321 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:19.394929 11321 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.395187 11533 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:19.395581 11533 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:19.387461 11386 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.396066 11217 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.372231 11664 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:19.396572 11217 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:19.397029 11217 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.395943 11533 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.397065 11664 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.401036 11664 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.401618 11428 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:19.402240 11428 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:19.402827 11495 raft_consensus.cc:3055] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:19.403232 11495 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:19.404098 11495 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.404521 11670 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.405223 11495 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.406591 11670 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.407287 11659 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.407634  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:19.394783  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.408248  8365 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.409531  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.409701  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:19.410241  8927 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.425863  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.433465  8365 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:19.437456  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:19.445043  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.446509 11501 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:19.447186 11501 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:19.448221 11501 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.449591  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.450353  8293 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:19.451719  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 90400.3us
I20260709 13:17:19.452761  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:19.453218  8926 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:19.451664  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.454141 11386 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.454532 11386 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.454869 11386 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.455057  8258 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.456023  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.456255 11657 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:19.456773 11657 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:19.457410  8287 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:19.457597 11657 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.459064 11666 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.460780  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:19.463132  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.464464  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.424268 11514 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:19.465297  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:19.403342 11428 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.427659 11477 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.470696  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:19.471364  8287 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:17:19.472570  8924 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:19.463043  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.473356  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.475771  8923 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:19.476140  8923 pending_rounds.cc:85] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 6
I20260709 13:17:19.476348  8923 pending_rounds.cc:107] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:19.477639  8923 raft_consensus.cc:2889] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.479561  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:19.468014 11577 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.481365  8289 pending_rounds.cc:85] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 3
W20260709 13:17:19.482379  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 56625.5us
I20260709 13:17:19.484259  8289 pending_rounds.cc:107] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:19.484551  8289 raft_consensus.cc:2889] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.484568  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.487216  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.487731  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.472604 11666 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.490500  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.492144  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.493314  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.495087  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.495446  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:19.495841  8219 raft_consensus.cc:2393] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:19.495656  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.498905  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.501585  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.503147  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.504482  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:19.504798  8215 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:19.485515 11577 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:19.505545 11577 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.505738  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.506079 11654 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:19.506500  8215 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:19.506640 11654 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.507304  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.507339 11217 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.508342  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.516922  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.517668 11577 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.518072  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.508746 11514 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.495196 11553 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.520542 11514 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:19.520787 11553 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.509279  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.520514 11217 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:19.519793 11577 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:19.521178 11514 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:19.523921 11514 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.530162  8364 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:19.489988 11477 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:19.510641  8217 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:17:19.532527  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.522955 11553 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.488277 11309 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.563117  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.560426  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:19.561743  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 57356.2us
W20260709 13:17:19.566723  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 83104.4us
I20260709 13:17:19.565434  8220 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:19.564769  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:19.569247  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.569350  8213 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:19.478371 11533 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.508771 11654 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:19.572945  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:19.574402  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.575071  8364 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:19.574430  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.560846 11655 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.561174 11605 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:19.583353 11605 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:19.576902  8261 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:19.584627 11553 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:19.585027 11553 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.585369 11553 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.585738 11605 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.563753 11617 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:17:19.575978  8220 raft_consensus.cc:2376] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9. Re-sending same reply.
I20260709 13:17:19.569967  8217 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
W20260709 13:17:19.580595  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.590473  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:19.563298 11309 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:19.594376  8361 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.595125  8927 raft_consensus.cc:2410] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:19.567363 11217 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:19.597767 11217 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:19.598814 11217 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.588816 11617 raft_consensus.cc:3055] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:19.610533  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:19.613361  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.618445  8293 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.615085  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.620230  8213 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:19.608991  8216 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:19.615597  8369 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:19.616564  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.616086  8365 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:19.588796 11659 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.617492  8290 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:19.629377  8365 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:19.629508  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:19.631096  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.632730  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.601706 11309 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.564231 11386 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.640974  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.620918  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.644548  8287 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:19.644719  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.640727  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.640762  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.646080  8217 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:19.647832  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.653420  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.651098  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.601522 11404 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:19.618626 11477 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:19.617874 11617 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:19.619855 11548 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:19.664667  8294 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:19.641155 11514 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:19.658540  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 49575.5us
I20260709 13:17:19.656282  8293 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:19.658383  8295 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:19.674057  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.690230  8213 raft_consensus.cc:2368] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11.
I20260709 13:17:19.692313 11653 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:19.690264  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 100732us
I20260709 13:17:19.665432  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.696195  8924 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:19.652614 11657 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:19.697633  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.701516  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:19.673954 11652 consensus_queue.cc:1059] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:17:19.593812 11655 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:19.714250  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.718192  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:19.732580  8924 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:19.733852  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:19.742291 11533 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:19.742937 11662 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:17:19.743558 11683 log.cc:927] Time spent T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:19.656493 11669 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:17:19.733404 11514 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:19.757017  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 59449.3us
I20260709 13:17:19.697187 11548 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:19.760561  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 83593.3us
I20260709 13:17:19.750939 11657 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.773706 11656 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.776540 11685 log.cc:927] Time spent T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:19.776786 11656 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:19.777704 11688 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:17:19.777851 11577 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.778401 11577 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.779182 11656 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.779838 11669 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:19.780241 11669 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:19.781615  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 171123us
I20260709 13:17:19.782403  8892 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:19.794433  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.801764  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:19.803690  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60044.5us
I20260709 13:17:19.802635  8287 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:19.751837 11321 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.807202  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:19.807870  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:19.808456  8290 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:19.815281 11696 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.816085 11696 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:19.816704  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:19.819126  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.820183  8287 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:19.819166  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.835261  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:19.790563 11680 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:17:19.837496  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.837865  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.838435  8294 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.838886  8290 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:19.841524  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:19.842095  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.842341  8212 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:19.844116  8290 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:19.843969  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:19.846266  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.850296  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.850459  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:19.851292  8365 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:19.851819  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.854423  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:19.852468  8214 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
W20260709 13:17:19.856424 11691 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:19.856575  8219 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:19.856757  8213 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:19.857589 11533 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:19.857818 11686 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:17:19.859771  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:19.860384  8218 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
W20260709 13:17:19.838851 11685 log.cc:927] Time spent T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:17:19.849884  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 44770us
I20260709 13:17:19.863756  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:19.864259  8332 leader_election.cc:400] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11.
I20260709 13:17:19.864589  8332 leader_election.cc:403] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:19.867792  8287 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:19.866690  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.844477 11217 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.879253  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:19.879855  8289 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.884174 11664 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.884593 11664 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.884933 11664 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.874094 11386 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:19.892227 11664 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.893535  8217 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:19.892624  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:19.891886  8361 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:19.807536 11656 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:19.891462 11309 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:19.854041 11684 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.896468  8924 raft_consensus.cc:2368] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11.
W20260709 13:17:19.899520  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.906126  8289 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:19.832152 11315 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:17:19.782886 11477 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:19.917279  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:19.951277  8926 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:19.919026  8294 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:19.870543 11577 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:19.962540  8928 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:19.869926 11514 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:17:19.945935 11678 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:19.963547  8287 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:19.947327 11686 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:19.965296  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:19.992339  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:19.993474 11692 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:17:19.807145 11669 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.015312 11669 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.910638 11702 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11.
I20260709 13:17:19.994786 11664 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:19.994782  8366 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:19.999634 11548 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:20.022516  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:20.002086 11553 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.025203  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:20.026295 11553 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:20.027535 11571 raft_consensus.cc:3055] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:20.028016 11571 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:20.028918 11571 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.019589 11617 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.002673 11309 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:20.003645 11655 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:20.004271 11679 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:20.005602 11321 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:20.006491  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:20.076642  8295 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:20.007151 11709 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:20.007814 11514 consensus_queue.cc:1243] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:19.950245 11533 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.894734 11708 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.086328 11708 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:20.026834  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:20.034739  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:20.086894 11708 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.036424  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:20.088011  8361 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.040158  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:20.092379  8218 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:20.053785  8258 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.097084 11654 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:20.097581 11654 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:20.097966 11654 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:20.099102  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 72218.3us
I20260709 13:17:20.103600  8361 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:20.082297 11670 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.085543  8186 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:20.100788  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:20.080024  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 207006us
W20260709 13:17:20.111374  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 247680us
I20260709 13:17:20.115998  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.116334  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:20.120641  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.121798  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.122093 11702 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:20.122505 11702 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.122888 11702 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.123558 11309 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.124469 11706 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:20.125012 11706 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.125443 11706 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.125910  8366 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:20.133244  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:20.128325  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:20.138441  8927 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:20.140282  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.073990 11386 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:17:20.112202 11704 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:17:20.084970 11617 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.151618  8923 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:20.118129 11321 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.141796 11652 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:20.150667 11659 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.168558 11652 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:20.143383 11718 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:20.171926  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 118256us
I20260709 13:17:20.173717  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:20.174036  8258 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.146641 11481 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:20.176961  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.181715  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.185667 11386 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:20.185787 11577 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:20.186158 11386 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:20.186590 11386 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.186690  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.187443 11481 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:20.187937 11481 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.190083 11481 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:20.192010 11605 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:20.169828 11652 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.192545 11605 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:20.193434 11605 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.146812 11492 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:20.191437  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.199695  8217 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:20.148932 11593 consensus_queue.cc:1059] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:20.202589  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.179664 11666 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.204623 11670 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:20.204950 11593 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:20.213941 11593 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:20.216485 11593 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.217886 11593 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.222241 11702 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.206662 11577 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.228574  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.229315 11728 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:20.229787  8258 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:20.233134 11533 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:20.233640 11533 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.209983 11670 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:20.261879  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 121677us
I20260709 13:17:20.264693  8361 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:20.265843 11386 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.268621 11723 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.209375 11514 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.270902  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:20.270138  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 112253us
I20260709 13:17:20.272998  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.170081 11708 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.237749 11670 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.276782  8365 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:20.280670 11404 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:20.285156  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 55425us
I20260709 13:17:20.286178  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.287146 11666 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:20.287658 11666 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:20.288213 11514 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.268177 11386 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:20.270536 11577 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:20.259918 11712 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:20.262163 11701 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.332227  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:20.270833 11618 raft_consensus.cc:2764] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:20.343305  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:20.347939  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 59904.2us
I20260709 13:17:20.349426  8258 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.341367 11315 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.351020 11666 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.351998 11514 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:20.337344 11728 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:20.353374 11728 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.356194 11533 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.358778 11533 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:20.378805 11428 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:20.379439 11428 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.276963 11723 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.385970 11723 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:20.404666  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 131729us
I20260709 13:17:20.405542  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:20.408128  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 58806.2us
I20260709 13:17:20.379876 11428 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.409495  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:20.341950 11702 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:20.409879  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 66662.6us
I20260709 13:17:20.458738  8361 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:20.451416  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:20.470229  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:20.414397  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:20.471544  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 66080.5us
I20260709 13:17:20.471902  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:20.471609  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:20.345449 11654 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.479838  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:20.413509  8258 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.416746  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:20.484895  8214 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:20.410317 11577 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:20.494343  8213 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:20.496307  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.496814  8211 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:20.497664  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:20.498214  8212 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.411691 11618 raft_consensus.cc:2764] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:20.500929  8889 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.501441  8925 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:20.501511  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:20.501925  8364 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:20.412863 11605 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
W20260709 13:17:20.502069  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 88610us
I20260709 13:17:20.499284 11553 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.503233  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.503710 11709 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.416466 11386 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:17:20.397799 11706 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.509455 11593 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:20.511313 11660 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:20.511878  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:20.533298  8288 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.533494  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:20.512125  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:20.513111  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:20.513343  8291 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:20.517331  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.517323  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:20.518981  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:20.537743  8293 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:20.453668 11404 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.418286 11699 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.541558  8292 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:20.543056  8919 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:20.524997 11217 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.416911 11696 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.527128  8183 leader_election.cc:400] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11.
I20260709 13:17:20.529414 11693 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:20.521297  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.349220 11701 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.549850  8183 leader_election.cc:403] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:20.539978 11708 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:20.563403  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46153.6us
I20260709 13:17:20.563323  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.565624 11712 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:20.567915 11514 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:20.568197 11321 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:20.568408  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.548760 11593 consensus_queue.cc:1243] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:20.545564 11699 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.524384 11309 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:20.592093  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:20.572320 11657 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.593618  8889 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.596576  8215 pending_rounds.cc:85] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 3
I20260709 13:17:20.610822  8215 pending_rounds.cc:107] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:17:20.611125  8215 raft_consensus.cc:2889] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.545758 11404 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.563911 11728 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:20.529206 11726 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:17:20.550544 11386 consensus_queue.cc:1243] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:20.605903  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:20.633371  8290 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.573848 11553 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.560714 11693 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:20.612653  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 102486us
W20260709 13:17:20.623373  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 55042.1us
I20260709 13:17:20.600768 11699 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.597368 11709 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.636193 11738 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:20.636278 11713 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:20.636998 11695 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.009s	sys 0.014s
W20260709 13:17:20.648128  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 54568.4us
I20260709 13:17:20.693405  8889 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.648542  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:20.614375 11618 raft_consensus.cc:2764] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:20.610925 11217 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:20.517028  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:20.677037  8219 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:20.634927 11684 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.697358  8219 pending_rounds.cc:85] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 5
I20260709 13:17:20.702302  8219 pending_rounds.cc:107] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:20.702667  8219 raft_consensus.cc:2889] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.713649  8290 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:20.717428  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:20.695942 11695 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.009s	sys 0.015s
I20260709 13:17:20.721171  8290 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:20.753052  8290 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:20.701574 11696 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.627404 11657 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:20.754948  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 60293.1us
I20260709 13:17:20.756531 11713 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:20.765718  8293 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:20.756345 11514 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:17:20.772439  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 55115.8us
I20260709 13:17:20.773619  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.774734 11738 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:20.776219 11695 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.778061  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:20.750350 11481 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.701823 11217 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:20.757774  8258 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.761531  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.720463 11684 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:20.757273 11696 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.719779 11723 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:17:20.788647  8293 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:20.772017 11701 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:20.758246 11728 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:17:20.795105  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:20.805045  8288 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:20.789808 11533 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:20.805783 11533 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:20.806160 11533 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:20.808097 11725 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.808859 11217 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.794797 11577 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:20.810324 11217 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.794963 11386 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:20.811264 11386 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.812666 11404 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:20.813874 11386 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:20.767904 11742 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:17:20.821707  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:20.808797 11725 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.792426 11696 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.827242  8889 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.794252 11315 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:20.832086  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 76894.4us
I20260709 13:17:20.798774 11728 consensus_queue.cc:1243] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:20.836689  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:20.798300 11706 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:20.785544 11481 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.835929  8212 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:20.757829 11693 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.828125 11738 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.792251 11712 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:17:20.843405  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:20.854966  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:20.829236 11736 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:17:20.846837  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:20.833143 11709 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:20.829706 11751 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.853320  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60556us
I20260709 13:17:20.856215  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:20.826597 11618 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:17:20.840713 11315 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:20.876701 11315 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.878352 11654 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:20.859745 11749 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:20.861349  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:20.862027 11745 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.826792 11747 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:20.868664  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:20.871259  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:20.872555 11755 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.873893 11481 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:20.874150 11746 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:17:20.875715 11725 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:20.828617 11689 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:17:20.790939 11684 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.912256  8889 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:20.847283 11655 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11.
I20260709 13:17:20.918488  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:20.839627 11695 consensus_queue.cc:1059] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:17:20.853963 11404 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.912348  8286 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:20.856491 11738 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.920011  8212 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.930579  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:20.869488 11533 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.922555 11755 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.925762  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:20.927040  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 58445.5us
I20260709 13:17:20.862846 11701 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:17:20.931408  8925 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:20.920523 11747 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.926568 11706 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.881496 11751 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.928390 11404 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:20.933845 11738 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.932825 11728 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:20.949453 11695 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:20.939972 11693 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:20.958967 11712 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:17:20.969868  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:20.970395 11533 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:20.970608  8211 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:20.945747 11696 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:20.945966 11747 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.986604  8212 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:20.993541  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:20.998387  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:20.999176  8364 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:21.002650  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:21.003208  8211 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.005637  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:21.006558  8360 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:21.007854  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:20.960737 11428 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:20.971207 11706 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:17:21.008482  8366 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:20.988610 11728 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:20.991928 11386 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:21.017369  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:21.018606  8289 raft_consensus.cc:2410] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:21.008958 11751 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:21.027406 11765 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:21.051582 11752 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:17:21.051666 11309 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.032131 11728 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:21.052353 11309 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:21.023317  8186 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:21.034178 11428 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:21.042202  8211 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:21.065805  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:21.017098 11386 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:21.086529  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:21.074350 11662 raft_consensus.cc:3055] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:21.092097  8211 raft_consensus.cc:2410] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:21.068634 11654 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:21.094475 11654 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.094869 11654 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.093398 11662 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:21.106057  8363 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:17:21.106992  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:21.105965  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:21.113776  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:21.129447  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:21.133888  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:21.101732 11768 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:21.141446  8216 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:21.101086 11662 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:21.145339  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:21.143257  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 179652us
I20260709 13:17:21.130637 11217 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.149643  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:21.152531  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:21.142540 11768 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:21.155560  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:21.159457  8923 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.153861 11712 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.169330  8927 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:21.154075 11662 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.170439 11386 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:21.171037  8924 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:21.171132 11309 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:21.183426 11718 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:21.150715 11755 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:21.183919 11718 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:21.170326  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:21.151695 11217 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.184145  8216 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:21.200201  8291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36518
I20260709 13:17:21.215971  8291 raft_consensus.cc:606] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 13:17:21.216419  8291 raft_consensus.cc:614] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:21.220340 11217 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.216176 11577 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.251304  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 123225us
I20260709 13:17:21.248013  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:21.288676  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:21.291241  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:21.293134  8216 pending_rounds.cc:85] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 4
I20260709 13:17:21.293537  8216 pending_rounds.cc:107] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:21.293848  8216 raft_consensus.cc:2889] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:21.305009  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 98940.3us
I20260709 13:17:21.306217  8364 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:21.326841  8925 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:21.327311  8925 pending_rounds.cc:85] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 7
I20260709 13:17:21.327584  8925 pending_rounds.cc:107] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:21.327943  8925 raft_consensus.cc:2889] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.290405 11663 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:21.296021 11689 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:21.247344 11501 consensus_queue.cc:1059] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:17:21.295691 11695 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:21.322829 11577 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:21.294970 11718 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:21.307686 11768 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:21.331746 11663 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.745957 11663 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:21.745004 11771 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:17:21.749069 11718 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.750792 11763 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.751941 11763 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:21.416827 11781 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
W20260709 13:17:21.410180 11778 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:17:21.754503 11763 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:21.517192  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.746147 11772 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.423s	user 0.000s	sys 0.000s
W20260709 13:17:21.497802  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 60538.4us
I20260709 13:17:21.518168  8923 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
W20260709 13:17:21.673094  8365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.011s	sys 0.007s
W20260709 13:17:21.785152  8365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.012s	sys 0.007s
I20260709 13:17:21.497880  8286 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:21.417949 11780 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
W20260709 13:17:21.418889 11769 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
W20260709 13:17:21.529933 11699 consensus_meta.cc:287] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.833s	user 0.004s	sys 0.007s
W20260709 13:17:21.780622 11738 consensus_meta.cc:287] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.790s	user 0.005s	sys 0.005s
I20260709 13:17:21.518537 11533 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.419749 11775 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
I20260709 13:17:21.740650 11309 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:21.798843 11666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.004s	sys 0.020s
W20260709 13:17:21.824276  8214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.005s
W20260709 13:17:21.824676  8214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.004s	sys 0.005s
W20260709 13:17:21.815009  8924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.021s	sys 0.039s
W20260709 13:17:21.799849 11747 consensus_meta.cc:287] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.802s	user 0.011s	sys 0.001s
I20260709 13:17:21.813647 11763 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.428427  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:21.909780  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 121439us
W20260709 13:17:21.863689  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.825917 11666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.005s	sys 0.020s
I20260709 13:17:21.934966  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:21.935881  8214 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:21.903466 11728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.012s	sys 0.008s
I20260709 13:17:21.815130 11699 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:21.899335 11764 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:21.903219 11321 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:21.945185  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1542) took 1180 ms. Trace:
I20260709 13:17:21.900231 11774 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:21.330080 11785 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.631s
I20260709 13:17:21.817919 11738 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:21.420251 11664 consensus_queue.cc:1059] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.523s
I20260709 13:17:21.824054 11533 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:21.419646 11654 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:21.945797 11728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.012s	sys 0.008s
I20260709 13:17:21.949601  8290 rpcz_store.cc:276] 0709 13:17:20.764707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.764833 (+   126us) service_pool.cc:224] Handling call
0709 13:17:20.765164 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:20.778002 (+ 12838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.778075 (+    73us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:20.986126 (+208051us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b2c00010988. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fbd0aa11 00007f31fbd1a372 00007f31fd44ca01 00007f31fd41143a 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:17:20.988698 (+  2572us) log.cc:844] Serialized 52 byte log entry
0709 13:17:21.148487 (+159789us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:21.148523 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.148589 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.938987 (+790398us) raft_consensus.cc:1685] finished
0709 13:17:21.939014 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.945123 (+  6109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12280,"raft.queue_time_us":13909,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4280,"spinlock_wait_cycles":11523968,"thread_start_us":137293,"threads_started":1,"wal-append.queue_time_us":204720}
I20260709 13:17:21.833874 11309 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:21.960665  8218 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.961385  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1548) took 1009 ms. Trace:
I20260709 13:17:21.981127  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:21.953218 11801 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:21.987594  8362 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:17:21.931352 11763 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:21.983291  8294 rpcz_store.cc:276] 0709 13:17:20.951877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.952011 (+   134us) service_pool.cc:224] Handling call
0709 13:17:20.964289 (+ 12278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.976380 (+ 12091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.976429 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.986043 (+  9614us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.068179 (+ 82136us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:21.068238 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.068327 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.961134 (+892807us) raft_consensus.cc:1685] finished
0709 13:17:21.961163 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.961318 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10707,"thread_start_us":58627,"threads_started":1,"wal-append.queue_time_us":87002}
I20260709 13:17:21.983482  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 496) took 1137 ms. Trace:
I20260709 13:17:21.913889 11747 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:21.958948 11773 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.995500  8288 rpcz_store.cc:276] 0709 13:17:20.845726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.846011 (+   285us) service_pool.cc:224] Handling call
0709 13:17:20.861534 (+ 15523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.861859 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.861884 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.862318 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.989595 (+127277us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:20.989638 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.989712 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.963863 (+974151us) raft_consensus.cc:1685] finished
0709 13:17:21.963893 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.983423 (+ 19530us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2068,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":5093,"spinlock_wait_cycles":16256,"thread_start_us":125759,"threads_started":1,"wal-append.queue_time_us":279564}
I20260709 13:17:21.954054 11321 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:21.998070 11801 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:22.048975 11662 consensus_meta.cc:287] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.879s	user 0.012s	sys 0.000s
I20260709 13:17:21.953625 11764 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.045630  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1455) took 1595 ms. Trace:
I20260709 13:17:22.060782  8219 rpcz_store.cc:276] 0709 13:17:20.450441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.451426 (+   985us) service_pool.cc:224] Handling call
0709 13:17:20.473377 (+ 21951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.703204 (+229827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.045236 (+1342032us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400093b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:22.045512 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407911296}
I20260709 13:17:21.995795 11728 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:21.944185 11695 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:22.044512 11792 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 13:17:22.061599  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 71628.6us
W20260709 13:17:22.060449 11693 consensus_meta.cc:287] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.089s	user 0.012s	sys 0.004s
I20260709 13:17:22.072541  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.035071 11755 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:22.074558  8219 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:22.077092  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:22.078719 11783 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.549s	user 0.001s	sys 0.001s
I20260709 13:17:22.079226 11309 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:22.105194  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.082974 11791 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:17:22.109225  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 129259us
I20260709 13:17:22.082844 11657 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.111420  8889 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:22.085634 11666 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.022953 11773 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.118567 11805 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.119526 11577 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.120551 11804 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:22.137894 11738 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:22.128698 11706 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.138121 11812 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:22.121345 11533 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.122198 11654 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.139108 11812 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:22.138176 11804 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.140509 11812 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.125458 11747 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.142037 11804 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.138738 11706 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:22.083209 11801 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.126750 11764 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:22.134117  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1679) took 1162 ms. Trace:
I20260709 13:17:22.134042 11666 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.140699 11805 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.126065 11663 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.125985 11763 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.145772  8214 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
W20260709 13:17:22.149706  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 75905us
I20260709 13:17:22.082846 11807 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:17:22.104282 11693 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:22.074764 11728 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.085698 11755 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:22.120702 11217 consensus_meta.cc:287] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.899s	user 0.012s	sys 0.000s
I20260709 13:17:22.166054 11217 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.166653 11693 consensus_queue.cc:1243] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer d03eaa3ce81042f9b114cd00a7f41b17 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:22.168767 11217 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.155061  8213 rpcz_store.cc:276] 0709 13:17:20.971753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.133086 (+1161333us) service_pool.cc:224] Handling call
0709 13:17:22.133526 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.133730 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.133763 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.133822 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:22.133860 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.133929 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.134051 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.169488 11728 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:22.169868  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 755) took 1603 ms. Trace:
I20260709 13:17:22.170233  8926 rpcz_store.cc:276] 0709 13:17:20.566466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.566771 (+   305us) service_pool.cc:224] Handling call
0709 13:17:22.169150 (+1602379us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:17:22.169347 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.169519 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.169549 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.169589 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:22.169618 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.169694 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.169798 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36530560}
I20260709 13:17:22.162324  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:22.166559 11663 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.155221 11699 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.153105 11706 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.160867 11617 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.180207  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:22.180915  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:22.182024  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:22.171350 11773 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.183211  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:22.183990  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:22.184669  8923 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.187469  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.178023 11693 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.191733 11747 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.192101 11699 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:22.192745  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.192657 11699 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.193439  8214 raft_consensus.cc:2393] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:22.185027 11801 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:22.193125 11817 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.183580 11663 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:22.198213  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.215924 11818 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:22.211562 11808 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:22.180102 11617 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.217383 11663 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.195703 11693 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:22.254029 11755 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.257051 11819 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.251622 11808 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.287443 11808 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.289701 11817 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.257826 11819 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.296514 11684 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.298548 11820 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:17:22.299701 11477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.061s	user 0.024s	sys 0.021s
W20260709 13:17:22.300160 11477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.062s	user 0.024s	sys 0.021s
I20260709 13:17:22.302603 11805 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.308387 11748 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:22.308944 11748 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:22.310077 11748 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.320634 11663 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:22.324183  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.325476 11666 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:22.212242  8166 auto_rebalancer.cc:893] Removing replace marker failed: Replica 4cf23888b4fe42b594b9443ae6ee9cd2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:17:22.325251 11693 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:22.326282  8166 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:17:22.326591  8166 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:17:22.218402 11653 raft_consensus.cc:3055] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:22.328445 11653 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:22.328599 11699 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.329360 11653 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.219595 11773 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:22.325554 11723 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.331650 11773 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.334313 11773 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.335943 11653 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.217952  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:22.339002 11723 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.347884 11723 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:22.349454 11743 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.558s	user 0.007s	sys 0.019s
I20260709 13:17:22.370574  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.372324  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.374172  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:22.383232 11819 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.385318 11817 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.412387  8214 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.388020  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.431350  8360 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:22.432552  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.433190  8360 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:22.434284  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.434404  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.435353  8369 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:22.435273  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:22.389429  8211 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:22.436367 11711 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:22.391047 11801 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:22.400142  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 187630us
I20260709 13:17:22.436864 11711 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:22.404191  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 474) took 1532 ms. Trace:
W20260709 13:17:22.411553 11776 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.239s	user 0.005s	sys 0.012s
I20260709 13:17:22.387313  8361 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.438017 11711 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.418499 11571 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.419855  8366 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:22.439715 11711 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.420454 11309 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:22.420843 11669 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:22.440572 11669 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:22.437490 11801 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.441390 11669 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.442726 11669 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.437476  8220 rpcz_store.cc:276] 0709 13:17:20.871562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.871719 (+   157us) service_pool.cc:224] Handling call
0709 13:17:20.872837 (+  1118us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.873213 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.873255 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.160307 (+1287052us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b2c00000c88. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fbd0aa11 00007f31fbd1a372 00007f31fd44ca01 00007f31fd41143a 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:17:22.162991 (+  2684us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.401561 (+238570us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:22.401600 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.401701 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.403864 (+  2163us) raft_consensus.cc:1685] finished
0709 13:17:22.403886 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.404109 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1285,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":79,"spinlock_wait_cycles":87606144,"thread_start_us":214572,"threads_started":1,"wal-append.queue_time_us":224313}
I20260709 13:17:22.440332 11309 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.444617 11713 raft_consensus.cc:3055] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:22.445019 11713 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:22.420949  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.421743  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.445895 11713 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.420400  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.446149  8363 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:22.446954 11713 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.447189  8364 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:22.423163  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.448060  8368 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:22.448926 11404 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:22.450358 11797 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.451s	user 0.000s	sys 0.008s
W20260709 13:17:22.427965 11796 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.523s	user 0.001s	sys 0.000s
I20260709 13:17:22.461571  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2367) took 1459 ms. Trace:
I20260709 13:17:22.462011  8365 rpcz_store.cc:276] 0709 13:17:21.002320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.002451 (+   131us) service_pool.cc:224] Handling call
0709 13:17:21.002722 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.007779 (+  5057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.007809 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.009765 (+  1956us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.785721 (+775956us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.785778 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.785871 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.427230 (+641359us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:22.461233 (+ 34003us) raft_consensus.cc:1685] finished
0709 13:17:22.461262 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.461504 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54,"raft.queue_time_us":2303,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4270,"spinlock_wait_cycles":13513088,"thread_start_us":732314,"threads_started":1,"wal-append.queue_time_us":767145}
I20260709 13:17:22.464221 11321 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:22.465325  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:22.465909  8361 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:22.466301 11795 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.481s	user 0.002s	sys 0.000s
I20260709 13:17:22.467065 11807 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:22.467561 11807 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.469540 11807 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.469973 11807 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.470311  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:22.470414 11807 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:22.471067  8290 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:22.472152  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:22.472896  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1451) took 2055 ms. Trace:
I20260709 13:17:22.473268  8218 rpcz_store.cc:276] 0709 13:17:20.417059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.417188 (+   129us) service_pool.cc:224] Handling call
0709 13:17:20.453356 (+ 36168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.982864 (+1529508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.472707 (+489843us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001d4a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:22.472846 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3465760128}
I20260709 13:17:22.474563  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:22.474957  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:22.475150  8924 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:22.475373  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:22.475766  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:22.476245  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:22.476504  8928 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:22.476882  8926 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:22.477113 11670 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.477804  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:22.478057 11768 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.478917  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:22.479465  8927 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.489117  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:22.492379  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.493212  8365 raft_consensus.cc:2393] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:22.495659 11751 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.496310 11751 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.496953  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:22.497808 11428 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:22.498256 11751 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:22.499004  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:22.499895  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:22.500491  8294 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:22.501358 11808 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:22.502148 11593 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.502628 11593 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.503597  8219 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:22.504112  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:22.504797  8286 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:22.204416  8923 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
W20260709 13:17:22.453215  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.423491 11617 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:22.454871 11799 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260709 13:17:22.451898  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2374) took 1445 ms. Trace:
I20260709 13:17:22.456125  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:22.446133 11309 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.459312  8363 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:22.508059 11428 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:22.507951  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51926.2us
I20260709 13:17:22.508695 11428 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.507606  8362 rpcz_store.cc:276] 0709 13:17:21.006946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.007092 (+   146us) service_pool.cc:224] Handling call
0709 13:17:21.007352 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.992554 (+985202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.451678 (+459124us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400356454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:22.451843 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253661952}
I20260709 13:17:22.509125 11428 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.509310  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:22.510524 11666 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:22.510986 11666 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:22.511821 11666 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.519832 11745 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:22.435896  8360 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.520601 11745 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.521270 11321 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:22.521943 11321 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.522670 11745 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.524392 11321 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:22.525038 11321 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:22.525614 11321 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.528827  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.529063 11321 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.530440  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.530875 11751 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.531600  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.531491 11751 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.530920  8927 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:22.533923 11751 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:22.534564 11751 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.535344  8362 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.535060 11751 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.538341  8363 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.538437  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.539047  8364 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:22.539906  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.543123  8361 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:22.553686  8217 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:22.565682 11662 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.566268 11662 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.567498 11807 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.570829 11745 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:22.571455 11745 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.579527 11745 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.554052 11751 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:22.557267 11593 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.424815  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1681) took 1434 ms. Trace:
I20260709 13:17:22.564860 11726 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:22.584820 11726 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.585022  8213 rpcz_store.cc:276] 0709 13:17:20.990666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.169719 (+1179053us) service_pool.cc:224] Handling call
0709 13:17:22.170172 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.170547 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.170587 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.171071 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.424480 (+253409us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:22.424517 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.424577 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.424622 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:22.424632 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.424755 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12733,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5015,"thread_start_us":252964,"threads_started":1,"wal-append.queue_time_us":250554}
I20260709 13:17:22.587975  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1462) took 1645 ms. Trace:
I20260709 13:17:22.587532 11726 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:22.596828  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.597528  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.597678 11830 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.598011  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.596882  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.598234 11830 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:22.599385  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.600006  8211 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:22.598485 11809 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.600569  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 125121us
I20260709 13:17:22.601876  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:22.602582  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.604326 11315 consensus_queue.cc:1059] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.604987 11830 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:22.598636 11664 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:22.605114  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:22.608350 11653 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.590965  8216 rpcz_store.cc:276] 0709 13:17:20.942477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.248141 (+305664us) service_pool.cc:224] Handling call
0709 13:17:21.292892 (+ 44751us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:21.294609 (+  1717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.294656 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:22.481692 (+1187036us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b2c00000c88. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fbd0aa11 00007f31fbd1a372 00007f31fd44ca01 00007f31fd41143a 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:17:22.482340 (+   648us) log.cc:844] Serialized 52 byte log entry
0709 13:17:22.583433 (+101093us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:22.583488 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.583575 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.583628 (+    53us) raft_consensus.cc:1685] finished
0709 13:17:22.583641 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.587900 (+  4259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7971,"spinlock_wait_cycles":13302016,"thread_start_us":100749,"threads_started":1,"wal-append.queue_time_us":98923}
W20260709 13:17:23.232945  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.239977  8362 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
W20260709 13:17:22.919502  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.689749  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:22.802465  8919 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:22.689667  8925 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:22.631529  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:23.052778  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.243846  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1452) took 2794 ms. Trace:
I20260709 13:17:22.800745  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:22.658622  8214 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:22.615907  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:22.765074  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:23.800287  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1468) took 1035 ms. Trace:
I20260709 13:17:23.800673  8211 rpcz_store.cc:276] 0709 13:17:22.764605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.764777 (+   172us) service_pool.cc:224] Handling call
0709 13:17:23.800227 (+1035450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.293934 11653 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.689417 11726 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.803376 11726 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.711017  8291 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:17:23.379261 11684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.019s	sys 0.046s
I20260709 13:17:23.804630  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2133) took 1188 ms. Trace:
W20260709 13:17:23.804860 11684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.026s	sys 0.049s
I20260709 13:17:23.805621 11684 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.806249 11684 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:23.223060 11309 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:23.441777 11801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.031s	sys 0.024s
I20260709 13:17:23.808492 11309 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:23.809134 11801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.366s	user 0.031s	sys 0.033s
I20260709 13:17:23.809928 11801 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:22.664247  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:23.461730  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 217033us
I20260709 13:17:23.811873  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2138) took 1148 ms. Trace:
I20260709 13:17:23.221371 11711 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:23.805013  8291 rpcz_store.cc:276] 0709 13:17:22.616504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.616643 (+   139us) service_pool.cc:224] Handling call
0709 13:17:22.710575 (+ 93932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.804364 (+1093789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.804574 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.812356  8293 rpcz_store.cc:276] 0709 13:17:22.663784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.663919 (+   135us) service_pool.cc:224] Handling call
0709 13:17:23.811811 (+1147892us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.812814 11711 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.813699  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:23.813865  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:23.814563  8293 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:23.815106 11711 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:23.815420  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.359822  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:23.242143 11768 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.364200 11321 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.881385 11662 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:23.816936  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2140) took 1107 ms. Trace:
I20260709 13:17:23.883419  8295 rpcz_store.cc:276] 0709 13:17:22.709665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.709874 (+   209us) service_pool.cc:224] Handling call
0709 13:17:23.816872 (+1106998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.797803 11807 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.817515  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.366008 11808 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.489164  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:23.531080 11830 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:23.398679  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.474906 11787 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:23.243973 11725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.544s	user 0.010s	sys 0.016s
I20260709 13:17:22.710124 11533 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.651929 11666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.020s	sys 0.023s
I20260709 13:17:22.674788  8360 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:23.241633 11748 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.819612 11735 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:23.913825 11735 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:23.914245 11735 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.916678 11533 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.919390 11533 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:23.885768 11768 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.925489 11768 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:23.926256 11708 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:23.926796 11708 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:23.903014 11684 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:23.907049 11315 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.907784 11830 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:23.929239 11315 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.931216 11830 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:23.903604 11548 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.909741 11787 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.933185 11548 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.935036 11787 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:23.937875  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1839) took 1484 ms. Trace:
I20260709 13:17:22.862942  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:23.939464  8367 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:17:23.939931  8367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2393) took 1448 ms (client timeout 1814 ms). Trace:
W20260709 13:17:23.940372  8367 rpcz_store.cc:269] 0709 13:17:22.491935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.492109 (+   174us) service_pool.cc:224] Handling call
0709 13:17:22.847435 (+355326us) spinlock_profiling.cc:243] Waited 976 us on lock 0x7b5800188798. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:23.939874 (+1092439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260096}
W20260709 13:17:23.820186  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 1.20423e+06us
I20260709 13:17:23.315093  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:22.659883  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 222611us
I20260709 13:17:23.229521 11822 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:23.941586  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:23.948984  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:22.806876 11723 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.369644 11664 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.821669  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 662) took 1212 ms. Trace:
I20260709 13:17:23.221621 11693 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:23.293087 11751 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:22.764250 11809 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.805420 11726 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:23.823203  8926 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:23.069370 11762 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.018s	sys 0.020s
W20260709 13:17:23.986598 11762 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.029s	sys 0.027s
I20260709 13:17:23.986328 11726 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:23.295310  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:23.987514  8362 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:23.243256  8288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.026s	sys 0.043s
W20260709 13:17:23.988332  8288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.590s	user 0.028s	sys 0.053s
I20260709 13:17:23.988111 11726 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:23.989058  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 502) took 1810 ms. Trace:
I20260709 13:17:23.989207 11726 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:23.989804 11726 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.990422 11726 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.654306 11695 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.991052 11695 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.992766  8926 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:23.993139 11695 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:23.993324  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 663) took 1339 ms. Trace:
W20260709 13:17:23.243561  8289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.006s	sys 0.011s
W20260709 13:17:23.993902  8289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.581s	user 0.010s	sys 0.019s
I20260709 13:17:23.993677  8926 rpcz_store.cc:276] 0709 13:17:22.653930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.689511 (+ 35581us) service_pool.cc:224] Handling call
0709 13:17:23.993221 (+1303710us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.994266 11809 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:23.994624  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 501) took 1819 ms. Trace:
I20260709 13:17:23.994874  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:23.825521  8924 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:17:22.871379  8217 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1450) took 2457 ms (client timeout 1994 ms). Trace:
I20260709 13:17:23.828725  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1690) took 1639 ms. Trace:
W20260709 13:17:22.987782  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.829578  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:23.810632 11801 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:22.619570  8294 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:23.818490  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 666) took 1016 ms. Trace:
W20260709 13:17:23.796612  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.831460  8261 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.632s (SENT) [suppressed 8 similar messages]
W20260709 13:17:23.837947  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.838449  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:23.796504 11697 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.803031  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:23.829061  8215 rpcz_store.cc:276] 0709 13:17:20.449513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.449629 (+   116us) service_pool.cc:224] Handling call
0709 13:17:20.449986 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:20.622350 (+172364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.622395 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:20.635971 (+ 13576us) log.cc:844] Serialized 52 byte log entry
0709 13:17:22.424540 (+1788569us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b18003b1d60. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:17:22.516326 (+ 91786us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:22.516376 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.840999 (+324623us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400035cd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:22.841080 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.841172 (+    92us) raft_consensus.cc:1685] finished
0709 13:17:22.841197 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.243788 (+402591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28808,"raft.queue_time_us":119,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":18204,"spinlock_wait_cycles":340742784,"thread_start_us":91582,"threads_started":1,"wal-append.queue_time_us":1862879,"wal-append.run_cpu_time_us":1516,"wal-append.run_wall_time_us":1003109}
I20260709 13:17:23.874680  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:23.927852 11708 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:23.865872  8219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.006s	sys 0.017s
I20260709 13:17:23.874933  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:23.810685 11309 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:23.839524 11713 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.840782  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:23.877314  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.877368  8368 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:23.798560 11745 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:23.884775  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:23.887670  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:23.840938 11653 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:17:23.902786  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:23.904608 11808 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:23.938273  8360 rpcz_store.cc:276] 0709 13:17:22.424554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.435076 (+ 10522us) service_pool.cc:224] Handling call
0709 13:17:23.909026 (+1473950us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.935719 11548 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:23.904358 11725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.213s	user 0.014s	sys 0.018s
W20260709 13:17:23.908721 11666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.022s	sys 0.023s
I20260709 13:17:23.953048  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:23.954777  8925 rpcz_store.cc:276] 0709 13:17:22.609302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.609540 (+   238us) service_pool.cc:224] Handling call
0709 13:17:22.689486 (+ 79946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.821432 (+1131946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.821618 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.931852 11315 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:23.961508  8186 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:23.968564  8116 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 6 to 7, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 7 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.970170  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:23.972417  8920 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:23.953758 11698 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:23.953900 11533 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:23.985247 11664 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:23.989409  8288 rpcz_store.cc:276] 0709 13:17:22.178344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.178508 (+   164us) service_pool.cc:224] Handling call
0709 13:17:22.183878 (+  5370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.184136 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:22.398344 (+214208us) log.cc:844] Serialized 14 byte log entry
0709 13:17:23.988740 (+1590396us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.988790 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:23.988831 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.988891 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.988985 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11735,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":1793608,"threads_started":2,"wal-append.queue_time_us":1131032}
W20260709 13:17:22.905141  8117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 189) took 12056 ms (client timeout 15000 ms). Trace:
I20260709 13:17:22.957432 11428 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:23.944836 11753 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:23.901177 11807 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.187047  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1470) took 1342 ms. Trace:
I20260709 13:17:24.139631  8216 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:23.899290 11321 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:24.140084  8219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.013s	sys 0.017s
I20260709 13:17:23.998075  8928 pending_rounds.cc:85] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 7
W20260709 13:17:24.140568  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 299884us
I20260709 13:17:24.140690  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2136) took 1521 ms. Trace:
W20260709 13:17:24.141361  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 188381us
I20260709 13:17:24.141851  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 665) took 1340 ms. Trace:
I20260709 13:17:24.142354  8214 rpcz_store.cc:276] 0709 13:17:22.189769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.373905 (+184136us) service_pool.cc:224] Handling call
0709 13:17:23.828652 (+1454747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.142963  8923 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.187403  8218 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
W20260709 13:17:24.190644  8921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 667) took 1388 ms (client timeout 1820 ms). Trace:
W20260709 13:17:24.139849  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 178404us
I20260709 13:17:24.192919  8295 raft_consensus.cc:2410] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:24.193325  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 668) took 1390 ms. Trace:
I20260709 13:17:24.229914  8928 pending_rounds.cc:107] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:17:23.995018  8289 rpcz_store.cc:276] 0709 13:17:22.175431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.175666 (+   235us) service_pool.cc:224] Handling call
0709 13:17:22.178141 (+  2475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.178338 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:22.180338 (+  2000us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.413194 (+232856us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b180013d8c0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb123a 00007f31fd41ba2a
0709 13:17:23.994316 (+1581122us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.994362 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:23.994416 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.994474 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.994572 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3958,"prepare.queue_time_us":1850,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2091,"spinlock_wait_cycles":5723008,"thread_start_us":1580930,"threads_started":1,"wal-append.queue_time_us":1571412}
I20260709 13:17:24.142184  8922 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
W20260709 13:17:24.142211  8217 rpcz_store.cc:269] 0709 13:17:20.413966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.414132 (+   166us) service_pool.cc:224] Handling call
0709 13:17:22.871084 (+2456952us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b5400377b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:22.871248 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4773362944}
I20260709 13:17:24.232131  8924 rpcz_store.cc:276] 0709 13:17:22.801504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.850628 (+ 49124us) service_pool.cc:224] Handling call
0709 13:17:23.825274 (+974646us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.141617 (+316343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.141803 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12160}
I20260709 13:17:24.232647  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:24.233467  8293 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.233354  8294 rpcz_store.cc:276] 0709 13:17:22.618928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.619052 (+   124us) service_pool.cc:224] Handling call
0709 13:17:22.619357 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.140458 (+1521101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.140638 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.234915  8294 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:24.235405  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2143) took 1044 ms. Trace:
I20260709 13:17:24.235698  8294 rpcz_store.cc:276] 0709 13:17:23.190901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.234355 (+1043454us) service_pool.cc:224] Handling call
0709 13:17:24.234635 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.235206 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.235358 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.191165  8212 rpcz_store.cc:276] 0709 13:17:22.844839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.964795 (+119956us) service_pool.cc:224] Handling call
0709 13:17:23.884611 (+919816us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:24.186995 (+302384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501248}
I20260709 13:17:23.954073 11822 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:23.956212 11723 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:24.231702  8922 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 670) took 1428 ms (client timeout 1852 ms). Trace:
W20260709 13:17:24.414752  8213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.182s	user 0.016s	sys 0.053s
W20260709 13:17:24.551949  8183 connection.cc:256] RPC call timeout handler was delayed by -1.9895574330000727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 13:17:24.476514  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.183s	user 0.039s	sys 0.074s
W20260709 13:17:24.606952  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.314s	user 0.040s	sys 0.080s
I20260709 13:17:24.391943  8286 raft_consensus.cc:2410] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:17:24.314087  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.610250  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.612404  8183 connection.cc:256] RPC call timeout handler was delayed by -1.9443427299997893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:17:24.233168 11315 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:24.281988  8290 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:23.967935 11693 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:24.393079  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.566039  8213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.016s	sys 0.064s
I20260709 13:17:24.195853 11697 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.627125 11571 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:24.627714 11571 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.301854  8293 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:24.257026  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:24.141211  8919 rpcz_store.cc:276] 0709 13:17:22.801867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.801987 (+   120us) service_pool.cc:224] Handling call
0709 13:17:22.802274 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.818260 (+1015986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.818432 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.568085  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2146) took 1170 ms. Trace:
I20260709 13:17:24.077104 11830 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.630095 11830 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:24.631047  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.631177  8215 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:24.233767 11753 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:24.565900  8922 rpcz_store.cc:269] 0709 13:17:22.803228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.803963 (+   735us) service_pool.cc:224] Handling call
0709 13:17:23.880061 (+1076098us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:24.231635 (+351574us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345460480}
W20260709 13:17:24.230321  8921 rpcz_store.cc:269] 0709 13:17:22.802149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.802666 (+   517us) service_pool.cc:224] Handling call
0709 13:17:24.190582 (+1387916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.276031  8923 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:24.230115  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1469) took 1385 ms. Trace:
I20260709 13:17:24.278000  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 558) took 1035 ms. Trace:
I20260709 13:17:24.231900  8920 rpcz_store.cc:276] 0709 13:17:22.802469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.805303 (+  2834us) service_pool.cc:224] Handling call
0709 13:17:23.971760 (+1166457us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:17:23.972021 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.193080 (+221059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.193261 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347249536}
I20260709 13:17:24.280874  8292 raft_consensus.cc:2368] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10.
I20260709 13:17:24.565282  8928 raft_consensus.cc:2889] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.360280  8116 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:24.190879 11662 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:24.629645  8294 rpcz_store.cc:276] 0709 13:17:23.398170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.277460 (+879290us) service_pool.cc:224] Handling call
0709 13:17:24.563605 (+286145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.563861 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.563899 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.563953 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:24.563995 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.567892 (+  3897us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.568012 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.192659 11745 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.191534 11809 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:24.149446 11711 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.633119  8923 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 661) took 2024 ms (client timeout 1974 ms). Trace:
I20260709 13:17:24.634084 11711 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.632730 11830 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.162629 11695 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.635119 11745 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.188395 11533 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:24.322047 11548 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:24.611116  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:24.636334  8924 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [7.7-9.8]
W20260709 13:17:24.186663  8117 rpcz_store.cc:269] 0709 13:17:10.849053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.849220 (+   167us) service_pool.cc:224] Handling call
0709 13:17:22.905038 (+12055818us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:19.332444 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:19.333292 (+   848us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:19.333362 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:17:19.333390 (+    28us) tablet.cc:662] Decoding operations
0709 13:17:19.335073 (+  1683us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:19.335146 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:19.335173 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:17:19.481858 (+146685us) tablet.cc:701] Row locks acquired
0709 13:17:19.495147 (+ 13289us) write_op.cc:260] PREPARE: finished
0709 13:17:19.515523 (+ 20376us) write_op.cc:270] Start()
0709 13:17:19.515673 (+   150us) write_op.cc:276] Timestamp: P: 1783603039515451 usec, L: 0
0709 13:17:19.515695 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:19.516428 (+   733us) log.cc:844] Serialized 5866 byte log entry
0709 13:17:20.156244 (+639816us) op_driver.cc:464] REPLICATION: finished
0709 13:17:20.225318 (+ 69074us) write_op.cc:301] APPLY: starting
0709 13:17:20.225400 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:20.225692 (+   292us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:20.225803 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:20.227123 (+  1320us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:20.227370 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:17:20.227413 (+    43us) write_op.cc:312] APPLY: finished
0709 13:17:20.227706 (+   293us) log.cc:844] Serialized 107 byte log entry
0709 13:17:20.268448 (+ 40742us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:20.268645 (+   197us) write_op.cc:454] Released schema lock
0709 13:17:20.268703 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:20.335465 (+ 66762us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:20.338208 (+  2743us) write_op.cc:454] Released schema lock
0709 13:17:21.053100 (+714892us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd40e32a 00007f31fd393f14 00007f31fd393ec3 00007f31fd393e38 00007f31fd393df3 00007f31fd3930dc 00007f31fd3bce16 00007f31fd3a4cbb 00007f31fd38f39d 00007f31fd392d75
Metrics: {"mutex_wait_us":108756,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":54532,"apply.run_cpu_time_us":3319,"apply.run_wall_time_us":46158,"num_ops":15,"prepare.queue_time_us":97375,"prepare.run_cpu_time_us":23876,"prepare.run_wall_time_us":272030,"raft.queue_time_us":298149,"raft.run_cpu_time_us":7314,"raft.run_wall_time_us":967723,"replication_time_us":603471,"spinlock_wait_cycles":9315072,"thread_start_us":212731,"threads_started":4,"wal-append.queue_time_us":172596,"wal-append.run_cpu_time_us":4791,"wal-append.run_wall_time_us":1533514}]]}
I20260709 13:17:24.635738 11745 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:24.629768 11697 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:24.605402  8287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.020s	sys 0.037s
I20260709 13:17:24.638042 11309 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:24.638340  8287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.020s	sys 0.037s
I20260709 13:17:24.638541 11309 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:24.638731  8258 connection.cc:256] RPC call timeout handler was delayed by -1.32888602800017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:17:24.639070  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2139) took 1956 ms. Trace:
I20260709 13:17:24.640058  8220 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:24.254561 11774 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:24.637507 11745 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.641172 11774 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.642882 11745 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.633353  8218 rpcz_store.cc:276] 0709 13:17:22.844416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.845868 (+  1452us) service_pool.cc:224] Handling call
0709 13:17:24.230049 (+1384181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944}
I20260709 13:17:24.634559  8116 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.997244 11751 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.635730 11533 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.639487  8287 rpcz_store.cc:276] 0709 13:17:22.682864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.683026 (+   162us) service_pool.cc:224] Handling call
0709 13:17:22.793913 (+110887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.794172 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:23.797888 (+1003716us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.638771 (+840883us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.638820 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:24.638860 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.638922 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.639021 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1003168,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"thread_start_us":840540,"threads_started":1}
I20260709 13:17:24.635954 11695 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:24.540400 11841 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:17:24.254086  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:24.322356 11664 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:24.634446  8923 rpcz_store.cc:269] 0709 13:17:22.608995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.653824 (+ 44829us) service_pool.cc:224] Handling call
0709 13:17:23.887502 (+1233678us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:24.633052 (+745550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345444224}
W20260709 13:17:24.646656  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.635200  8925 rpcz_store.cc:276] 0709 13:17:23.242464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.192952 (+950488us) service_pool.cc:224] Handling call
0709 13:17:24.277420 (+ 84468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.277587 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.277626 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.277680 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:24.277737 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.277808 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.277936 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.191061 11713 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.639081 11309 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:24.663332  8334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.040s	sys 0.080s
W20260709 13:17:24.663777  8334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.040s	sys 0.080s
I20260709 13:17:24.652745 11315 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:24.664734  8259 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.029s	sys 0.042s
W20260709 13:17:24.665153  8259 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.029s	sys 0.043s
I20260709 13:17:24.666054 11428 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.666409  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 559) took 1423 ms. Trace:
I20260709 13:17:24.666649 11428 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:24.666776  8926 rpcz_store.cc:276] 0709 13:17:23.242744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.253749 (+1011005us) service_pool.cc:224] Handling call
0709 13:17:24.666350 (+412601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.667245 11695 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.669859 11695 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.670692 11428 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.667400 11664 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.672820 11428 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.673502 11428 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:24.673689 11664 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.656365 11809 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:24.673990 11428 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.674829 11809 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.678200 11751 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:24.678627 11571 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.669890 11713 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.681633 11807 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.684815  8291 raft_consensus.cc:2410] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:24.633193 11753 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.644023 11774 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.666007 11315 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.654486 11662 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:24.636586 11548 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.701592 11321 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.675997 11428 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.706375  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1471) took 1861 ms. Trace:
I20260709 13:17:24.706817  8220 rpcz_store.cc:276] 0709 13:17:22.845147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.982076 (+136929us) service_pool.cc:224] Handling call
0709 13:17:23.889245 (+907169us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:17:23.889475 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.640769 (+751294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.706118 (+ 65349us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54001b3354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:24.706309 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905686528}
W20260709 13:17:24.708587  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.708984  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:24.709749  8289 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.711033  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2137) took 2047 ms. Trace:
I20260709 13:17:24.713668  8290 rpcz_store.cc:276] 0709 13:17:22.663405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.663585 (+   180us) service_pool.cc:224] Handling call
0709 13:17:22.804183 (+140598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.613981 (+1809798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.710761 (+ 96780us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540005a5d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:24.710964 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3397532416}
W20260709 13:17:24.720613 11852 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:24.706597 11711 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.724964  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:24.726207 11822 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.727252 11723 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.728984  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1465) took 2130 ms. Trace:
W20260709 13:17:24.735055  8292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2141) took 1971 ms (client timeout 1787 ms). Trace:
I20260709 13:17:24.734952  8116 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 4 to 6, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 6 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:17:24.735493  8292 rpcz_store.cc:269] 0709 13:17:22.763746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.293322 (+529576us) service_pool.cc:224] Handling call
0709 13:17:24.734866 (+1441544us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b540005c154. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:24.734989 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870547840}
I20260709 13:17:24.727792 11723 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:24.740880  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 560) took 1497 ms. Trace:
I20260709 13:17:24.741437  8924 rpcz_store.cc:276] 0709 13:17:23.242981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.275299 (+1032318us) service_pool.cc:224] Handling call
0709 13:17:24.329891 (+ 54592us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:24.636781 (+306890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.740516 (+103735us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002c1fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:24.740804 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704053504}
W20260709 13:17:24.743323  8291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2142) took 1943 ms (client timeout 1780 ms). Trace:
W20260709 13:17:24.743862  8291 rpcz_store.cc:269] 0709 13:17:23.096859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.813410 (+716551us) service_pool.cc:224] Handling call
0709 13:17:24.743062 (+929652us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400024c54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:24.743238 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001149312}
W20260709 13:17:24.744871  8286 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2134) took 2116 ms (client timeout 1663 ms). Trace:
W20260709 13:17:24.745390  8286 rpcz_store.cc:269] 0709 13:17:22.616970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.617098 (+   128us) service_pool.cc:224] Handling call
0709 13:17:24.733498 (+2116400us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400388954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:24.733691 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292001152}
I20260709 13:17:24.729424  8219 rpcz_store.cc:276] 0709 13:17:22.598751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.598884 (+   133us) service_pool.cc:224] Handling call
0709 13:17:22.599221 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.230361 (+631140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.230391 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.230904 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.230937 (+1000033us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:24.230975 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.728627 (+497652us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b54001d4054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:24.728678 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.728721 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:24.728735 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.728928 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":801843,"raft.queue_time_us":640746,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":66550,"spinlock_wait_cycles":3857280,"thread_start_us":999688,"threads_started":1,"wal-append.queue_time_us":1339787}
I20260709 13:17:24.706439 11745 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.712124 11321 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:24.700376 11309 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.740331 11801 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.756685 11321 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:24.780826  8116 catalog_manager.cc:5697] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 5 to 6, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 6 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.756273 11723 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.757819 11745 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.762737 11662 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:24.797622 11748 consensus_meta.cc:287] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.847s	user 0.007s	sys 0.004s
I20260709 13:17:24.799595 11693 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:24.815924  8116 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 7, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 7 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.861464  8116 catalog_manager.cc:5697] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 5 to 6, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 6 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.811486 11548 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:24.863325  8927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.057s	user 0.045s	sys 0.119s
W20260709 13:17:24.865564  8927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.045s	sys 0.119s
I20260709 13:17:24.797401 11321 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.872839 11309 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:24.886025  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.007s	sys 0.022s
W20260709 13:17:24.911449  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.008s	sys 0.022s
W20260709 13:17:24.911861  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 962822us
I20260709 13:17:24.898536  8289 raft_consensus.cc:2410] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:24.915304  8116 catalog_manager.cc:5697] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 6 to 7, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
W20260709 13:17:24.909940  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.007s	sys 0.010s
W20260709 13:17:24.916978  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.007s	sys 0.010s
W20260709 13:17:24.885761 11689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.009s	sys 0.022s
I20260709 13:17:24.920835  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2150) took 1267 ms. Trace:
I20260709 13:17:24.930462  8289 rpcz_store.cc:276] 0709 13:17:23.653973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.231427 (+577454us) service_pool.cc:224] Handling call
0709 13:17:24.708795 (+477368us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:24.920755 (+211960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4881664}
I20260709 13:17:24.909106 11708 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:24.917289  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 685742us
I20260709 13:17:24.939095  8186 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:24.927749  8261 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.002s	sys 0.007s
W20260709 13:17:24.881755  8260 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.182s	user 0.010s	sys 0.020s
W20260709 13:17:24.940367  8260 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.010s	sys 0.020s
I20260709 13:17:24.928890  8116 catalog_manager.cc:5697] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 3 to 5, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 5 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:24.918395 11808 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:24.892206 11826 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.018s	sys 0.047s
W20260709 13:17:24.936513 11689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.010s	sys 0.023s
I20260709 13:17:24.936623  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:24.944428 11309 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:24.944918  8186 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:24.936344 11723 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.949144  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:24.947358 11826 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.019s	sys 0.050s
I20260709 13:17:24.951545  8186 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:24.953429  8261 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.003s	sys 0.007s
I20260709 13:17:24.941653 11803 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:24.955686  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 1.12412e+06us
W20260709 13:17:24.927057  8333 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.010s	sys 0.011s
W20260709 13:17:24.957501  8333 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.010s	sys 0.011s
I20260709 13:17:24.956365  8116 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 5 to 8, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 8 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:24.960928  8892 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.004s	sys 0.008s
I20260709 13:17:24.950421 11857 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:24.983843  8369 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:17:24.985044  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:24.985703  8369 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:24.987138  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:24.987931  8369 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:24.949393 11745 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:24.948223 11309 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:24.955344 11725 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.974660  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:24.989528  8116 catalog_manager.cc:5697] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:24.993188  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 379987us
I20260709 13:17:24.993232  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:24.957460 11803 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:24.975486  8892 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.005s	sys 0.009s
W20260709 13:17:24.996330  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 937594us
W20260709 13:17:24.999542  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.977065  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.000499  8362 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:24.978729  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.001322  8361 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:25.001530  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.002342  8926 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:24.982097  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:24.954890 11762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.008s	sys 0.005s
W20260709 13:17:24.963932 11726 consensus_meta.cc:287] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.973s	user 0.014s	sys 0.000s
I20260709 13:17:24.991428  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:24.999804  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.020135  8261 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:24.980382  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.003970  8363 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:24.961583 11698 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:25.018848  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.025238  8365 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 5.
I20260709 13:17:25.019717  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.025349  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:24.993743  8183 connection.cc:256] RPC call timeout handler was delayed by -1.8534427299998697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
I20260709 13:17:25.021499  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:25.026803  8183 connection.cc:256] RPC call timeout handler was delayed by -1.811476323999841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 13:17:25.028211  8923 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:25.028306  8361 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:25.031298  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.031832  8926 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:25.032723  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.033007  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.033635  8919 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:25.033778  8286 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:25.033806  8116 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 4 to 7, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 7 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.983235 11655 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.983050 11753 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.983181 11571 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.036336  8116 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 3 to 8, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 8 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.037982  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:25.010947 11684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.033s	sys 0.060s
I20260709 13:17:25.046877  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:24.974915 11870 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:25.022953 11762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.008s	sys 0.005s
I20260709 13:17:25.003746 11803 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.992314 11725 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.044116  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.040998  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:25.056089  8220 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
W20260709 13:17:25.045614  8183 connection.cc:256] RPC call timeout handler was delayed by -1.7648119299999507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
I20260709 13:17:25.057016  8211 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:25.057212  8183 connection.cc:256] RPC call timeout handler was delayed by -1.6487119299999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260709 13:17:25.057315  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:25.057600  8183 connection.cc:256] RPC call timeout handler was delayed by -1.4313923539998541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
I20260709 13:17:25.058120  8291 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:25.058413 11859 log.cc:927] Time spent T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:17:25.055604  8925 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:25.032218 11698 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.045826  8116 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 5 to 6, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 6 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:25.042625  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:25.047317 11684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.033s	sys 0.061s
I20260709 13:17:25.039028  8261 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:25.047572  8919 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:25.052239 11735 consensus_meta.cc:287] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 1.138s	user 0.013s	sys 0.001s
I20260709 13:17:25.053305  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.002190 11856 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.064914  8218 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:25.082082  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:25.093291  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 54348.6us
I20260709 13:17:25.039693 11858 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.036394 11548 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:17:25.036795 11854 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:17:25.033212 11726 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:24.994263 11857 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.045006 11745 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:17:25.044799 11808 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:17:25.051769 11571 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.052423 11753 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:25.228297  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 165913us
I20260709 13:17:25.155246  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:25.106585  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.095155  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:25.063284  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.159297  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:25.033315 11867 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:25.151701  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.583550  8293 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
W20260709 13:17:25.584661  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.095194  8292 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:25.095152  8926 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:25.275285  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:25.590186  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 598762us
I20260709 13:17:25.048709 11830 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.049316 11492 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.060338 11725 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.593415  8364 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:25.453073  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:25.605012 11801 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:25.605705  8290 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:25.596498  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:25.285713  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.584268  8294 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
W20260709 13:17:25.600245  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.048629 11855 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:25.608660 11855 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:25.609433 11855 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.610332 11808 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:25.273617 11853 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.328s	user 0.000s	sys 0.000s
I20260709 13:17:25.605019 11872 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:25.613107 11872 consensus_queue.cc:1243] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:17:25.231684  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46964.5us
I20260709 13:17:25.613693  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1464) took 3015 ms. Trace:
W20260709 13:17:25.614924  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.615512  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.605757 11801 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:25.607856 11874 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:25.614174  8213 rpcz_store.cc:276] 0709 13:17:22.598432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.599241 (+   809us) service_pool.cc:224] Handling call
0709 13:17:22.604517 (+  5276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.231465 (+626948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.231499 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.231916 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.626872 (+1394956us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:24.626928 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.627023 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.613449 (+986426us) raft_consensus.cc:1685] finished
0709 13:17:25.613481 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.613629 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":799355,"raft.queue_time_us":687888,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"thread_start_us":1394505,"threads_started":1,"wal-append.queue_time_us":1682667}
I20260709 13:17:25.611682  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:25.618167 11874 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.616554 11801 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.618462  8261 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:25.618788  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.619527 11801 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.620309 11874 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:25.620784 11874 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:25.621223 11874 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.629585  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:25.618165  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.595336  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:25.061327 11698 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.059301 11870 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:25.642738  8368 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:25.094132 11693 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:25.274231 11860 log.cc:927] Time spent T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.306s	user 0.000s	sys 0.000s
I20260709 13:17:25.643265  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.048857 11655 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.210301 11315 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:25.591509 11854 consensus_queue.cc:1243] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:25.381456 11684 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:25.620333  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:25.594368 11867 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:25.650974  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:25.275983 11762 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:25.652618  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.603132 11745 consensus_queue.cc:1243] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer d03eaa3ce81042f9b114cd00a7f41b17 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:17:25.644569 11662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.023s
I20260709 13:17:25.106381 11735 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:25.656991  8925 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:25.659049  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.702186 11653 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.703004 11548 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.702842 11653 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.697890 11684 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:25.706231 11684 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:25.710326 11571 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:25.713327 11876 log.cc:927] Time spent T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:17:25.657933 11867 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:25.714680 11533 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 1.031s	user 0.009s	sys 0.002s
I20260709 13:17:25.661485 11808 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:25.715085 11533 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:25.716082  8363 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:25.716826  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1700) took 1879 ms. Trace:
I20260709 13:17:25.717293  8211 rpcz_store.cc:276] 0709 13:17:23.837429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.234495 (+397066us) service_pool.cc:224] Handling call
0709 13:17:24.234754 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.057430 (+822676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.716556 (+659126us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400037ad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:25.716757 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890541824}
I20260709 13:17:25.718744 11874 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.721946 11753 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:25.722463 11753 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:25.722954 11753 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.597630 11856 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.727192  8289 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:25.721459 11865 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.358s	user 0.004s	sys 0.006s
W20260709 13:17:25.771312  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 142259us
I20260709 13:17:25.789048  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:25.772617  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:25.773556 11807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.001s	sys 0.000s
W20260709 13:17:25.773644  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.001s	sys 0.000s
W20260709 13:17:25.793462  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.001s	sys 0.001s
I20260709 13:17:25.793747  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:25.727500 11723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.013s	sys 0.043s
I20260709 13:17:25.637708 11492 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:25.597743 11858 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:25.778244  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 660) took 3169 ms. Trace:
W20260709 13:17:25.824174  8924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.012s	sys 0.009s
I20260709 13:17:25.643982 11830 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:25.832544  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 181655us
I20260709 13:17:25.807225  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:25.833292  8925 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:25.791965  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:25.658473 11864 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:25.790943  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:25.779310 11809 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:25.793848  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 742881us
W20260709 13:17:25.824739  8924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.013s	sys 0.009s
W20260709 13:17:25.806654 11878 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.568s	user 0.000s	sys 0.001s
I20260709 13:17:25.824529  8927 rpcz_store.cc:276] 0709 13:17:22.608707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.608831 (+   124us) service_pool.cc:224] Handling call
0709 13:17:22.609140 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.800478 (+191338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.800508 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.805690 (+1005182us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b2c00047618. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fbd0aa11 00007f31fbd1a372 00007f31fd44ca01 00007f31fd41143a 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:17:23.806128 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.865954 (+1059826us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:24.865993 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.866060 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.724627 (+858567us) raft_consensus.cc:1685] finished
0709 13:17:25.724650 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.778165 (+ 53515us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152058,"raft.queue_time_us":146692,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":407016320,"thread_start_us":1059443,"threads_started":1,"wal-append.queue_time_us":1138245}
W20260709 13:17:25.793375 11807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.001s	sys 0.001s
W20260709 13:17:25.698016 11662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.000s	sys 0.024s
I20260709 13:17:25.837204  8362 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:25.808923 11723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.013s	sys 0.043s
I20260709 13:17:25.795398 11309 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:25.843080  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 51176.1us
I20260709 13:17:25.822530 11869 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:25.700202 11762 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.807616 11451 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:17:25.848902  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 257987us
I20260709 13:17:25.847970  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:25.724813 11315 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:25.851541  8215 raft_consensus.cc:606] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:25.844292  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 48490.1us
I20260709 13:17:25.836687 11864 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.866169  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:25.866989  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:25.840783 11809 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:25.847820 11617 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:25.870947  8219 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:25.871629  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:26.011665 11879 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 13:17:26.012378 11653 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:26.016304 11753 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:26.011504 11655 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:26.019816  8922 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:25.850492 11869 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.004683  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:25.930514  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 61763us
I20260709 13:17:25.871773  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:25.872252  8212 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:26.021404  8211 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:26.026459  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 765) took 1025 ms. Trace:
I20260709 13:17:25.892683  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.044714  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:26.045622  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 179534us
I20260709 13:17:26.046463  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.048167  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:26.045326  8924 rpcz_store.cc:276] 0709 13:17:25.000837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.000985 (+   148us) service_pool.cc:224] Handling call
0709 13:17:25.039912 (+ 38927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.040259 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.040285 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.040711 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.841685 (+800974us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.841742 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.841832 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.026226 (+184394us) raft_consensus.cc:1685] finished
0709 13:17:26.026245 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.026400 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":467,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7277,"thread_start_us":687177,"threads_started":1,"wal-append.queue_time_us":801745}
I20260709 13:17:26.049242  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48574 (request call id 13) took 1337 ms. Trace:
I20260709 13:17:26.050055  8215 rpcz_store.cc:276] 0709 13:17:24.712278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.724804 (+ 12526us) service_pool.cc:224] Handling call
0709 13:17:25.930139 (+1205335us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540019a354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd40b853 00007f32023d960a 00007f31fb95f7d4 00007f31fb95f762 00007f31fb95f691 00007f31fb95f60c 00007f31fb95e8c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:26.043332 (+113193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589463808}
I20260709 13:17:26.048569  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:25.864679 11751 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.041170 11708 consensus_meta.cc:287] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.099s	user 0.007s	sys 0.004s
I20260709 13:17:25.842456 11870 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.017362 11894 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:26.057260  8215 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:26.010980 11874 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:26.056107  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 664) took 3255 ms. Trace:
I20260709 13:17:26.054217 11892 raft_consensus.cc:2764] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:26.121587  8928 rpcz_store.cc:276] 0709 13:17:22.801071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.804836 (+  3765us) service_pool.cc:224] Handling call
0709 13:17:23.997567 (+1192731us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5800183998. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ece9c 00007f31fa2eca5b 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:17:23.997788 (+   221us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:24.686030 (+688242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.686073 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:24.702490 (+ 16417us) log.cc:844] Serialized 78 byte log entry
0709 13:17:25.017002 (+314512us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:25.017065 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.017171 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.055805 (+1038634us) raft_consensus.cc:1685] finished
0709 13:17:26.055825 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.056031 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30840,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7777,"spinlock_wait_cycles":77228288,"thread_start_us":267568,"threads_started":1,"wal-append.queue_time_us":336055}
W20260709 13:17:26.074648  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.057440 11315 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:26.059170 11803 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.995s	user 0.009s	sys 0.000s
I20260709 13:17:26.149382 11803 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.091522  8923 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:26.041386 11809 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.045972 11617 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.048604 11869 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.093341  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:25.871881 11864 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.094439 11309 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:26.096287  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2412) took 1089 ms. Trace:
I20260709 13:17:26.055753 11801 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:26.101686 11693 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:26.101956  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2400) took 2798 ms. Trace:
I20260709 13:17:26.105456 11858 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:26.105623  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:26.091741 11725 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.049860 11753 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:26.065927  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.116618  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:26.137036  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.135892  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2411) took 1129 ms. Trace:
I20260709 13:17:26.153596  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.159578  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 456) took 1197 ms. Trace:
I20260709 13:17:26.160578  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.265664  8364 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:26.263262  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 508) took 1224 ms. Trace:
W20260709 13:17:26.190826  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.269852  8364 pending_rounds.cc:85] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:26.271194  8364 pending_rounds.cc:107] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:17:26.270632  8289 rpcz_store.cc:276] 0709 13:17:25.038601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.038717 (+   116us) service_pool.cc:224] Handling call
0709 13:17:25.051309 (+ 12592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.727572 (+676263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.262976 (+535404us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54001a1dd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:26.263192 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553996672}
I20260709 13:17:26.277675  8364 raft_consensus.cc:2889] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.272236  8216 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:26.272439  8365 rpcz_store.cc:276] 0709 13:17:25.006289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.597763 (+591474us) service_pool.cc:224] Handling call
0709 13:17:25.644001 (+ 46238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.898445 (+254444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.898474 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.898515 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:25.898544 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.135430 (+236886us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400405954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:26.135521 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.135766 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584711040}
I20260709 13:17:26.278666  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1850) took 1239 ms. Trace:
I20260709 13:17:26.279572  8364 rpcz_store.cc:276] 0709 13:17:25.039353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.264951 (+1225598us) service_pool.cc:224] Handling call
0709 13:17:26.265313 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.278341 (+ 13028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.278597 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:26.280824 11753 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:26.281319 11753 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.281242  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.282775 11857 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:26.276664  8368 rpcz_store.cc:276] 0709 13:17:24.962422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.962544 (+   122us) service_pool.cc:224] Handling call
0709 13:17:24.971293 (+  8749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.643117 (+671824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.159316 (+516199us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b5400356e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:26.159517 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1537722752}
I20260709 13:17:26.169548 11617 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.148687 11751 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.286062 11751 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:26.286918  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 181358us
I20260709 13:17:26.287807 11857 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:26.262521 11875 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.031s	user 0.005s	sys 0.013s
I20260709 13:17:26.285673 11725 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:26.186475 11871 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.289552  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:26.290045 11871 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:26.291853 11803 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:26.292559  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.293412  8213 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:26.273761  8366 rpcz_store.cc:276] 0709 13:17:23.303225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.304193 (+   968us) service_pool.cc:224] Handling call
0709 13:17:23.797104 (+492911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.678999 (+881895us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:24.679242 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.049781 (+370539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.049827 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:25.049869 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.101708 (+1051839us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b540010ed54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:26.101758 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.101898 (+   140us) inbound_call.cc:177] Queueing success response
0709 13:17:26.261881 (+159983us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
Metrics: {"mutex_wait_us":2374,"prepare.queue_time_us":1258,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":126181,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":86799,"spinlock_wait_cycles":2231641728,"thread_start_us":367752,"threads_started":2,"wal-append.queue_time_us":375178}
I20260709 13:17:26.167565  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.290355 11857 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:26.292713 11830 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:26.093986 11883 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:26.276705  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 123911us
I20260709 13:17:26.316864  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:26.317510  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.317575  8919 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
W20260709 13:17:26.318110  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.317847  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.168591  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1846) took 1130 ms. Trace:
I20260709 13:17:26.318604  8362 rpcz_store.cc:276] 0709 13:17:25.038385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.167455 (+1129070us) service_pool.cc:224] Handling call
0709 13:17:26.167878 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.168151 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.168189 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.168247 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:26.168294 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.168366 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.168518 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:26.297397  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 180859us
I20260709 13:17:26.270475  8369 rpcz_store.cc:276] 0709 13:17:25.006546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.612024 (+605478us) service_pool.cc:224] Handling call
0709 13:17:25.612482 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.822886 (+210404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.822918 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.844476 (+ 21558us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.909320 (+ 64844us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:25.909376 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.909473 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.096070 (+186597us) raft_consensus.cc:1685] finished
0709 13:17:26.096090 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.096222 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112140,"raft.queue_time_us":234214,"spinlock_wait_cycles":13606656,"thread_start_us":114394,"threads_started":2,"wal-append.queue_time_us":230232}
I20260709 13:17:26.298964  8922 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:26.299104  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.320771  8926 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:26.299801  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.300617  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:26.310724  8360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.045s	sys 0.057s
W20260709 13:17:26.321735  8360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.045s	sys 0.057s
I20260709 13:17:26.321811  8927 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:26.321954  8213 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:26.323490  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.324760  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.325412  8213 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:26.329931  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53535408ea514f8db7292852927e7743"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:26.330647  8214 raft_consensus.cc:606] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:26.330492 11725 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:26.330021  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.336126  8219 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:26.337298  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.337579  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.337633  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.338963  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.340149  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.341897  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.342435  8289 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:26.344244  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.344519  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.344866  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:26.345132  8288 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:26.345409  8216 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.345548  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.346021  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.346140  8213 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:26.346961  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:26.347223  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.348212  8287 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:26.349555  8369 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:26.267074 11872 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:26.340797  8366 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:26.354641  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.338502  8921 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:26.350994  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.352465  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.353029  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.265908 11533 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:26.351805  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.355571 11873 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.333230 11858 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.343659 11708 consensus_queue.cc:1059] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:17:26.343660 11883 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:26.386088  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.353223 11901 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:17:26.360864  8213 raft_consensus.cc:2410] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:26.386911  8922 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:26.363209  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.326709 11801 raft_consensus.cc:697] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:26.395799  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.362826  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 672) took 1332 ms. Trace:
I20260709 13:17:26.426029  8923 rpcz_store.cc:276] 0709 13:17:25.030030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.031067 (+  1037us) service_pool.cc:224] Handling call
0709 13:17:26.362600 (+1331533us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400563bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:26.362754 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436543872}
I20260709 13:17:26.374015  8286 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:26.427069  8286 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:26.380297  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.383658  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.429155  8366 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:26.383728  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.364346  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:26.377351  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.381026  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.361374  8362 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:26.376418  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.336174 11315 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.423251  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.150972 11855 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.385388 11857 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.495370  8921 raft_consensus.cc:2393] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:26.427999  8286 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:26.491626  8368 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
W20260709 13:17:26.495383  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 8d3403855d4147a9b056dc8678880fdf: Illegal state: Replica 9e95b04d03d241329435b6d08dd1f236 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
W20260709 13:17:26.383422 11698 consensus_meta.cc:287] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.737s	user 0.005s	sys 0.001s
I20260709 13:17:26.343514 11664 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:17:26.518778  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.519631  8928 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:26.368136 11762 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:26.378037 11653 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:17:26.371148 11321 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.431404  8214 raft_consensus.cc:2410] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:17:26.511952  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.614482  8923 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:26.353698 11872 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:26.621529 11872 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.546329 11864 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:26.524516  8295 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
W20260709 13:17:26.580199  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.382139 11617 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:26.358847 11874 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
W20260709 13:17:26.478760  8160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.BulkChangeConfig -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 48516.6us
I20260709 13:17:26.503865 11315 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:26.517192 11909 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:26.597766 11867 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.883s	user 0.004s	sys 0.004s
I20260709 13:17:26.379036 11858 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:26.379230 11871 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:26.508957 11857 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.631695  8367 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:26.632201  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.631477  8216 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:26.633852  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:26.634342  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 280490us
I20260709 13:17:26.634835  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.660979  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:26.661427  8923 raft_consensus.cc:2410] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:26.363899 11693 consensus_queue.cc:1059] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.250s
I20260709 13:17:26.636185  8286 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.584527 11698 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.382967 11883 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:26.631953  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 267653us
I20260709 13:17:26.639101  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.639791  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.642464  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:26.643153  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:26.643594  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.670769  8289 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:26.364187 11807 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.252s
I20260709 13:17:26.657199  8295 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:26.658288  8183 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:26.663359  8889 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:26.670074  8921 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:26.635215  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:26.378647 11873 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:26.654757 11872 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:26.680575  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.657738 11858 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.686178  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.689666  8368 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:26.690251  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.683789  8212 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:26.690847  8369 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
I20260709 13:17:26.658932 11874 consensus_queue.cc:1243] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:26.665028 11913 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:17:26.686852  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.688174  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.694643  8216 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:26.694895  8366 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:26.691219  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:26.663534 11857 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.696794  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.657516 11909 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:26.699105  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.717546  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:26.361424 11897 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 13:17:26.636078 11895 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:17:26.682755 11762 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:26.728358  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:26.381345 11900 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:17:26.682035 11826 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.747040  8286 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:17:26.730916  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.747169 11826 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.689181 11751 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:26.748639  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.763656  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:26.715634 11909 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.682375 11697 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:17:26.756497  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.765645  8212 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:26.728354 11884 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.666961 11869 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:26.658164 11867 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.696664 11309 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:17:26.728374 11897 consensus_queue.cc:1243] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:26.767370 11751 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:26.764472  8219 raft_consensus.cc:2368] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:26.767424 11864 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:26.722404  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:26.771216  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:26.772640  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 105086us
I20260709 13:17:26.774901  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:26.686105 11801 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:26.729967 11917 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.807430 11917 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.807808 11917 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.807950 11751 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:26.809345  8361 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:26.799757  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 77445.1us
I20260709 13:17:26.773875 11884 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.750653 11762 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:26.806612  8216 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:26.764123 11826 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:26.792817 11809 consensus_meta.cc:287] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.003s
I20260709 13:17:26.810138  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:26.806277  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:26.866102  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 59874.3us
I20260709 13:17:26.806376  8295 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:26.811273  8218 raft_consensus.cc:2368] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10.
I20260709 13:17:26.761214  8286 pending_rounds.cc:85] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 8
W20260709 13:17:26.798400 11912 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:17:26.815091  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 142154us
I20260709 13:17:26.864272 11693 consensus_queue.cc:1243] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer d03eaa3ce81042f9b114cd00a7f41b17 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:26.773022 11807 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:17:26.894107  8219 pending_rounds.cc:85] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 4
W20260709 13:17:26.832669  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.808838 11855 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:26.867852  8286 pending_rounds.cc:107] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:17:26.898294  8286 raft_consensus.cc:2889] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.898984  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 510) took 1849 ms. Trace:
I20260709 13:17:26.899271  8286 rpcz_store.cc:276] 0709 13:17:25.049164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.049494 (+   330us) service_pool.cc:224] Handling call
0709 13:17:25.051756 (+  2262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.373911 (+1322155us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54003c6f20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd4131c0 00007f31fd414231 00007f31fd410d8f 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c
0709 13:17:26.898749 (+524838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.898924 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418893056}
I20260709 13:17:26.887138  8216 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:26.814569  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.894546  8219 pending_rounds.cc:107] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:17:26.900959  8219 raft_consensus.cc:2889] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.901218  8293 raft_consensus.cc:2410] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:17:26.861433  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 218995us
I20260709 13:17:26.902671  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:26.905099  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1849) took 1866 ms. Trace:
I20260709 13:17:26.905473  8367 rpcz_store.cc:276] 0709 13:17:25.039087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.257857 (+1218770us) service_pool.cc:224] Handling call
0709 13:17:26.258275 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.660221 (+401946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.904851 (+244630us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54003665d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:26.905039 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858189568}
I20260709 13:17:26.813078 11871 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.813903 11762 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.816468 11887 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:26.909318  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:26.909987  8286 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:26.812718 11884 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.885526 11693 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:26.907087 11908 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:26.909584 11887 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:26.915185 11919 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:17:26.882268 11809 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:26.910460 11822 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:17:26.924367 11871 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:26.895679  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 85627.3us
W20260709 13:17:27.010115  8294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.022s	sys 0.022s
W20260709 13:17:27.044358  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 177412us
W20260709 13:17:27.045903  8925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.023s	sys 0.039s
I20260709 13:17:26.958032 11908 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.004688 11887 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.065510  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 496) took 1013 ms. Trace:
W20260709 13:17:27.075984  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.204207  8294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.022s	sys 0.022s
I20260709 13:17:27.204146  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:27.330384  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:27.336952  8286 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:27.337489  8925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.031s	sys 0.046s
I20260709 13:17:27.216885  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.240621  8220 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:27.339102  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 436463us
I20260709 13:17:26.968622 11693 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.350541  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:27.350896  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.351347  8366 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.352551  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.352792  8293 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:27.337060  8215 rpcz_store.cc:276] 0709 13:17:26.052542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.121734 (+ 69192us) service_pool.cc:224] Handling call
0709 13:17:26.136233 (+ 14499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:26.208612 (+ 72379us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:26.333022 (+124410us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.663503 (+330481us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:26.664027 (+   524us) log.cc:844] Serialized 52 byte log entry
0709 13:17:26.664206 (+   179us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:26.664236 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.664301 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.065284 (+400983us) raft_consensus.cc:1685] finished
0709 13:17:27.065303 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.065451 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22030,"prepare.queue_time_us":247162,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":55178,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":30622,"thread_start_us":218877,"threads_started":2,"wal-append.queue_time_us":366583}
I20260709 13:17:27.340101  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:27.355778  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:27.357235  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:27.358608  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:27.337013  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:27.343657  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:27.345103  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.358867  8368 raft_consensus.cc:2410] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:17:27.338496  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.344537 11864 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.381429  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:27.408653  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.381353  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.403949  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:27.348603 11908 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.418162  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.356149 11693 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.424775  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.412817  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.426380  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:27.426596 11917 consensus_meta.cc:287] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.000s
I20260709 13:17:27.427116  8363 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:27.427060 11917 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.419667 11867 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:27.428506 11867 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:27.428864 11867 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:27.429229 11867 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:27.346444 11873 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.432555  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.450930  8363 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:27.436483  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:27.443710  8286 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:27.438798  8215 pending_rounds.cc:85] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 2
I20260709 13:17:27.437469  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.453269  8215 pending_rounds.cc:107] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:17:27.453876  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:17:27.454535  8293 raft_consensus.cc:606] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:27.454864  8293 raft_consensus.cc:614] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.455132 11894 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:27.455588 11894 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:27.455899  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1482) took 1077 ms. Trace:
I20260709 13:17:27.456559  8219 rpcz_store.cc:276] 0709 13:17:26.378057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.817909 (+439852us) service_pool.cc:224] Handling call
0709 13:17:26.893933 (+ 76024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.901474 (+  7541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.901502 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.901880 (+   378us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.234382 (+332502us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.234657 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.245161 (+ 10504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.245261 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.455703 (+210442us) raft_consensus.cc:1685] finished
0709 13:17:27.455720 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.455842 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10159,"prepare.queue_time_us":106,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":10906,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"thread_start_us":332117,"threads_started":1,"wal-append.queue_time_us":551828}
I20260709 13:17:27.408365 11751 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.460292 11751 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.460723 11751 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.460898  8363 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:27.462453 11726 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.414799 11864 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:27.465813 11864 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:27.466212 11909 consensus_meta.cc:287] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.000s
I20260709 13:17:27.466625 11909 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.453579  8215 raft_consensus.cc:2889] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.406204 11871 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:27.468252 11871 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:27.468627 11871 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.407366 11928 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:27.469376  8369 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:27.455879  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.470935  8293 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:27.471267  8367 raft_consensus.cc:2393] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:27.485005  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.483646  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 125121us
W20260709 13:17:27.418635 11883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.011s	sys 0.029s
I20260709 13:17:27.490185  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:27.490080 11492 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.429466 11933 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.501664  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:27.478055 11928 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:27.554951 11928 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.556162  8293 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:27.517997  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:27.499389 11753 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.217s	user 0.012s	sys 0.000s
W20260709 13:17:27.498920 11883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.011s	sys 0.030s
I20260709 13:17:27.497710 11932 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:27.554504 11933 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.558224 11909 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.565380 11809 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.564999 11908 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:27.550386 11826 consensus_meta.cc:287] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.000s
I20260709 13:17:27.554091 11869 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:27.577405 11762 consensus_meta.cc:287] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.003s
I20260709 13:17:27.575930  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1487) took 1196 ms. Trace:
I20260709 13:17:27.577268 11933 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.593052  8217 rpcz_store.cc:276] 0709 13:17:26.379325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.373027 (+993702us) service_pool.cc:224] Handling call
0709 13:17:27.381012 (+  7985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.381199 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:27.413564 (+ 32365us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.575349 (+161785us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.575539 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.575587 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.575630 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.575692 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.575872 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45781,"prepare.queue_time_us":69819,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":16207,"raft.queue_time_us":3119,"raft.run_wall_time_us":3221,"spinlock_wait_cycles":53282176,"thread_start_us":157552,"threads_started":1}
W20260709 13:17:27.617316  8212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.018s	sys 0.002s
I20260709 13:17:27.617544 11801 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:27.614786 11925 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:27.618283 11801 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.615414 11762 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.620991 11801 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.621654 11801 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:27.621790 11762 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:27.593773 11855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.001s	sys 0.014s
W20260709 13:17:27.623209 11855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.001s	sys 0.015s
W20260709 13:17:27.594007  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 257038us
I20260709 13:17:27.628636  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
W20260709 13:17:27.628786  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 247414us
I20260709 13:17:27.586942 11909 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.629323  8217 raft_consensus.cc:606] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:27.635071  8217 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:27.636682  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 146566us
I20260709 13:17:27.637668  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:27.577075 11753 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.639659  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1571) took 1286 ms. Trace:
I20260709 13:17:27.622277 11801 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:27.641873  8294 rpcz_store.cc:276] 0709 13:17:26.353605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.353819 (+   214us) service_pool.cc:224] Handling call
0709 13:17:26.354079 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.354289 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:27.336507 (+982218us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.548936 (+212429us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.639335 (+ 90399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.639386 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.639426 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.639489 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.639600 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23181,"prepare.queue_time_us":441051,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":5399,"raft.queue_time_us":142068,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":6478,"spinlock_wait_cycles":1786240,"thread_start_us":1244838,"threads_started":3,"wal-append.queue_time_us":290249}
I20260709 13:17:27.626533 11807 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.642815  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:27.657850 11936 log.cc:927] Time spent T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:17:27.661749  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1848) took 2622 ms. Trace:
I20260709 13:17:27.662462 11887 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.663731  8364 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:27.662154  8361 rpcz_store.cc:276] 0709 13:17:25.038865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.169708 (+1130843us) service_pool.cc:224] Handling call
0709 13:17:26.187448 (+ 17740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.809738 (+622290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.661472 (+851734us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400155c54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:27.661693 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429678848}
I20260709 13:17:27.592145 11826 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.667567  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 785) took 1368 ms. Trace:
I20260709 13:17:27.653203 11762 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.669209  8925 rpcz_store.cc:276] 0709 13:17:26.299320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.300930 (+  1610us) service_pool.cc:224] Handling call
0709 13:17:26.340276 (+ 39346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.337873 (+997597us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.337903 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.344623 (+  6720us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.602655 (+258032us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.602693 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.602768 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.667349 (+ 64581us) raft_consensus.cc:1685] finished
0709 13:17:27.667384 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.667508 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25574,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":1177694,"threads_started":2,"wal-append.queue_time_us":317630}
I20260709 13:17:27.676842 11887 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:27.677639 11872 consensus_meta.cc:287] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.988s	user 0.008s	sys 0.002s
I20260709 13:17:27.668879 11917 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.677516 11894 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.639921 11909 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.684687 11954 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:27.684964 11925 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:27.685233 11826 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.696754 11896 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:27.696903 11925 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:27.696882 11954 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.697386 11896 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:27.697685 11925 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.695791 11908 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.696213 11693 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.699080 11954 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.698567 11896 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:27.678609 11857 consensus_meta.cc:287] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.932s	user 0.008s	sys 0.005s
W20260709 13:17:27.690569 11858 consensus_meta.cc:287] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.975s	user 0.000s	sys 0.009s
I20260709 13:17:27.700335 11693 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.700289 11858 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:27.701086 11753 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.690454 11664 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.656131 11807 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:27.691654 11884 consensus_meta.cc:287] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.000s
I20260709 13:17:27.692018 11932 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:27.699909 11857 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:27.704964 11932 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.705355 11932 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.696398 11909 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.685422 11856 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.686278 11867 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:27.709830 11857 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:27.711913 11914 log.cc:927] Time spent T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Append to log took a long time: real 0.901s	user 0.009s	sys 0.000s
I20260709 13:17:27.713138 11894 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.713766 11867 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:27.710356 11858 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.717793 11874 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:27.718225 11874 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:27.719002 11874 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.694301 11871 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.721808 11871 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.702670 11896 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.778257  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 479) took 1912 ms. Trace:
I20260709 13:17:27.779353  8211 rpcz_store.cc:276] 0709 13:17:25.865808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.866286 (+   478us) service_pool.cc:224] Handling call
0709 13:17:25.866581 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.044931 (+178350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.777496 (+1732565us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000361d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:27.777957 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355525504}
I20260709 13:17:27.634843  8258 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:27.785044  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1494) took 1353 ms. Trace:
I20260709 13:17:27.779639  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1479) took 1425 ms. Trace:
W20260709 13:17:27.785234  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 150394us
W20260709 13:17:27.787338  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 481) took 1917 ms (client timeout 1929 ms). Trace:
I20260709 13:17:27.785563  8219 rpcz_store.cc:276] 0709 13:17:26.431427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.458440 (+1027013us) service_pool.cc:224] Handling call
0709 13:17:27.458744 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.458937 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:27.637853 (+178916us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.784099 (+146246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.784247 (+   148us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.784402 (+   155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.784574 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.784775 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19732,"prepare.queue_time_us":105510,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"spinlock_wait_cycles":14080,"thread_start_us":282129,"threads_started":2,"wal-append.queue_time_us":32076}
W20260709 13:17:27.787887  8218 rpcz_store.cc:269] 0709 13:17:25.869712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.892375 (+ 22663us) service_pool.cc:224] Handling call
0709 13:17:27.786784 (+1894409us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b5400092c54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:27.787099 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1758003072}
I20260709 13:17:27.785737  8212 rpcz_store.cc:276] 0709 13:17:26.353631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.806974 (+453343us) service_pool.cc:224] Handling call
0709 13:17:26.866828 (+ 59854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.867282 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:26.898052 (+ 30770us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.630930 (+732878us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.631124 (+   194us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.631702 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.631846 (+   144us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:27.632072 (+   226us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.632246 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.632338 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.779004 (+146666us) raft_consensus.cc:1685] finished
0709 13:17:27.779092 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.779405 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12469,"prepare.queue_time_us":180283,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":98,"raft.queue_time_us":18114,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":12662,"thread_start_us":549099,"threads_started":1,"wal-append.queue_time_us":769221}
I20260709 13:17:27.790184  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 482) took 1920 ms. Trace:
I20260709 13:17:27.785254  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1491) took 1400 ms. Trace:
I20260709 13:17:27.790750  8220 rpcz_store.cc:276] 0709 13:17:25.870011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.870154 (+   143us) service_pool.cc:224] Handling call
0709 13:17:25.870483 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.339146 (+1468663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.789611 (+450465us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003d45d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:27.789973 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3150336768}
I20260709 13:17:27.791277  8215 rpcz_store.cc:276] 0709 13:17:26.385004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.438104 (+1053100us) service_pool.cc:224] Handling call
0709 13:17:27.438510 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:27.468028 (+ 29518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.468077 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:27.468593 (+   516us) log.cc:844] Serialized 52 byte log entry
0709 13:17:27.784488 (+315895us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:27.784617 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.784736 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.784803 (+    67us) raft_consensus.cc:1685] finished
0709 13:17:27.784831 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.785093 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1023,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":19190,"thread_start_us":315131,"threads_started":1,"wal-append.queue_time_us":224094}
I20260709 13:17:27.796339  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1483) took 1417 ms. Trace:
I20260709 13:17:27.797078  8213 rpcz_store.cc:276] 0709 13:17:26.378365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.373389 (+995024us) service_pool.cc:224] Handling call
0709 13:17:27.406765 (+ 33376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.407002 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:27.780818 (+373816us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.795348 (+ 14530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.795486 (+   138us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.795681 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.795831 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.796093 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6822,"prepare.queue_time_us":119254,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"thread_start_us":344709,"threads_started":2,"wal-append.queue_time_us":1644}
I20260709 13:17:27.805377  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:27.806501  8291 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:27.806522  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:27.808147  8214 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.808681  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1572) took 1451 ms. Trace:
I20260709 13:17:27.809242  8291 rpcz_store.cc:276] 0709 13:17:26.357032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.357463 (+   431us) service_pool.cc:224] Handling call
0709 13:17:26.383251 (+ 25788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.807461 (+1424210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.808281 (+   820us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001275d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:27.808562 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3271630720}
I20260709 13:17:27.811086  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:27.811337  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.812247  8289 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:27.814200  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:27.815147  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.817898  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2403) took 2859 ms. Trace:
I20260709 13:17:27.818473  8286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:17:27.819403  8286 raft_consensus.cc:606] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:27.819892  8286 raft_consensus.cc:614] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.667150  8366 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:27.704025 11884 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.728291 11925 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.864974  8365 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:27.702004 11801 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:27.837355  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.838284 11874 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.818435  8360 rpcz_store.cc:276] 0709 13:17:24.962692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.962815 (+   123us) service_pool.cc:224] Handling call
0709 13:17:24.963123 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.639869 (+676746us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:25.648192 (+  8323us) log.cc:844] Serialized 14 byte log entry
0709 13:17:26.328301 (+680109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.328369 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:26.328430 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.817267 (+1488837us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400366ad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:27.817325 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.817598 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6084,"prepare.queue_time_us":10168,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":13881,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":12734,"spinlock_wait_cycles":1555810176,"thread_start_us":673650,"threads_started":1,"wal-append.queue_time_us":965202}
I20260709 13:17:27.850991 11807 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.852563 11863 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.853817 11892 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:27.854645 11867 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:27.731120 11928 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.700572 11698 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.871994  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.732822 11932 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.872419 11857 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:27.879691 11858 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:27.880210 11858 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:27.880676 11858 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.880594 11664 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.883520 11664 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:27.883692 11315 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.884281 11923 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:27.901473 11923 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:27.874986 11892 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:27.885125  8214 raft_consensus.cc:2410] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:27.887214  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1489) took 1507 ms. Trace:
I20260709 13:17:27.904556 11753 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.905220 11753 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.904714  8216 rpcz_store.cc:276] 0709 13:17:26.379775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.382605 (+1002830us) service_pool.cc:224] Handling call
0709 13:17:27.418024 (+ 35419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.418237 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:27.628623 (+210386us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.886242 (+257619us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.886555 (+   313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.886618 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.886690 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.886799 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.887025 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35199,"prepare.queue_time_us":146262,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":89,"raft.queue_time_us":200,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":248,"thread_start_us":406443,"threads_started":2}
W20260709 13:17:27.904562  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1492) took 1519 ms (client timeout 1586 ms). Trace:
W20260709 13:17:27.907802  8214 rpcz_store.cc:269] 0709 13:17:26.385285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.619931 (+234646us) service_pool.cc:224] Handling call
0709 13:17:27.806135 (+1186204us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023d70a0 00007f32023d6984 00007f31fb9516d4 00007f31fb951662
0709 13:17:27.904500 (+ 98365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2862464}
I20260709 13:17:27.908617  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.909614  8295 raft_consensus.cc:2410] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:27.910740  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.911533  8289 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:27.911679 11920 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.100s	user 0.008s	sys 0.001s
I20260709 13:17:27.719902 11933 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.871207 11751 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:27.904294 11892 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.907111  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.900213  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:27.914599  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:27.914779 11931 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.493s	user 0.002s	sys 0.001s
I20260709 13:17:27.916217 11925 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.916754  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:27.917654  8258 connection.cc:256] RPC call timeout handler was delayed by -1.1376638080000703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 13:17:27.917730  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.918928  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.920429  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.890264 11928 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.887363 11932 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:27.924335  8291 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:27.877017 11867 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:27.921795 11923 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:27.926461  8258 connection.cc:256] RPC call timeout handler was delayed by -1.1016638080000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:17:27.932682  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 116609us
I20260709 13:17:27.926177  8290 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:27.930575  8289 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:27.930503  8294 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:27.931074  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 283364us
I20260709 13:17:27.930878  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:27.932186  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.934697  8295 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:27.941068  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:27.941416  8288 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:27.941668  8368 raft_consensus.cc:2368] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:27.942662 11889 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:27.944137  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:27.940256  8287 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:27.942691  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.930508 11884 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.946586  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:27.944716  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.943601 11889 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:27.932965 11867 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.950959  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.952250  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:27.945391  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.948516 11932 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:27.952662 11617 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:27.953297  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.948395  8892 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:27.953732  8288 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:27.958166  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:27.959121  8291 raft_consensus.cc:2410] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:27.960235  8215 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:27.960634 11863 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:27.961680  8290 raft_consensus.cc:2410] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:27.961524 11863 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:27.955937  8286 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:27.963063  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.962863 11932 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:27.957826 11889 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:27.967754  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.952589 11751 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:27.954919 11933 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.968021 11932 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.968693  8362 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:27.978636  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.970129  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:27.972376  8214 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:27.970046  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:27.975688  8213 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:27.974068  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:27.979085  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:27.981288  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:27.976459 11925 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:27.984566  8183 leader_election.cc:336] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.521s (SENT)
I20260709 13:17:27.984992 11925 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.982745  8364 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:27.985446 11925 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:27.985724  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 58826us
W20260709 13:17:27.987931  8183 leader_election.cc:336] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.663s (SENT)
I20260709 13:17:27.988453  8216 raft_consensus.cc:2368] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10.
I20260709 13:17:27.988425  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:27.989717  8360 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:27.991019  8291 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:27.964148 11863 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:27.991303 11617 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:27.994678 11892 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:27.995270  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 54337.2us
I20260709 13:17:28.010629  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.011540  8364 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:28.013455  8365 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:28.013711 11857 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:28.016163 11321 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:28.016182  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.018571  8362 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:28.022562 11735 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:28.017081 11857 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:28.024214 11857 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:28.000383  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.026491  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.004240  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:27.995918 11863 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:28.027691  8360 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:28.007941  8368 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:28.008944  8183 leader_election.cc:336] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.740s (SENT)
I20260709 13:17:27.991503  8291 pending_rounds.cc:85] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 5
I20260709 13:17:27.997283 11762 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:28.000602  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.006940  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.028925  8183 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:28.029884  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.030164  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.030884  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:28.031493  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.028403  8291 pending_rounds.cc:107] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:28.033200  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.035077  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.035221  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.035730  8286 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:28.035921  8289 raft_consensus.cc:2410] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:28.031350 11857 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.036353 11863 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:28.143366  8360 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.037170  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.039009  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:28.039680  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1569) took 1698 ms. Trace:
I20260709 13:17:27.999565 11858 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.038039 11892 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:28.046965  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:28.047385  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.048269 11708 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:28.050500  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.051867 11753 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:28.124536  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:28.128484  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:28.129932 11857 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.130828  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:28.131271  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.132191  8368 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:28.132812  8293 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:28.133445  8295 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:28.135035  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.135761  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.139200  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.140571  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.041038 11867 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.150156  8291 raft_consensus.cc:2889] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:28.150872  8365 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.159328  8286 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:28.154099 11708 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:28.162644  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.149541 11863 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.168342  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.169627  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.169864  8288 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.165274  8293 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:28.170226  8368 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:28.169009  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.169589  8216 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:28.171494  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:28.144348  8292 rpcz_store.cc:276] 0709 13:17:26.341458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.341619 (+   161us) service_pool.cc:224] Handling call
0709 13:17:26.379753 (+ 38134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.801261 (+1421508us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:27.801872 (+   611us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.868320 (+ 66448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:27.868390 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:27.868455 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.039286 (+170831us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540005b4d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:28.039326 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.039499 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3536,"prepare.queue_time_us":31249,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":47859,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":228,"spinlock_wait_cycles":3267186048,"thread_start_us":26429,"threads_started":1,"wal-append.queue_time_us":23526}
I20260709 13:17:28.171342  8928 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:28.172654  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.172909  8926 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.172871  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.173755  8294 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:28.175024  8215 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:28.176093  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.176280  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.176517  8369 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:28.176926  8922 raft_consensus.cc:2393] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 12: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:28.177302  8292 raft_consensus.cc:2376] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11. Re-sending same reply.
I20260709 13:17:28.177527  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.177910  8295 raft_consensus.cc:2410] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:28.178359  8290 raft_consensus.cc:2368] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10.
I20260709 13:17:28.178304  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.178722  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.179009  8292 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:28.179199  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.179906  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:28.180948  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 142106us
I20260709 13:17:28.180289  8212 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:28.180485  8925 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.182248  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:28.184448 11808 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:28.187861 11762 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.188390 11945 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:28.188494 11762 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.189296 11945 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.191264 11762 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:28.191879 11762 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:28.192803 11762 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.193629 11858 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:28.195560 11762 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:28.179932  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.198097  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.198427  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.198807  8927 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.198670  8295 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.199162  8922 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.200464  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.201225  8920 raft_consensus.cc:2368] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12.
I20260709 13:17:28.201649  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.202210  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.175055  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.203012 11708 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.203775  8286 raft_consensus.cc:2410] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:28.180444 11809 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:28.188412 11830 consensus_queue.cc:1059] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:28.205478  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:28.206497  8212 raft_consensus.cc:2368] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12.
I20260709 13:17:28.207046  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:28.207624  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:28.209129 11830 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:28.209712  8213 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:28.207847  8220 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:28.208132 11939 raft_consensus.cc:993] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:17:28.208410  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:28.210757 11939 raft_consensus.cc:1081] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:17:28.208808  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:28.174902 11942 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:28.209646 11830 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:28.213999  8186 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.215060 11809 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:28.214654 11830 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.215533 11809 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.204345 11708 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.216025 11809 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.217482 11867 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:28.216117 11830 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.219808  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.221040  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:28.222075  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.222826  8293 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:28.202335  8924 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.238667  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.239010  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.240003  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.240530  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.240801  8293 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:28.241456  8286 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:28.241361  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.244514 11492 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:28.246210  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.321591  8362 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:28.321882  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.322496  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.322820  8286 raft_consensus.cc:2410] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:28.323316  8362 raft_consensus.cc:2368] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
I20260709 13:17:28.323381  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.246627 11939 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:28.323971 11942 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:28.324678 11942 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:28.324826 11939 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:28.325315 11939 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:28.325434  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:28.326119  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 84886.8us
I20260709 13:17:28.323987  8292 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.326280 11939 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.327000  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.247028  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.247917  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.248070  8186 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.248699 11884 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:28.248831  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.249177 11892 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:28.248461 11925 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.251147  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.252064  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.254416 11809 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:28.257059  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.328547  8364 raft_consensus.cc:2368] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:28.335059  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.385354  8363 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.257941 11932 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.241540  8295 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:28.258742  8925 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:17:28.284217  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.306880  8360 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:28.308370  8287 raft_consensus.cc:2368] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:28.310416  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:28.191810 11945 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:28.386358  8367 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
W20260709 13:17:28.409876  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 78434.8us
I20260709 13:17:28.328405 11858 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:28.412266  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.412113  8368 raft_consensus.cc:2376] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10. Re-sending same reply.
I20260709 13:17:28.412721  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.415153  8295 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:28.416492  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.416626  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.417174  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.417894  8293 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:28.418691  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.417268  8919 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:28.383639 11939 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.434720  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.434994  8920 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:28.435307  8291 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:28.426663  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 178216us
W20260709 13:17:28.425439  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 416544us
I20260709 13:17:28.425333  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:28.427040  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 118033us
I20260709 13:17:28.429248  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.435977  8363 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:28.422688  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.432674  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.428943  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.435806  8927 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:28.428319  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.439183  8288 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:28.440316  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.441490  8288 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.440604  8928 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.445254  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.438463  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.446295  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.448707  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.450762  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.451211  8286 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:28.451509  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.445977  8289 raft_consensus.cc:2376] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9. Re-sending same reply.
I20260709 13:17:28.452176  8925 raft_consensus.cc:2368] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10.
I20260709 13:17:28.449350  8294 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:28.454367  8362 raft_consensus.cc:2368] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:28.456413  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.456980  8290 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:28.415032 11858 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:28.426505 11697 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:28.444864  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.461833  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:28.427224 11892 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:28.466300  8183 leader_election.cc:336] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.760s (SENT)
W20260709 13:17:28.466687  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.467666  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:28.468608  8922 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:28.444248 11945 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:28.496438  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.496495 11945 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:28.497260 11945 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.499338 11945 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:28.500077  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.500867  8367 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:28.501631  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.469051  8186 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:28.503666 11617 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:28.503769  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 52795.4us
I20260709 13:17:28.504372 11617 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.504747  8186 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.504860 11617 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.506758 11753 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:28.507311 11753 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:28.508328 11753 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.472071  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.509490  8366 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:28.510273  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.510913  8366 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:28.473919  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:28.481436  8287 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:28.484301 11867 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:28.490928 11925 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:28.492264 11932 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:28.492452 11809 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:28.428180 11884 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.493196  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:28.493958 11892 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:28.464573 11697 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:28.508689  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 47726.8us
I20260709 13:17:28.479846  8292 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:28.467236  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.516812 11867 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:28.536190  8925 raft_consensus.cc:2368] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8.
I20260709 13:17:28.536139 11867 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.537209  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.515996  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:28.518497  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.460734 11858 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.541585  8286 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.520902  8291 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:28.522387  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:28.542819  8919 raft_consensus.cc:2368] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10.
I20260709 13:17:28.523283  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.543939  8362 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:28.526697  8290 pending_rounds.cc:85] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 4
I20260709 13:17:28.544505  8290 pending_rounds.cc:107] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:28.544982  8290 raft_consensus.cc:2889] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:28.527096  8924 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:28.529145  8289 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:28.529489  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:28.529706  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.531580  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.325935 11942 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.540889  8360 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 7: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:28.537209 11884 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:28.537904 11857 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:28.537628 11697 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:28.551425  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 77647.7us
I20260709 13:17:28.554010  8919 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:28.558826  8369 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:28.566604  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:28.561122  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 120386us
I20260709 13:17:28.567250  8925 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:28.568399  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.576675  8922 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:28.577919  8928 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:28.580717  8364 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:28.585984  8366 raft_consensus.cc:2368] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:28.587353  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.587953  8258 leader_election.cc:400] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:28.588187  8289 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.588828 11863 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.589908  8362 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 9. Ops: []
I20260709 13:17:28.584064 11808 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:28.588306  8258 leader_election.cc:403] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.590965  8361 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:28.594226  8925 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:28.599635  8928 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:28.601204 11925 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:17:28.613804  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.616485 11803 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:28.617396 11803 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:28.618221 11803 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:28.618299 11698 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:28.591058 11808 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:28.618618 11803 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:28.618808 11698 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:28.619017 11808 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.619563 11803 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.619832 11698 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.620958 11803 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.621215 11698 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.622089  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.591018 11863 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:28.646143  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:28.646839  8288 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:28.647137  8926 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:28.643314  8286 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:28.645427  8922 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:28.650280  8261 connection.cc:256] RPC call timeout handler was delayed by -2.3536120989999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2318s for a response
I20260709 13:17:28.636577  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.651523  8361 raft_consensus.cc:2410] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:28.658383  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:28.636237 11925 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:17:28.662266  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.665041  8368 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:28.665369  8286 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:28.666781 11874 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:28.667770  8362 raft_consensus.cc:1240] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:28.666718 11892 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:28.668668 11892 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.669183 11892 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.672443  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.673748  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:28.674443  8295 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:28.675205  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:28.676611  8287 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:28.673224  8291 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:28.683282  8261 connection.cc:256] RPC call timeout handler was delayed by -1.1714675690000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:17:28.685626  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.684186  8261 connection.cc:256] RPC call timeout handler was delayed by -1.1156675689999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1632s for a response
W20260709 13:17:28.645571  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 70306us
W20260709 13:17:28.693596  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 90490.8us
W20260709 13:17:28.698798  8261 connection.cc:256] RPC call timeout handler was delayed by -1.0868675690001055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 13:17:28.699731  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.706634  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:28.707724  8368 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.686408  8360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53535408ea514f8db7292852927e7743"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:17:28.713970  8360 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:28.714414  8360 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:28.721624  8332 leader_election.cc:400] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12.
I20260709 13:17:28.740253  8332 leader_election.cc:403] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:17:28.743870  8365 consensus_meta.cc:287] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.579s	user 0.016s	sys 0.004s
I20260709 13:17:28.745770  8365 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:28.706143 11939 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:28.766311  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:28.754392 11939 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.772578 11725 consensus_queue.cc:1059] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:17:28.771531  8364 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.772732  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.747947 11874 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:17:28.765198 11762 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12.
I20260709 13:17:28.765223  8261 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:28.781484  8360 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.786074  8363 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:28.773572 11939 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:28.816187  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.816663  8889 leader_election.cc:336] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.511s (SENT)
I20260709 13:17:28.773221 11884 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:28.828094  8923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.028s	sys 0.058s
W20260709 13:17:28.828610  8923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.028s	sys 0.058s
W20260709 13:17:28.830199  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 82941.7us
W20260709 13:17:28.833680 11973 log.cc:927] Time spent T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:17:28.836735 11725 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:28.838027  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.838632 11725 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:28.839133 11725 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:28.842119  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 44803.2us
I20260709 13:17:28.845403  8360 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:28.858780 11867 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:28.856915  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:28.865840  8289 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:28.873409  8368 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
W20260709 13:17:28.880203  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 63557.4us
I20260709 13:17:28.887538  8186 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:28.887209  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:28.890404  8889 leader_election.cc:336] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.644s (SENT)
I20260709 13:17:28.891034  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:28.852625 11858 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.856094 11809 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:17:28.882171 11884 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:28.904538  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 351532us
I20260709 13:17:28.905989  8361 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:28.906935 11867 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:28.910660  8183 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.831s (SENT) [suppressed 54 similar messages]
I20260709 13:17:28.913873  8288 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.896613 11753 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:28.855877 11725 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:28.904422 11762 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:28.907579 11942 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:28.915235 11884 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:28.953814 11725 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.912422 11925 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:28.960232  8367 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:28.924134 11874 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:28.963581  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.934523 11942 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.927842 11753 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:28.919750  8118 catalog_manager.cc:5697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 2 to 9, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 9 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:28.945596 11762 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:28.927757 11617 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:28.995363  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.971143 11942 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:28.982744 11698 raft_consensus.cc:3055] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:28.980931 11867 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:29.035143  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 212695us
I20260709 13:17:29.036419  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:29.002802 11698 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:29.043495  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 210771us
I20260709 13:17:29.004704 11874 consensus_queue.cc:1059] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:29.050697 11858 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:29.043963 11857 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:29.011526 11808 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.057621  8118 catalog_manager.cc:5697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.085403  8258 leader_election.cc:400] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10.
I20260709 13:17:29.085765  8258 leader_election.cc:403] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:29.066727 11858 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.089208 11858 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:29.090391  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.104561  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 92686.9us
W20260709 13:17:29.116251  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 161014us
I20260709 13:17:29.108446  8118 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:29.138871  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:29.123354  8369 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:29.172417  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 113773us
I20260709 13:17:29.043092 11867 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.174506  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:29.108414 11830 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.084821 11857 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:29.091993 11858 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:29.190634  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 214440us
I20260709 13:17:29.109058 11617 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:29.198436  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 257104us
W20260709 13:17:29.199239  8889 leader_election.cc:336] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.717s (SENT)
W20260709 13:17:29.211790  8889 leader_election.cc:336] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.717s (SENT)
I20260709 13:17:29.187376 11830 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:29.193203 11857 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.212322  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.199342  8118 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:29.197111 11874 raft_consensus.cc:3055] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:29.109589 11698 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:29.222172  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 100876us
I20260709 13:17:29.183221 11492 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:29.080673 11980 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 13:17:29.096159 11762 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.194042 11863 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:29.202870 11892 consensus_meta.cc:287] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.004s
I20260709 13:17:29.070437 11884 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.067003 11753 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.194314 11978 consensus_queue.cc:1059] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:17:29.220743 11874 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:29.214246 11984 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10.
W20260709 13:17:29.233927  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.234624  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 155762us
W20260709 13:17:29.251528  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.256644  8889 leader_election.cc:336] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.758s (SENT)
I20260709 13:17:29.228256 11925 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.218469 11939 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:29.267860  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.277418  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 94438.8us
I20260709 13:17:29.258330 11698 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:29.283290  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:29.229151  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:29.303392  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.233889 11892 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:29.304469  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 72045.8us
W20260709 13:17:29.305336  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 48731.2us
I20260709 13:17:29.320940  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:29.302086 11697 consensus_meta.cc:287] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.000s
I20260709 13:17:29.339748  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.338371  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:29.260501 11830 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.287245 11858 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:17:29.300194 11874 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.346180 11863 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:29.346910 11874 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.351878 11987 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:17:29.354285  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.345470  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:29.355716  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:29.335255 11808 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:29.357836  8889 leader_election.cc:336] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.929s (SENT)
I20260709 13:17:29.363888 11988 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:29.364504 11988 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:29.365422 11988 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.366115  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2194) took 1224 ms. Trace:
I20260709 13:17:29.367503 11939 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:29.369982 11830 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:29.372180  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.366496  8290 rpcz_store.cc:276] 0709 13:17:28.141433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.461489 (+320056us) service_pool.cc:224] Handling call
0709 13:17:28.519625 (+ 58136us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:28.961862 (+442237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.961906 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:28.978104 (+ 16198us) log.cc:844] Serialized 52 byte log entry
0709 13:17:29.211207 (+233103us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:29.268635 (+ 57428us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.285554 (+ 16919us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.365494 (+ 79940us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b18000457c0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287 00007f31fd42c208
0709 13:17:29.365682 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.365751 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.365887 (+   136us) raft_consensus.cc:1685] finished
0709 13:17:29.365904 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.366040 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32329,"prepare.queue_time_us":139685,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":75536,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8703,"spinlock_wait_cycles":37926656,"thread_start_us":612127,"threads_started":3,"wal-append.queue_time_us":270442}
I20260709 13:17:29.375056  8889 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.378266  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:29.378894  8367 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.380573 11897 raft_consensus.cc:3055] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:29.381039 11897 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:29.382025 11897 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.383414 11897 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.383932 11985 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.335943 11697 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.384807 11892 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:29.362466 11867 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:29.388073  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 85506.1us
W20260709 13:17:29.388417 11982 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:17:29.388567  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 129093us
I20260709 13:17:29.388661 11858 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:29.388933 11983 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:17:29.389207 11980 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.386456 11925 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.376901 11725 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:29.383435  8118 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 6, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 6 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:17:29.405277  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51852.3us
I20260709 13:17:29.385210 11809 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:29.408382  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.411150  8118 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 8, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:17:29.412905  8118 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 8, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 8 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:29.414772  8294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2189) took 1366 ms. Trace:
I20260709 13:17:29.414516  8118 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:29.416030  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.415756  8118 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.416729  8215 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 5.
I20260709 13:17:29.397315 11858 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:29.418226  8118 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 6 to 7, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.418491 11858 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.419868 11858 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.420382 11725 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:29.420554  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 77126.9us
I20260709 13:17:29.421367 11725 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:29.423389  8889 leader_election.cc:336] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.195s (SENT)
I20260709 13:17:29.424408  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.425215  8216 raft_consensus.cc:2410] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:29.424368  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.426935  8212 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.412019 11984 raft_consensus.cc:3055] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:29.427485  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.423848  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.439980  8367 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:29.404753 11980 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.436245  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:29.452518  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.452654  8261 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.453434  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:29.415114  8294 rpcz_store.cc:276] 0709 13:17:28.048285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.461448 (+413163us) service_pool.cc:224] Handling call
0709 13:17:28.533305 (+ 71857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.966291 (+432986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.966335 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.978442 (+ 12107us) log.cc:844] Serialized 26 byte log entry
0709 13:17:29.202543 (+224101us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:29.221060 (+ 18517us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.255437 (+ 34377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.255602 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.414557 (+158955us) raft_consensus.cc:1685] finished
0709 13:17:29.414575 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.414708 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100018,"prepare.queue_time_us":30923,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":122938,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":46621,"thread_start_us":624030,"threads_started":3,"wal-append.queue_time_us":347216}
I20260709 13:17:29.434888 11984 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:29.459914 11803 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:29.450810 11980 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.445677 11809 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:29.464933 11863 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:29.475780  8220 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.454301  8118 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 8, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 8 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:29.454813 11925 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.454327 11978 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.485168  8261 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:29.485311  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 129685us
W20260709 13:17:29.485849  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.487362  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.487784  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.489023 11803 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:29.491091  8116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46486 (request call id 268) took 22909 ms (client timeout 15000 ms). Trace:
I20260709 13:17:29.491780 11803 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:29.491483  8116 rpcz_store.cc:269] 0709 13:17:06.565759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.566101 (+   342us) service_pool.cc:224] Handling call
0709 13:17:29.468467 (+22902366us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:25.706954 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:25.707559 (+   605us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:25.707597 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:17:25.707613 (+    16us) tablet.cc:662] Decoding operations
0709 13:17:26.283670 (+576057us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:26.283731 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:26.283766 (+    35us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:17:26.284961 (+  1195us) tablet.cc:701] Row locks acquired
0709 13:17:26.284981 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:17:26.285137 (+   156us) write_op.cc:270] Start()
0709 13:17:26.285277 (+   140us) write_op.cc:276] Timestamp: P: 1783603046285091 usec, L: 0
0709 13:17:26.285301 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:26.285957 (+   656us) log.cc:844] Serialized 5529 byte log entry
0709 13:17:27.710395 (+1424438us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:27.734516 (+ 24121us) op_driver.cc:464] REPLICATION: finished
0709 13:17:27.896024 (+161508us) write_op.cc:301] APPLY: starting
0709 13:17:27.896223 (+   199us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:27.896694 (+   471us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:27.896733 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:27.955430 (+ 58697us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:27.964893 (+  9463us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:17:27.964992 (+    99us) write_op.cc:312] APPLY: finished
0709 13:17:27.965525 (+   533us) log.cc:844] Serialized 101 byte log entry
0709 13:17:27.965790 (+   265us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.966236 (+   446us) write_op.cc:454] Released schema lock
0709 13:17:27.966330 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:28.031822 (+ 65492us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:28.031852 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":230947,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":161072,"apply.run_cpu_time_us":6298,"apply.run_wall_time_us":135866,"num_ops":14,"prepare.queue_time_us":323567,"prepare.run_cpu_time_us":28367,"prepare.run_wall_time_us":935682,"raft.queue_time_us":20985,"raft.run_cpu_time_us":28969,"raft.run_wall_time_us":153997,"replication_time_us":1449015,"spinlock_wait_cycles":114372992,"thread_start_us":850521,"threads_started":4,"wal-append.queue_time_us":402857,"wal-append.run_cpu_time_us":35469,"wal-append.run_wall_time_us":2301950}]]}
I20260709 13:17:29.489830  8118 catalog_manager.cc:5697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 7, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:29.500385  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2190) took 1451 ms. Trace:
I20260709 13:17:29.512058  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:29.513775  8118 catalog_manager.cc:5697] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:29.515491  8118 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 6 to 7, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 7 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:29.521041  8218 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:29.522826 11697 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:29.503487 12001 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.527155 12007 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:29.528208  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47880.5us
I20260709 13:17:29.531502  8212 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:29.504634  8293 rpcz_store.cc:276] 0709 13:17:28.048619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.460914 (+412295us) service_pool.cc:224] Handling call
0709 13:17:28.520198 (+ 59284us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:28.574086 (+ 53888us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:28.969001 (+394915us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.218485 (+249484us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:29.222404 (+  3919us) log.cc:844] Serialized 52 byte log entry
0709 13:17:29.222530 (+   126us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:29.304366 (+ 81836us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.490277 (+185911us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.499944 (+  9667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.500065 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.500121 (+    56us) raft_consensus.cc:1685] finished
0709 13:17:29.500139 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.500304 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120547,"prepare.queue_time_us":598218,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":1353,"raft.queue_time_us":166926,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":26544,"thread_start_us":748685,"threads_started":4,"wal-append.queue_time_us":281457}
W20260709 13:17:29.533988  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 110639us
W20260709 13:17:29.540170  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.541985  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.537029  8118 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 8, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:29.555585  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.557575 11984 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.559005 11984 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:29.560480  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 64423.9us
I20260709 13:17:29.560949  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.561300  8258 leader_election.cc:400] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10.
W20260709 13:17:29.564870  8183 connection.cc:256] RPC call timeout handler was delayed by -1.5084910289999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:17:29.565421  8183 connection.cc:256] RPC call timeout handler was delayed by -1.5057910289999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:17:29.565804  8183 connection.cc:256] RPC call timeout handler was delayed by -1.504891028999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 13:17:29.566309  8183 connection.cc:256] RPC call timeout handler was delayed by -1.4346910290000778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
I20260709 13:17:29.569585  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:29.571290  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.571452  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.570371  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:29.571985  8216 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:29.569199  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.571462  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.573040  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.576565  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:29.576998  8923 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:29.577174  8920 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:29.578313  8927 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:29.563447 12007 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:29.560495 12005 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:29.533252 11925 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.583003 11808 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.605501  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.591305  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:29.596443  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 51086.1us
I20260709 13:17:29.596823  8211 raft_consensus.cc:2410] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:29.590901  8258 leader_election.cc:400] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8.
I20260709 13:17:29.625746  8258 leader_election.cc:403] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:29.593302  8183 leader_election.cc:336] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.764s (SENT)
I20260709 13:17:29.598945  8118 catalog_manager.cc:5697] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 6 to 7, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.589406 11617 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.589380 12009 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.631042 11617 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.631156 12009 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.632675  8258 leader_election.cc:400] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10.
I20260709 13:17:29.633240 11617 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:29.634162  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:29.634536  8927 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:29.630347  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 148538us
W20260709 13:17:29.591985 12004 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:17:29.649289  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 56049.7us
W20260709 13:17:29.635277  8889 leader_election.cc:336] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.246s (SENT)
I20260709 13:17:29.651084  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.650283  8118 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 8 to 9, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 9 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:29.654009  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:29.654769  8366 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.598503 12005 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:29.652379  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:29.557590 11809 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.597004 11994 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:29.664188  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:29.670419 12005 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:29.672111 11942 consensus_meta.cc:287] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.000s
I20260709 13:17:29.672235 11874 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:29.672729 11874 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.672587 11942 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.673133 11874 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.650540 12001 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.681303  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:29.682053  8183 leader_election.cc:336] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.780s (SENT)
I20260709 13:17:29.682497  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:29.653631 11617 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.690207  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.691218  8286 raft_consensus.cc:2368] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10.
I20260709 13:17:29.692749  8118 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:29.700866  8927 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:29.694267  8118 catalog_manager.cc:5697] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 6 to 8, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 8 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.713667  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:29.713476  8118 catalog_manager.cc:5697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.714615  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.703672 11808 consensus_queue.cc:1059] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:29.745376 11808 raft_consensus.cc:3055] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:29.745736 11808 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:29.746568 11808 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.748070 12009 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:29.598066 12007 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.747809 11808 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.749209  8294 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:29.731436 11994 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.734071  8366 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
W20260709 13:17:29.734170  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.755942  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 81207us
I20260709 13:17:29.734611 12013 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:29.737412  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.739988 12014 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:29.740466 11857 consensus_meta.cc:287] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.005s
I20260709 13:17:29.742311 12003 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.746690 11980 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.742354  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.720570 12000 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:29.750588  8220 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:29.773708  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:29.753455  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.769352  8219 raft_consensus.cc:2410] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:29.774437  8290 raft_consensus.cc:2368] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
W20260709 13:17:29.772315  8183 leader_election.cc:336] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.784s (SENT)
I20260709 13:17:29.729002  8118 catalog_manager.cc:5697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:29.773977  8286 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:29.722311 11942 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:29.748806 12009 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:29.778617  8186 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:29.779379 12022 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:29.767851 11830 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:29.782464 11858 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:29.784025  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:29.784309 12017 log.cc:927] Time spent T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:17:29.768847 11994 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.799264 11994 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:29.777473 11857 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.777570 12013 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.800442  8294 raft_consensus.cc:2410] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:29.773609 12003 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:29.801645 12013 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:29.802026 12003 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.803094 12003 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.803674 11857 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:29.778404 12012 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:29.804322 11980 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:29.804569 11925 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:29.805315  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 187111us
W20260709 13:17:29.805651  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.780515  8118 catalog_manager.cc:5697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 4 to 5, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 5 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
W20260709 13:17:29.794077  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 83797.8us
I20260709 13:17:29.796336  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.796420 12007 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:29.796916  8293 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:29.786511  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 73016.6us
W20260709 13:17:29.808730  8889 leader_election.cc:336] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 2.349s (SENT)
I20260709 13:17:29.810957  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.810092 11874 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.824342  8261 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.824183  8118 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 6 to 8, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:29.825417 11874 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:29.826128 11874 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:29.826972  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 54717.8us
I20260709 13:17:29.827512  8261 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:29.827682  8183 leader_election.cc:336] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.787s (SENT)
I20260709 13:17:29.828774 11980 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.829821  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:29.830314 11698 consensus_meta.cc:287] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 13:17:29.830554  8290 raft_consensus.cc:2368] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:29.832103 11925 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.832440  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.837893  8258 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:29.792817 11617 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:29.839534  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.839540  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:29.792861 11858 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:29.843297  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.844247  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:29.843983  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:29.848488  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.849118  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.855072  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.855284  8332 leader_election.cc:400] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12.
I20260709 13:17:29.855636  8287 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:29.857735  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.776891 12014 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.859236  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.869513  8295 raft_consensus.cc:2368] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
I20260709 13:17:29.862773 11867 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:29.863030  8219 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:29.863488  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.864203 11698 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.864566 11617 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:29.808635 11830 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.867048 11753 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.873277  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:29.875367  8211 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:29.852895 11858 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:29.878705  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:29.865518  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.852491 12008 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:29.807148 12022 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:29.887940 12022 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:29.889520  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:29.892596  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 65166.3us
I20260709 13:17:29.884428 12008 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:29.873914 11942 raft_consensus.cc:2764] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:29.874660 11867 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.900564  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.901016 11867 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.903141  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.904285 11863 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:29.905740  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.906095  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.906468  8261 leader_election.cc:400] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:29.906718  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.907392  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.881182 11994 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:17:29.908538 11994 consensus_queue.cc:1243] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:29.908587  8261 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.909104 11994 raft_consensus.cc:3055] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:29.909499 11994 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:29.909559 11980 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.910053  8261 leader_election.cc:400] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:29.910311 11994 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.880999 11984 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:29.911450  8261 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.911834 11984 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:29.912768 11984 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.895123 12008 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:29.895645  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 86953.7us
W20260709 13:17:29.915807  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 88179.4us
I20260709 13:17:29.884548 11874 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:29.896647 12014 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:29.922286  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:29.922508  8892 leader_election.cc:400] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:29.926196  8367 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:29.929229  8922 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:29.929832  8892 leader_election.cc:403] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:29.881466 12001 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8.
I20260709 13:17:29.927786  8293 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:29.932034  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.934612  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.938956 11830 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:29.939736  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.940315  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.940935  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:29.941684  8287 raft_consensus.cc:2393] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:29.942823  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:29.911445 11994 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.948248 11978 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:29.950335 11978 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:29.950724 11978 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.951093 11978 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.952297 12014 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:29.952412  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.954047 12014 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:29.955830 12007 raft_consensus.cc:3055] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.956208 12007 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:29.957291  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.957700  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:29.958253  8924 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.958907  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:29.959508  8927 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:29.960856  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:29.934983  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.935564  8261 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:29.936348 12000 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.936944  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:29.962276  8211 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:29.937587 11897 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:29.943639  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:29.963553  8211 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:29.956758  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.960294  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:29.966199  8289 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:29.967902  8923 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 5.
I20260709 13:17:29.884565 11753 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:29.972352  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:29.973658  8922 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:29.976806  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.977118  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:29.973424  8294 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:29.974279  8286 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:29.984834  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:29.984102  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 47254.5us
I20260709 13:17:29.989709  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:29.994143  8924 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:29.964594 11942 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.002566  8293 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:30.005134  8295 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:30.006800  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 71297.1us
W20260709 13:17:30.008409  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.970069 11874 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:30.010206  8219 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:30.060801 11874 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.062713  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.020215  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:30.023809 11753 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:30.024976  8290 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:30.065881  8921 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:30.025758  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:30.066814  8212 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:29.990821 11997 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:29.990377 12001 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:29.965169 12000 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.040721  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:30.042591 12030 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:17:29.984012 12007 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.054632 12014 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:29.965920 12029 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.061331  8219 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:29.906097 11617 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:30.069041  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 152469us
W20260709 13:17:30.078008  8183 connection.cc:256] RPC call timeout handler was delayed by -1.2591910290000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 13:17:30.078630  8183 connection.cc:256] RPC call timeout handler was delayed by -1.1801712540000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 13:17:30.079008  8183 connection.cc:256] RPC call timeout handler was delayed by -1.1394910290000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2295s for a response
W20260709 13:17:30.070410  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 62609.6us
I20260709 13:17:30.074910  8367 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
W20260709 13:17:30.079404  8183 connection.cc:256] RPC call timeout handler was delayed by -1.1234712539999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:17:30.080984  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0415712540000186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 13:17:30.081379  8183 connection.cc:256] RPC call timeout handler was delayed by -1.0055712539999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
I20260709 13:17:30.081284  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.083498  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:30.084442  8218 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:30.084544  8889 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.076453 11997 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.076301 12012 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:30.090266 11997 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:30.081368 12014 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.084316 12001 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:30.091254  8889 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.091576 12001 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.092247 12029 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.092347 12014 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:30.092903 12029 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:30.095254 12000 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:30.084137 12022 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:17:30.099121  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.099284  8213 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:30.099736  8367 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:30.103875  8214 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:30.104900 11994 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.083257 12008 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.105608  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:30.079632 11978 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.076931 11858 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.090189 11980 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.108834  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.140651  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.110414  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.110803  8217 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:30.110905 12012 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.111240  8261 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.112582  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:30.143661 11995 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:30.144234 11995 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.144627 11995 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.145535  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.147531 12012 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.150316 12012 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:30.151680  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.153817  8261 leader_election.cc:400] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:30.154167  8261 leader_election.cc:403] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.154819 11698 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:30.155316 11698 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:30.155791 11698 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.162014 11858 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:30.162227 11697 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:30.162820 11697 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:30.163297 11697 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:30.142316 12003 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:30.164324  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.167881 12008 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:30.118784 11753 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:30.170727 11978 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:30.171002  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:30.172328  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:30.173651  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.174644 11997 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.175532 11997 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:30.185441  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 44894.1us
I20260709 13:17:30.186645  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.188868  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.118542 11867 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.184427 12005 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.195585  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.184386 11994 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:30.205027  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:30.206562  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.184481 11863 raft_consensus.cc:2764] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:17:30.214958  8214 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.184953 12003 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:30.217846  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 126641us
I20260709 13:17:30.219728  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.224270  8889 leader_election.cc:400] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
I20260709 13:17:30.224615  8889 leader_election.cc:403] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.227885  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.228854  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.214483 11857 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.215668 12012 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.232254  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.229781  8361 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:30.231524  8214 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:30.234712  8360 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:30.221577 11939 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.213373 11697 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.240195  8218 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:30.240833 12022 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
I20260709 13:17:30.242853 11867 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:30.242888 11697 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:30.222484 12038 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:30.233722  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:30.254390  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:30.254686  8922 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:30.259296  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.229562 11884 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.260344  8361 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 8: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:30.261650  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:30.262923  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:30.265993  8926 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:30.263568  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:30.266866  8924 raft_consensus.cc:2368] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:30.264370  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:30.270948  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.272763  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:30.273491  8292 raft_consensus.cc:2410] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:30.274150  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.274928  8293 raft_consensus.cc:2410] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:30.275319  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.275882  8286 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:30.250691 12038 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:30.276789  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.277002  8287 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:30.258162 11857 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:30.278666  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:30.279028  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.280556  8291 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:30.280562  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:30.281764  8183 leader_election.cc:336] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.814s (SENT)
I20260709 13:17:30.282015  8926 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:30.283792  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 51647.3us
I20260709 13:17:30.284919  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:30.285694  8922 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.286901  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.287369  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.286903  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.288607  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:30.288859  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:30.289324  8294 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:30.291326  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.293268  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.294030  8287 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:30.294124  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.294293  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:30.295169  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.295003  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.287514  8290 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:30.295717  8288 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:30.297758  8287 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:30.297991  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.298439  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.298931  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.299103  8294 raft_consensus.cc:2368] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:30.271160 12001 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:30.300221  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:30.300797  8928 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.300756  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.261452 11698 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.307973  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.308174 11698 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:30.308795 11978 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.310031  8258 leader_election.cc:400] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9.
I20260709 13:17:30.310832  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.311528 11978 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.312865  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.313561 11978 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:30.318222 12038 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.319278 11997 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:30.320209 12043 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:17:30.301595 12003 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.321825  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.276885 11984 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:30.324354 11984 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.324780  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.325089  8360 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:30.301805 11762 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:30.326022  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:30.326556  8289 raft_consensus.cc:2376] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8. Re-sending same reply.
I20260709 13:17:30.326812 11809 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:30.328716  8361 raft_consensus.cc:1217] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-9.5]   Dedup: 7.4->[9.5-9.5]
I20260709 13:17:30.329257  8361 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:17:30.329486 12012 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:30.276816 11858 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:30.329958 11857 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:30.330369  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.330961  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.340624  8292 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:30.328971  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.341609  8293 raft_consensus.cc:2393] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:30.341145  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.330044  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:30.342479  8287 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:30.342759  8922 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:30.348896  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:30.349248  8926 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:30.349828  8288 raft_consensus.cc:2376] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8. Re-sending same reply.
I20260709 13:17:30.335712  8928 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:30.352686  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:30.353539  8291 raft_consensus.cc:2368] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:30.357681  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.338042 12001 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:30.371299  8183 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.374243  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:30.375075  8287 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 6: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:30.381911  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.397496  8216 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:30.342748 11858 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.400082  8366 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:30.401374  8288 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:17:30.401741  8288 pending_rounds.cc:85] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 7
I20260709 13:17:30.401942  8288 pending_rounds.cc:107] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:17:30.402149  8288 raft_consensus.cc:2889] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:30.382854 12044 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:30.388547 12013 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:17:30.400460  8366 pending_rounds.cc:85] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:30.408515  8366 pending_rounds.cc:107] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:17:30.408860  8366 raft_consensus.cc:2889] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:30.404623  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 74632.5us
I20260709 13:17:30.381934 11939 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:30.406498  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.396641 11867 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:30.400177 11808 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:30.425071  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.401985 12012 consensus_queue.cc:1243] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:30.388831 11994 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:30.388962 11978 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:30.409070 11762 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:30.395854 11897 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:17:30.396795 11492 consensus_queue.cc:1059] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:17:30.405781 11997 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:30.417145 11867 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:30.458590 11884 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:30.458750 11858 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:30.418110 11995 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.455031 11808 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:30.464216  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 82027.2us
I20260709 13:17:30.474833 12053 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:30.476532  8367 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:30.450990 11762 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:30.382505 12001 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:30.495160  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 87687.2us
I20260709 13:17:30.495440  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.497462  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.499096  8889 leader_election.cc:400] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
W20260709 13:17:30.499152  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 50779.6us
I20260709 13:17:30.454874 12012 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:30.501420  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.483353 11808 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:30.487123 11762 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.505132  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.507318  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.430678 11857 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.508860  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:30.509682  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.510936  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.512118  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.515239  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.511735  8258 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.516759  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.512420  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.536144  8366 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:30.537056  8363 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:30.516446  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.540463  8368 raft_consensus.cc:2393] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 6: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:30.512409  8889 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.547087  8367 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:30.516103 12048 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:17:30.551527  8889 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.553421  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:30.543484 11997 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.560724 11997 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:30.518576 11753 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.514161 12058 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:30.570385  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:30.573793  8293 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:30.571852  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:30.574615  8292 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.514587 12064 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.576304  8287 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:30.565086 12062 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:30.577008  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:30.581182  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.506475 12061 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:17:30.583204  8220 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:30.581907  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 198266us
I20260709 13:17:30.583549  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:30.584296  8363 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:30.582696  8214 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.582785  8362 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:30.553225 12029 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:30.590437  8261 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:30.575197 11753 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.575466 11997 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:30.598780  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.581885 12013 raft_consensus.cc:2764] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:30.509059 11867 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:30.601647  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 50232.5us
I20260709 13:17:30.603564  8889 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.631116  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:30.648317  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 64381.4us
W20260709 13:17:30.787974  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 138413us
I20260709 13:17:30.794688  8214 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
W20260709 13:17:30.803133  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 199643us
I20260709 13:17:30.803946  8889 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.805918  8292 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:30.600497 12064 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:30.798556  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:30.823834  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.825711  8889 leader_election.cc:400] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:30.822927  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:30.648598 12029 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:30.837172  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:30.839612  8214 raft_consensus.cc:606] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:30.837707  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.797343 12058 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:30.838747  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.819479 12009 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.819721 12064 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:30.855010 12006 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:17:30.854741 12029 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:30.834504 11995 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:30.838450 12014 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:30.851119 12064 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:30.904021  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.878499 11857 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:30.877986 12014 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:30.928423  8362 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:30.930105  8369 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:30.933369  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:30.934159  8214 raft_consensus.cc:606] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:30.934604  8214 raft_consensus.cc:614] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:30.914373 12053 consensus_queue.cc:1243] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:30.937302 12058 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:30.939086  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 100704us
I20260709 13:17:30.946283  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:30.949352  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.910988 12062 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:30.956656  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 113847us
W20260709 13:17:30.952615  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 163862us
I20260709 13:17:30.921056 11857 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:30.930754 12014 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:30.994329  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 48160.5us
I20260709 13:17:30.996110  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.961349 11857 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:31.006965  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.986465  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:30.980232  8360 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:17:31.024426  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.022114  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:31.026110  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:30.956238 12061 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:30.953871 12080 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:31.032711  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:31.023514 12007 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.023919 12074 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.041141  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:31.022192 11997 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:31.030531 12055 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.034577 12080 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:31.050730  8928 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:31.038707 12012 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:31.084434  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 112353us
W20260709 13:17:31.093151  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 65996.7us
I20260709 13:17:31.094406  8366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:17:31.095072  8366 raft_consensus.cc:606] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:31.047137 12087 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:17:31.096733 12067 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:31.097287 12067 raft_consensus.cc:697] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:31.094872 12074 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:31.098016 12074 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:31.098194 12067 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:31.098891 12074 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.034818 12061 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:31.057474 12080 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.105465  8183 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:31.099999 12071 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:31.132607  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 91553.5us
I20260709 13:17:31.056538 12062 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:31.190680 12092 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:17:31.317922  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.183854 12088 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:17:31.324942  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:31.545107  8928 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
W20260709 13:17:31.401270  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 298304us
I20260709 13:17:31.366361 12064 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.397521 11857 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:31.289273  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.185984 11762 consensus_meta.cc:287] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.000s
I20260709 13:17:31.551806 12086 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:31.552381 12086 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:31.552172 11762 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:31.245087 12077 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:17:31.489322 12061 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:31.218289 12076 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.391s
I20260709 13:17:31.215799 11874 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.206s
I20260709 13:17:31.558203 11762 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:31.558514 12086 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:31.217310 12083 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.560016 12084 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:31.560431 12061 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:31.560599 12084 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.217625 12091 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.316s
I20260709 13:17:31.218003 12093 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.561079 12061 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.136420 11995 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.280s
I20260709 13:17:31.561849 12093 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.562906 12084 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:31.188373 12099 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.369688  8927 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:31.564005 12093 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:31.189359 12101 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.414216 12113 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.565011 12113 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:31.568642 12101 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.571276 12093 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:31.187961 12095 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:31.529135  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.135272 12071 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:31.257388 12096 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.313838 12009 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:31.531200 12014 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.531311 12054 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:31.530815  8892 connection.cc:256] RPC call timeout handler was delayed by -1.0544890029998442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 13:17:31.254972 12097 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.184089 12090 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.389s
I20260709 13:17:31.201923 12055 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.228s
W20260709 13:17:31.543646  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 403261us
I20260709 13:17:31.548014  8258 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:31.548475  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.563356 12061 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:31.537985 11753 consensus_meta.cc:287] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.933s	user 0.015s	sys 0.002s
I20260709 13:17:31.641542  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:31.537580 12063 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:31.537459 12042 raft_consensus.cc:3055] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:31.638052  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 90118us
W20260709 13:17:31.640123  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 92777.2us
W20260709 13:17:31.641010  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.636439  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.544940 11809 raft_consensus.cc:3055] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:31.668183  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1898) took 1117 ms. Trace:
I20260709 13:17:31.670014  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:31.663132  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1892) took 1367 ms. Trace:
W20260709 13:17:31.676627  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.666371 12029 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.645051 12095 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:31.677976 12029 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:31.571692 12101 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:31.682340  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:31.683127  8216 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:31.687497  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:31.691411  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:31.692384  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:31.692925  8924 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:31.675678  8361 rpcz_store.cc:276] 0709 13:17:30.296163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.296420 (+   257us) service_pool.cc:224] Handling call
0709 13:17:30.328534 (+ 32114us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:30.329599 (+  1065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.662894 (+1333295us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b5400355f50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:31.663051 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73185024}
I20260709 13:17:31.648991  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1741) took 1478 ms. Trace:
I20260709 13:17:31.705025  8218 rpcz_store.cc:276] 0709 13:17:30.170942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.172016 (+  1074us) service_pool.cc:224] Handling call
0709 13:17:31.648708 (+1476692us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54000375d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:31.648910 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154424704}
I20260709 13:17:31.688289  8288 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:31.693918  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:31.685570  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:31.734033  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 64129us
W20260709 13:17:31.664224 12066 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.145s	user 0.000s	sys 0.010s
I20260709 13:17:31.736361 12055 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.645499 12063 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:31.573279 12113 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:31.674455  8367 rpcz_store.cc:276] 0709 13:17:30.550717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.550860 (+   143us) service_pool.cc:224] Handling call
0709 13:17:30.551681 (+   821us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:30.570215 (+ 18534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.570264 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:30.577225 (+  6961us) log.cc:844] Serialized 52 byte log entry
0709 13:17:31.030127 (+452902us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:31.529822 (+499695us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.530127 (+   305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.530221 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.667953 (+137732us) raft_consensus.cc:1685] finished
0709 13:17:31.667972 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.668123 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":501686,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":2817,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":32801,"thread_start_us":830870,"threads_started":2,"wal-append.queue_time_us":504534}
I20260709 13:17:31.669273 12064 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:31.679953 12029 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:31.667755 11857 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:31.643829 12096 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:31.680271 11809 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:31.640599 12071 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:31.703203  8185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.054s	sys 0.049s
W20260709 13:17:31.747608  8185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.054s	sys 0.049s
I20260709 13:17:31.676331 12009 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:31.750344 12009 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:31.748549  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.679806 12095 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:31.571765 12093 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.544620 12080 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.082705  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.048883  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:31.734588  8293 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
W20260709 13:17:32.085500  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 327281us
I20260709 13:17:31.875216  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 705) took 1032 ms. Trace:
W20260709 13:17:32.087843  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 446339us
I20260709 13:17:32.091398  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:31.923049  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.092604  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:31.742260  8291 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:32.053344  8367 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:32.093443  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:32.094262  8213 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.094462 12009 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.095129 12009 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.091686  8927 rpcz_store.cc:276] 0709 13:17:30.842951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.843259 (+   308us) service_pool.cc:224] Handling call
0709 13:17:30.843605 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.564223 (+720618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.874920 (+310697us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54002c33d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:31.875144 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208981248}
W20260709 13:17:31.754360  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 60551.1us
I20260709 13:17:31.664860 11925 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.920828  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:31.922559  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.099015  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:31.673295 12012 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:31.751421  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70283.6us
I20260709 13:17:32.046416  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.134752  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:32.052520  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:31.757652  8928 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:31.644255 11874 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:32.100490  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.137426  8367 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:32.100482  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:31.747206 12083 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:32.089466  8220 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:31.744721 11809 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.105998 12009 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:31.958367 12102 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.043846 11857 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:31.827961 12088 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:17:31.875538 12101 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.019636 12008 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:31.990249 12064 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:31.923099 12092 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:17:32.141077 12029 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:32.107609  8217 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:32.101980 11830 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:32.102187 12003 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.161394  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.161701  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:32.113303 12104 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:17:32.113582 12089 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:32.114061 12098 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.191510 12098 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.114923 11808 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:32.115521 12110 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:17:32.117144 11984 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:32.102931 12099 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.206243 12099 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.120831 12093 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:32.124332  8213 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:32.091940 12053 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:32.128822 11863 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:32.234597 11863 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:32.235899 11863 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.237412 11863 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.131062  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.089577 12022 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.131654 11897 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:32.131933 12087 raft_consensus.cc:993] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
W20260709 13:17:32.135600  8892 leader_election.cc:336] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.520s (SENT)
W20260709 13:17:32.246016  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 142697us
I20260709 13:17:32.246312  8892 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:32.247565  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 111977us
I20260709 13:17:32.054117  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.250589  8363 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:32.138787  8212 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:32.139350  8215 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:32.139711  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:31.676158 12042 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:31.665562 12108 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.147493  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:31.989030 12058 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.732823 11980 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.150020  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 57477.7us
I20260709 13:17:31.645632 11753 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.745553 12096 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:32.195828 11830 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.159157 12008 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.158171  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:32.164023  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.143035 11874 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:31.643996 12054 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.114500 12100 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.192580 12003 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:32.193354 12089 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.146426 12012 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.152742 12055 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:32.151322 12102 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.152904 12101 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:32.198141  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.145704 11925 consensus_queue.cc:1059] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:32.209208  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.188138 12080 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:32.252395  8220 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:32.256521  8924 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:17:32.290294  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.152366 11857 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.248404  8889 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:32.258984  8291 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:32.233417 12053 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.261365 12087 raft_consensus.cc:1081] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:17:32.261662  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:31.741443 12063 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:31.646085 12014 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.162364 12064 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.161160 12029 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.383168  8922 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:32.262272  8218 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:32.413442  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:32.425840  8218 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:32.411701  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.416272  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 167975us
I20260709 13:17:32.416451  8368 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:32.417961  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 272567us
I20260709 13:17:32.418850  8360 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:32.423655  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.256481 12113 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.413276 11874 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.297854 12116 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.418098 12101 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.426504  8217 raft_consensus.cc:2368] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12.
I20260709 13:17:32.506256  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:32.478853  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.469425  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 56393.4us
W20260709 13:17:32.439018  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.500118  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.410979 11808 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.379783 11698 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.380769 11984 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.295966 12001 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.501075  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 369870us
I20260709 13:17:32.502035  8927 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:32.265086 12107 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.496762  8218 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.509995 11830 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:32.422283 12009 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.413230 12093 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.453166 12041 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.775s	user 0.007s	sys 0.000s
I20260709 13:17:32.546077 12008 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:32.263581 12115 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:32.546669  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.546808 12115 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.549170 12089 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:32.549446 12115 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:32.524410  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.524983  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.256812 12022 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.552222  8920 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:32.535990 11698 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.553053 12022 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:32.553558 12022 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.553987 12022 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.554740 11698 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:32.556288  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.434783 12055 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:32.557092 12098 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:32.557610 12055 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.534530 12067 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:32.561614 12062 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.555799 12022 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:32.562114 12062 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.563414 11857 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:32.563911 12099 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:32.565109 12029 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:32.565214 11867 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.566517 12102 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:32.568133 12014 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:32.418273 12100 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.571559 12100 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:32.573693 12053 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:32.573975  8369 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:32.526870  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:32.263762 12108 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:32.574510  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 74954.7us
I20260709 13:17:32.520113 12063 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:32.578404  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 78949.1us
W20260709 13:17:32.582166  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 55620.9us
I20260709 13:17:32.421716 12058 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:32.585425  8889 leader_election.cc:336] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.835s (SENT)
I20260709 13:17:32.585436  8361 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:32.585880  8889 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:32.586236  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 282250us
I20260709 13:17:32.586892  8291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53535408ea514f8db7292852927e7743"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:17:32.541357  8261 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:32.542142  8218 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.591229  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.512115 12116 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.520133 12080 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.544437 12009 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.525816 12113 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:17:32.453637 12003 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.503679 12005 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:32.602424 12005 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:32.579824  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.533205 12105 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.417491 11980 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.591809  8289 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [5.7-8.8]
W20260709 13:17:32.577680 12097 consensus_meta.cc:287] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.000s
I20260709 13:17:32.588347  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:32.577320 12071 consensus_meta.cc:287] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.831s	user 0.004s	sys 0.007s
I20260709 13:17:32.565795 12064 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:32.594810  8360 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:32.595237  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.636161  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:32.596276 12080 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:32.596676  8215 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:32.597114 12108 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:32.597630 12054 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:32.495397 12079 consensus_queue.cc:1175] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e95b04d03d241329435b6d08dd1f236" responder_term: 13 status { last_received { term: 12 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:32.598201 12009 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.642110 11808 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:32.642560 11808 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.642901 11808 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.597654  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.644357  8220 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:32.644505 12130 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.600744  8365 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:32.601086 11753 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:32.545008 12001 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.538669  8368 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:32.608678  8288 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:32.591892 12119 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:17:32.587965 11867 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:32.633240  8361 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:32.619951  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 78683.9us
I20260709 13:17:32.660521  8368 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:32.660888  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:32.662225  8261 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:32.639943 12080 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.664235  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:32.665349  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:32.665992  8294 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:32.666898  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:32.646129  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:32.541427 11984 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:32.646874  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 61471.7us
I20260709 13:17:32.637563  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.647707  8287 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:32.578088 12093 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.512115 12042 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.655285  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:32.732496  8288 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.668776  8218 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:17:32.613152 12105 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:32.638888 12097 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:32.696460  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 114485us
I20260709 13:17:32.740854  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.709775  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:32.722750  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.723891  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.647318 12064 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.667685  8294 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:32.726989  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:32.575323 12107 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.728700  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:32.729326  8922 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [5.7-8.8]
I20260709 13:17:32.724613  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.733119  8218 pending_rounds.cc:85] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 7
I20260709 13:17:32.702587 12073 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.736181 12083 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:32.737320  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.633803 12071 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.737113  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:32.782025  8919 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.695899 12089 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:32.702374 12098 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.731961 12076 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.766608  8218 pending_rounds.cc:107] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:32.764088  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:32.769184  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:32.769500  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:32.769943  8214 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:32.770797  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:32.773258  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:32.750196  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.777132  8211 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:32.777477  8291 raft_consensus.cc:606] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:32.779608  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:32.780508  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:32.728171 12029 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.729256 11867 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:32.891357  8290 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:32.811842  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.737861 12075 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:32.748318  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:32.905297  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 134601us
I20260709 13:17:32.905428  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:32.741587 12105 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.890040  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:32.910389  8922 raft_consensus.cc:2410] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:32.892489  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1748) took 1064 ms. Trace:
I20260709 13:17:32.911890  8214 rpcz_store.cc:276] 0709 13:17:31.828078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.828330 (+   252us) service_pool.cc:224] Handling call
0709 13:17:32.744007 (+915677us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b5800001298. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eceee 0000000000375939 00007f32023601e0 00007f32024290c4 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:17:32.744199 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.892105 (+147906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.892412 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115049088}
I20260709 13:17:32.893154  8924 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:32.893883  8291 raft_consensus.cc:614] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:32.894294  8923 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
W20260709 13:17:32.915628  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 205929us
I20260709 13:17:32.917531  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.894791  8218 raft_consensus.cc:2889] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.890103  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:32.896072  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 83162.1us
I20260709 13:17:32.895275  8925 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:32.894812  8294 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:32.763943 12055 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.897704  8360 raft_consensus.cc:2410] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:32.926683  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:32.905740  8287 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:32.927345  8290 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
W20260709 13:17:32.897567 11863 consensus_meta.cc:287] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.002s
I20260709 13:17:32.906432  8215 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:32.811659 12089 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:32.907052  8889 leader_election.cc:336] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 2.311s (SENT)
I20260709 13:17:32.727900 12008 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:17:32.930179  8217 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:32.966089  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.735354 12078 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.156s
I20260709 13:17:32.920943  8921 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:32.903143  8288 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:32.831166  8919 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:32.969451  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 709) took 1250 ms. Trace:
I20260709 13:17:32.814484 11997 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:32.906970  8362 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:32.904068 12003 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.788486 12064 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.906739 12053 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:32.932353  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.980584  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.918922 12097 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:32.967317  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.930368  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:32.967721  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:32.788210 12100 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 13:17:32.972616  8363 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:17:32.969868  8928 rpcz_store.cc:276] 0709 13:17:31.690972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.691094 (+   122us) service_pool.cc:224] Handling call
0709 13:17:32.941138 (+1250044us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b54004c2554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:32.941277 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150461824}
W20260709 13:17:32.982627  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 65860.7us
W20260709 13:17:32.979353  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 237909us
I20260709 13:17:32.982669  8363 pending_rounds.cc:85] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:32.983377  8363 pending_rounds.cc:107] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:32.983632  8363 raft_consensus.cc:2889] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.891577 12098 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.985126  8258 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:32.922297 12131 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:32.991562 12131 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:32.933063 12054 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.811578 12083 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.788666 12073 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.970945 12089 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:32.987675  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 80657.4us
I20260709 13:17:32.960220 12139 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.903999 12029 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.004513  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.010851  8360 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:32.923061 11753 consensus_queue.cc:1059] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:17:33.013064  8368 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:33.013135  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:32.977404 11863 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:32.929600 11830 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:17:32.939800 12108 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:17:32.940016 12055 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:32.966761 12099 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:17:32.904007 12076 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.001139 11884 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:32.990691 12053 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:32.985002 12097 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:33.022233 12000 raft_consensus.cc:3055] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:32.993753 12131 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:33.030611  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.032938  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 49507.1us
I20260709 13:17:33.040946  8361 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:33.017540 12116 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.003377 11925 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:33.029415 12125 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:17:32.980188 11997 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:33.023017 11874 consensus_meta.cc:287] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
W20260709 13:17:33.030062 12136 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:17:33.068746 12075 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:33.070505  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 85397.9us
I20260709 13:17:33.018805 12140 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.016966 12064 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.014339 12139 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:33.081461  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.985443 12003 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:33.082870  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 107390us
I20260709 13:17:33.029516 11863 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.014559 11867 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.021795 12029 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:33.024991 11984 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.025291 12001 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.027243 12083 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.050818  8925 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:33.027830 12107 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.029327 12098 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.090044  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.005302 12038 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:17:33.078536 12097 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.078729 12000 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:33.083032  8369 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
W20260709 13:17:33.156090  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.014696 12054 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.162842  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:33.398414  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.398926  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 236163us
W20260709 13:17:33.400655  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 316220us
I20260709 13:17:33.130038  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1908) took 1078 ms. Trace:
W20260709 13:17:33.296948  8295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2217) took 3022 ms (client timeout 1831 ms). Trace:
W20260709 13:17:33.230122  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 57912.1us
I20260709 13:17:33.431030  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1749) took 1544 ms. Trace:
W20260709 13:17:33.419590  8295 rpcz_store.cc:269] 0709 13:17:30.273086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.273196 (+   110us) service_pool.cc:224] Handling call
0709 13:17:33.256488 (+2983292us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54002e72d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:33.295210 (+ 38722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4271916416}
I20260709 13:17:33.437435  8211 rpcz_store.cc:276] 0709 13:17:31.886340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.886489 (+   149us) service_pool.cc:224] Handling call
0709 13:17:31.921126 (+ 34637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.893615 (+972489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.430708 (+537093us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54001d4054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:33.430955 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960866560}
I20260709 13:17:33.087855 12058 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:33.320063 12101 consensus_meta.cc:287] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.789s	user 0.009s	sys 0.000s
I20260709 13:17:33.086016 12008 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:33.250679 12137 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:17:33.125564 11997 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:33.255072 12112 log.cc:927] Time spent T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.576s	user 0.003s	sys 0.000s
W20260709 13:17:33.303791 11808 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.000s
I20260709 13:17:33.418316  8364 rpcz_store.cc:276] 0709 13:17:32.051974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.053519 (+  1545us) service_pool.cc:224] Handling call
0709 13:17:32.090935 (+ 37416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.148287 (+ 57352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.148326 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.156313 (+  7987us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.498918 (+342605us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:32.498989 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.499083 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.129830 (+630747us) raft_consensus.cc:1685] finished
0709 13:17:33.129849 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.129984 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50791,"raft.queue_time_us":45387,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4033,"thread_start_us":309784,"threads_started":1,"wal-append.queue_time_us":463399}
W20260709 13:17:33.175598 12009 consensus_meta.cc:287] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.000s
I20260709 13:17:33.119715 12093 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.441061  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:33.432101  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.423322 11697 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:33.250259 12062 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.336822 12012 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:33.119169 11980 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.446877  8360 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:33.121629 12073 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.178947 12139 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:33.443897 11858 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.006s	sys 0.022s
I20260709 13:17:33.424151 11897 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:33.121824 12144 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:33.120668 12071 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.117341 11874 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:33.486452 12134 log.cc:927] Time spent T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.516s	user 0.002s	sys 0.000s
I20260709 13:17:33.468753  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.126504 12105 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:33.475800 11858 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.007s	sys 0.022s
I20260709 13:17:33.442652 12140 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.475287  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.440840 12151 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:17:33.443636 12008 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:33.478084  8258 leader_election.cc:400] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12.
I20260709 13:17:33.479841 11809 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.472538 11697 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:33.481837 12054 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.509330 12105 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.463884 11808 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:33.510077 12141 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.474s	user 0.000s	sys 0.004s
I20260709 13:17:33.510802 12089 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.445914 12101 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.511461  8216 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:33.484488 12144 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.513228 12101 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.478471 11897 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.513844 12144 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.121783 12076 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.487521  8292 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.490154 11874 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.473675  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:33.511315 11808 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.515599  8211 raft_consensus.cc:606] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:33.501267 12008 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.516286  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1919) took 1134 ms. Trace:
I20260709 13:17:33.516786  8363 rpcz_store.cc:276] 0709 13:17:32.381641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.381784 (+   143us) service_pool.cc:224] Handling call
0709 13:17:32.382117 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.984032 (+601915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.516002 (+531970us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54000a3a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:33.516218 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354748672}
I20260709 13:17:33.518173  8363 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.463986 12147 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:17:33.465653 12009 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.488956 12055 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.516149  8211 raft_consensus.cc:614] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:33.524654 11809 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:33.526026  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:33.526916 11809 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.527427  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:33.459422 12000 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.528095 12042 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.528934 12000 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:33.528986 12008 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.533886 12008 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.475560  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 714) took 1228 ms. Trace:
I20260709 13:17:33.462666 12083 consensus_queue.cc:1059] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:17:33.499562  8258 leader_election.cc:403] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:33.540304  8927 rpcz_store.cc:276] 0709 13:17:32.247256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.249344 (+  2088us) service_pool.cc:224] Handling call
0709 13:17:33.475404 (+1226060us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b5400499b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:33.475505 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198644480}
I20260709 13:17:33.541004 11808 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:17:33.541129  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 63840.9us
I20260709 13:17:33.542045 11809 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.542690 11809 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.508551 11697 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.482322 11863 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:33.515543 11897 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:33.520325  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.545473  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:33.538460 12053 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:33.539589 12009 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.542016  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:33.547362  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:33.548372 12008 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.548885 12008 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:33.549163 12089 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.549402 12008 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.520390  8926 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:33.552239  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.552302  8286 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:33.552587  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.499275  8364 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:33.553746 11808 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12.
I20260709 13:17:33.553953  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.554688  8364 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:33.555325  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.555347  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.556849  8364 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:33.556963 12140 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:33.558678  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:33.559573 12009 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.559707  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:33.560415  8212 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 6: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:33.560109 12009 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.561604 11809 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.562332  8364 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:33.554235  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.563206  8889 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:33.573179  8889 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:33.471159 12093 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:33.496212  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:33.576514  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.566120  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:33.543054 12063 consensus_meta.cc:287] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.960s	user 0.009s	sys 0.002s
I20260709 13:17:33.577755  8186 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:33.250164 12075 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.579941  8212 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
W20260709 13:17:33.580440  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.547482 12097 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.578272  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:33.580674  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:33.588261  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.585752  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.589097  8217 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
W20260709 13:17:33.580156  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 133672us
I20260709 13:17:33.586658  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.590180  8211 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:33.596931  8927 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:33.589272  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:33.589672  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.600867  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:33.608876  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.609248  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:33.609944  8217 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.610783  8367 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:33.577517 12093 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:33.612401  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 45066.2us
I20260709 13:17:33.580529 12014 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.615586  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:33.585319 12132 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.638643  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:33.638921  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.603492 12105 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:33.613550 12079 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.642263  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:33.597951 12099 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:33.642500  8363 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:33.603299 12023 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.640869  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:33.653278  8919 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:33.645566  8258 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:33.614632 11925 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.647540  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:33.603015 11874 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:33.580751 11809 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:33.638052 12062 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.620183 12093 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.639842 11997 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:33.668452  8215 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:33.616214 12014 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.638355 11980 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.663722  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:33.584509 12131 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.610450 11897 consensus_queue.cc:1059] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:17:33.647819 12064 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:33.644814 12058 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:33.662793  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:33.659864  8217 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:33.644431 12132 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.661252 11925 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.694155 11925 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.691191 12014 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.701493 11925 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.702697 12008 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.704356  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:33.692375  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:33.703912 11897 raft_consensus.cc:3055] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:33.661438 12099 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.651278  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:33.707971  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 56796.7us
I20260709 13:17:33.708580  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:33.661283 11858 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.711210 12001 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:33.711738 12158 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:33.712474 11897 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:33.689249 12105 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.714377  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:33.757126  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 160653us
I20260709 13:17:33.714917 12096 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.689662 12003 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.664631 12009 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.715903 12131 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:33.766121  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:33.667222 12153 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:17:33.715617 12064 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.663039 11809 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:33.667076 11874 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.823998 12005 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.824924  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1765) took 1234 ms. Trace:
I20260709 13:17:33.825524 11874 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.663480 12079 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.692782 11997 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:33.716408  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 53662.3us
I20260709 13:17:33.691387 11980 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.716917 12151 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:33.827152 12151 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.827539 12151 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:33.827584  8366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1916) took 1667 ms (client timeout 2187 ms). Trace:
I20260709 13:17:33.827757 11997 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.828055 11980 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.720400  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:33.828702  8921 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.702302 12132 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.722275 12097 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.833343 11897 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.834601 11897 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:33.836589 12160 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:17:33.661584 12023 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:33.752405 11697 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.837359 12023 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.837414 11697 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:33.837945 11697 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.838972  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 593) took 1113 ms. Trace:
W20260709 13:17:33.735433  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.687518 11984 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:33.753252  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 44541.5us
W20260709 13:17:33.840792  8366 rpcz_store.cc:269] 0709 13:17:32.159959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.160117 (+   158us) service_pool.cc:224] Handling call
0709 13:17:33.827396 (+1667279us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54003651d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:33.827509 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509432704}
I20260709 13:17:33.833351 12064 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.755722 11858 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.842543 12124 raft_consensus.cc:3055] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:33.842826 11858 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.842967 12124 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:33.847167  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.847059 12023 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.715340 12038 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:33.848248 12038 consensus_queue.cc:1243] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer d03eaa3ce81042f9b114cd00a7f41b17 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:33.848338  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.849781  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.758085  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:33.853425  8363 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.854398  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.735765 12099 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:33.704088 11925 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:33.763576  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:33.735147 12083 raft_consensus.cc:3055] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:33.755057 12001 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:33.860637  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 102675us
W20260709 13:17:33.813135 12165 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:33.748634 12058 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.867249  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1913) took 1725 ms. Trace:
I20260709 13:17:33.867704  8367 rpcz_store.cc:276] 0709 13:17:32.141547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.143441 (+  1894us) service_pool.cc:224] Handling call
0709 13:17:32.143803 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.611228 (+1467425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.867049 (+255821us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400406854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:33.867195 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3355087232}
I20260709 13:17:33.819275 12139 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:33.820248  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 111703us
I20260709 13:17:33.820518 12008 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.762039 12096 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.825296  8216 rpcz_store.cc:276] 0709 13:17:32.590874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.591006 (+   132us) service_pool.cc:224] Handling call
0709 13:17:33.824743 (+1233737us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400092754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:33.824870 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114205056}
I20260709 13:17:33.836511  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1759) took 1708 ms. Trace:
I20260709 13:17:33.726498  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2502) took 1075 ms. Trace:
I20260709 13:17:33.734012  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 591) took 1600 ms. Trace:
I20260709 13:17:33.839362  8926 rpcz_store.cc:276] 0709 13:17:32.725491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.725606 (+   115us) service_pool.cc:224] Handling call
0709 13:17:32.725862 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.551485 (+825623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.838736 (+287251us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b540046cdd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:33.838913 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826398976}
I20260709 13:17:33.840694 11984 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.860952  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:33.861346  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:33.865849  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1629) took 1256 ms. Trace:
I20260709 13:17:33.884459  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:33.882867  8292 rpcz_store.cc:276] 0709 13:17:32.609633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.609806 (+   173us) service_pool.cc:224] Handling call
0709 13:17:32.610047 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.514885 (+904838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.865586 (+350701us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54001284d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:33.865782 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017460992}
I20260709 13:17:33.888422  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:33.888562  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.889055  8214 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.871119  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:33.875336  8219 rpcz_store.cc:276] 0709 13:17:32.128638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.129139 (+   501us) service_pool.cc:224] Handling call
0709 13:17:32.129545 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.478105 (+348560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.478150 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.478209 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:32.478252 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.836269 (+1358017us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54000370d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:33.836319 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.836445 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800942464}
I20260709 13:17:33.889441  8258 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:33.889757  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.760824 12000 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:33.764341 12145 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.875061  8920 rpcz_store.cc:276] 0709 13:17:32.133860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.134762 (+   902us) service_pool.cc:224] Handling call
0709 13:17:32.151195 (+ 16433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.552585 (+401390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.733688 (+1181103us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540024e354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:33.733914 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921196288}
I20260709 13:17:33.889120  8217 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:33.890857  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:33.896888  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:33.897610  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:33.861955 12153 consensus_queue.cc:1243] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:33.858460 12131 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.878293  8365 rpcz_store.cc:276] 0709 13:17:32.651029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.787633 (+136604us) service_pool.cc:224] Handling call
0709 13:17:32.907863 (+120230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.032389 (+124526us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:33.446036 (+413647us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.724931 (+278895us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b1800253ba0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa29ec0a 00007f32039de219 00007f31fa326a40 00007f31fa3214e4 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287 00007f31fd42c208
0709 13:17:33.725127 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.725195 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:33.725258 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.726207 (+   949us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400355a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:33.726264 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.726423 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2818,"prepare.queue_time_us":430128,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":41,"raft.queue_time_us":257691,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":308680320,"thread_start_us":441492,"threads_started":2,"wal-append.queue_time_us":52578}
I20260709 13:17:33.883358  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:33.766463 12063 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:17:33.860272 11809 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.860663 12083 raft_consensus.cc:740] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:33.791935  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:33.890822  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1923) took 1225 ms. Trace:
I20260709 13:17:33.902918  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:33.871752 12140 raft_consensus.cc:2764] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:33.904773  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.892686 11984 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.908010  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.927057  8220 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:33.906353  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.928860  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:33.909029  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.908573  8258 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:33.862762 12001 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.911080  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:33.895139 12145 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.894941 12000 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:33.881029 12103 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:17:33.913712 12131 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.843895 12124 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.908592 11925 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.918799 12058 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:33.920845 12093 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.881438 12100 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:17:33.921201 12151 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.884109 12096 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.924058  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.973753  8360 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:33.974928  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.905591  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.765174 12105 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.952641 12000 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.930713  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:33.952713 12145 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.916352  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:33.925995 12053 consensus_queue.cc:1059] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:33.933617  8921 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:33.936286  8214 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:33.937502 12139 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.894189 11617 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:33.908654 12008 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.915397 12003 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:17:33.911245 12038 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:33.911310 12012 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:33.953586  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.994405  8363 raft_consensus.cc:2410] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:33.915525 12069 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.955941  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:33.893878 11997 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:17:33.882867 12132 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.901294 11808 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:17:33.942339 11874 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:33.930341  8183 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:34.038627  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 108401us
W20260709 13:17:33.977337  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46725.7us
I20260709 13:17:33.964937 11925 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:33.979665  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:33.981823  8289 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:33.982030  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 65745.4us
I20260709 13:17:33.978415  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:33.944953  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.042855  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.985193 11617 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:33.990283  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.044902  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:33.988576  8286 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:17:34.045711  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:33.960997 12005 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:34.029728  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.047739  8363 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.031857  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:33.983366 12058 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:34.049464  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:34.040256  8258 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:33.819283 12014 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.029240 12080 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.051596  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:34.055634  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:34.052510  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:34.061657  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.041016 12012 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:34.065025  8214 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.080062  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.081741  8214 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:34.043599 12103 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:34.082929  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.083196  8367 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:34.065091  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.083595  8288 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:34.061604  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:34.075975  8216 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:34.077901  8292 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.078375  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.050571 12053 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:34.046574 12131 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:33.981295 12083 consensus_queue.cc:260] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.057732 11874 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.049729 12058 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.091398  8220 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.102893  8292 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:34.087026  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.103885  8216 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:34.072685 12054 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:34.087383  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.087324  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.109823  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.073668 12159 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:34.104936  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.079053 12144 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:34.047224 12097 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:17:34.108821  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 64637.2us
I20260709 13:17:34.081014 12038 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:34.109911  8294 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:34.093947 12023 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:34.081496 12107 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:34.113451  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.106995  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:34.085649  8219 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:34.116007  8363 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:34.148053  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:34.167620  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 60742us
I20260709 13:17:34.096179 12053 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:34.172574  8258 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:34.104317  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.159147 12098 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.159336 12014 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.190083 11617 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.072882 11863 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:17:34.147568 12071 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:34.191565 12071 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.193962 12071 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:34.080895 11858 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.196180 11858 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.098428 11874 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.196817 12139 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.196987 11874 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.197301 12139 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.197767 12139 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.197940 12151 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.200431 12093 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.201012 11925 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.202104 12132 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.204265 12105 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.205994 11874 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.206163 11984 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.191637 12079 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:34.195852 11697 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.208263 12012 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.208956 11874 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:34.210835 12175 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:17:34.172602 12147 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.211802 12147 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.162371  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.164099  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.155092  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.215595  8294 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:34.216758  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.218080  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:34.174273  8292 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:34.110561 12153 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:34.109244 12058 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.189491 12098 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:34.197054 12169 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:17:34.220002  8288 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:34.181984  8218 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
I20260709 13:17:34.154359 12038 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.237129  8287 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:34.250003  8220 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:34.210693 11697 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.177588 12053 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.175310 11997 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.172124 12144 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:34.249382 12125 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:34.237746 12153 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:34.365996  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.255607 12038 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:34.440599  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 3caa82d776714435898936cb4c6041c0: Illegal state: Replica 9e95b04d03d241329435b6d08dd1f236 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
W20260709 13:17:34.446163 12174 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
W20260709 13:17:34.454618 12099 consensus_meta.cc:287] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.004s
I20260709 13:17:34.460296 11697 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:34.461114 11697 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.294118 11925 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:34.316138 12172 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 13:17:34.506749  8925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.020s	sys 0.054s
W20260709 13:17:34.521134  8925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.020s	sys 0.054s
I20260709 13:17:34.455289 12099 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.357654 11984 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.413404 12153 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:34.542412 12185 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:33.916031  8369 rpcz_store.cc:276] 0709 13:17:32.665116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.507263 (+842147us) service_pool.cc:224] Handling call
0709 13:17:33.507621 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.507816 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:33.562383 (+ 54567us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.890506 (+328123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.890577 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:33.890620 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.890678 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.890772 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3068,"prepare.queue_time_us":191,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":25083,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3315,"thread_start_us":305834,"threads_started":1}
W20260709 13:17:34.544077  8892 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.954s (SENT) [suppressed 35 similar messages]
W20260709 13:17:34.539340 12173 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.430s	user 0.000s	sys 0.001s
W20260709 13:17:34.562372  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.594122  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.568936  8216 raft_consensus.cc:2393] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:34.598814  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.599901  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:34.601495 11808 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:34.601619  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.602098 11808 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:34.603215  8366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.051s	sys 0.039s
W20260709 13:17:34.603593  8366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.051s	sys 0.039s
I20260709 13:17:34.603058 11808 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:34.550171 12008 consensus_meta.cc:287] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.002s
I20260709 13:17:34.608701  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.519994 11925 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.611776  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:34.613406 11925 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:34.619485 12096 consensus_meta.cc:287] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.637s	user 0.005s	sys 0.002s
W20260709 13:17:34.624414 12182 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:17:34.624122  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.626513  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:34.627161  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.627352  8369 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:34.629824  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.631209  8362 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:34.631742  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.632161  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.636139  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.555727 12147 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.633379  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.595978 12054 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:34.639050  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.639822  8219 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:34.640769  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:34.630862 11809 consensus_meta.cc:287] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.004s
I20260709 13:17:34.626719 12008 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.643297  8219 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.628677 12103 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.648819  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.650852  8219 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.633771 12080 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.633421 12098 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.652390  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:34.632745 12079 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:17:34.611240 12193 consensus_queue.cc:1059] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:17:34.647883 11809 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.626906 12096 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.658595  8219 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:34.648118 11697 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.634213 12038 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.587706 12144 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.663316  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:34.670042  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.662179  8212 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:34.675414  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:34.676247  8363 raft_consensus.cc:2410] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 10 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:17:34.676033  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.676770  8361 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.677094  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:34.651697 12159 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:34.677709  8365 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:34.679253  8290 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:34.680871  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.679440  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.682629  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:34.683892 12096 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.653508 12147 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:17:34.683786 12054 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.667778 12080 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:34.685120 12080 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:34.685489 12080 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:34.688391  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:34.655087 12076 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:17:34.653741 12103 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:34.713310  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.677562 12098 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:17:34.714169 12099 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:34.698323 12145 consensus_meta.cc:287] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.002s
I20260709 13:17:34.714957  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.698813  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.715731  8214 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:34.716152  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.716529  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.717159  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.717598  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.718163  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.718616  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.719118  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.699054 12055 raft_consensus.cc:3055] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.719561  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:34.691125 12000 consensus_meta.cc:287] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.697s	user 0.006s	sys 0.002s
I20260709 13:17:34.705909 12159 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.707584 12080 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.692131 12193 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:17:34.722170 12080 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.722793  8364 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:34.708611 12053 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.723021 12000 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.724174  8215 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:34.724311 12124 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.725121 12053 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.725478  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.726011  8215 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:34.726720  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.726889 12058 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.710471 12038 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.713258 12103 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.714799 12145 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.675313 11857 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:34.709074 11867 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:34.727692  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.697145  8219 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:34.709921  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1632) took 2072 ms. Trace:
I20260709 13:17:34.703033  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.713260  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.719748 12055 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:34.731338  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 789368us
I20260709 13:17:34.737931  8261 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.728189  8214 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 6.
I20260709 13:17:34.739408  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.742368  8361 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:34.736193  8289 rpcz_store.cc:276] 0709 13:17:32.637996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.638105 (+   109us) service_pool.cc:224] Handling call
0709 13:17:33.511725 (+873620us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b5800190e98. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa2ecb71 00007f31fa2eca22 00007f3203205c09 00007f320235fee0 00007f32024290ab 00007f3202429131 00007f32023eafc0 00007f32023d5929 00007f32023d53d2 00007f31fb94cbd4
0709 13:17:33.511967 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.043697 (+531730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.709703 (+666006us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54002e9ad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:34.709867 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098816512}
W20260709 13:17:34.691150 12171 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.659s	user 0.003s	sys 0.003s
I20260709 13:17:34.745121  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.745908  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.746376  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:34.746675  8213 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:34.749624  8214 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:34.751519  8213 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:34.752455  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:34.753531  8215 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.747062  8219 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:34.756323  8261 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.757297  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:34.735796 11857 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.756158  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:34.760398  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 216355us
I20260709 13:17:34.759989  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.762181  8292 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:34.763469  8288 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.763916  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.764716  8288 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:34.765643  8214 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:34.766095  8214 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:34.767268  8922 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.768010  8919 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.762681  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.735566 11867 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:34.788434  8288 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:34.770612  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:34.789857  8922 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:34.791735  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:34.758814 12038 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.766917  8214 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.796576  8214 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.761307 11857 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.763401 12080 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:34.798519  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.800433  8287 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:34.801554  8287 raft_consensus.cc:1240] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.763146 12193 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.803215  8261 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.804682 12093 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.787958 12064 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.789304 12008 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:34.808398  8362 pending_rounds.cc:85] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 6
I20260709 13:17:34.808709  8362 pending_rounds.cc:107] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:17:34.808624  8921 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:34.809188  8362 raft_consensus.cc:2889] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:34.810314  8923 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:34.761436 12053 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:34.760622 12096 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:17:34.813362  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 182213us
I20260709 13:17:34.813596  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.811568  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.797140 12089 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:34.815008  8361 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.816283  8367 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:34.758960 12196 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:17:34.802914 12080 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:34.822669  8289 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.823360  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.818915  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.805266 11874 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.806485 12098 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:34.828065  8921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:17:34.821712  8287 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:34.828572  8921 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:34.828955  8921 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:34.824071  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1778) took 1215 ms. Trace:
I20260709 13:17:34.830989  8211 rpcz_store.cc:276] 0709 13:17:33.608433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.608548 (+   115us) service_pool.cc:224] Handling call
0709 13:17:33.609027 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.609276 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.609308 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.609764 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.859524 (+249760us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:33.859559 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.859620 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.690581 (+830961us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:34.819314 (+128733us) raft_consensus.cc:1685] finished
0709 13:17:34.819339 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.823999 (+  4660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6737152,"thread_start_us":207305,"threads_started":1,"wal-append.queue_time_us":347976}
I20260709 13:17:34.827020  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.834537  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:34.840099  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.840636  8215 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.838482  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.842907  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:34.843412  8361 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:34.844961  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:34.845250  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.845639  8927 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 5.
I20260709 13:17:34.846295 12159 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:34.838203 12190 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:34.817304 12079 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:17:34.848400 12003 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:34.849321  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:34.807298 12147 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:17:34.849951  8926 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:34.850672  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:34.826496 12080 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.864600  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.855907  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:34.852649  8214 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:34.854682  8211 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:34.850782 11809 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.866039  8927 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.858839 12159 raft_consensus.cc:3055] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:34.859477 12190 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.833662 12098 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:34.860584  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }.
  Pending config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.805223 12055 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.860383 12147 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:34.861308 12000 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.833510 12105 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:34.862443  8369 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:34.854059 12153 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:34.897746 12153 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.856138  8924 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:34.866704  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:34.898195 12195 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.293s	user 0.003s	sys 0.000s
I20260709 13:17:34.898990  8295 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:34.899147  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.899712  8211 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.900907  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:34.901218 12140 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:34.864562 12001 consensus_meta.cc:287] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.906s	user 0.008s	sys 0.003s
I20260709 13:17:34.901832 12140 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:34.902014 12001 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.902936 12140 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.874195  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:34.872583  8921 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.860026 12079 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:34.824368 12076 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:34.880141  8288 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:34.879917  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:34.857394 12196 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:34.886503  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:34.978257  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:34.978807  8288 raft_consensus.cc:2376] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10. Re-sending same reply.
I20260709 13:17:34.978909  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:34.894670  8368 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:34.894976  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.979625  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:34.980130  8294 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:34.887069  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:34.978250  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:34.875088  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:34.976677  8361 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.850015 12054 consensus_queue.cc:1059] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:17:34.873706 12159 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:34.982496  8921 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.839073 11867 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:34.876360 12063 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:17:34.921979 12058 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.876601 12190 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:34.838474 12193 consensus_queue.cc:1059] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:17:34.984680 12202 log.cc:927] Time spent T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.147s	user 0.004s	sys 0.000s
I20260709 13:17:34.971408  8211 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:34.885923 12098 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.878705 12003 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:34.903990 12001 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:35.098467  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.068467  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.108208  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.936820  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.109664  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.990692 12140 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.971903  8892 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:34.974411  8215 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:34.975558  8927 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:17:34.974874 12079 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:34.901453  8369 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:35.118628  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:35.119371  8215 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:34.975916  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 101780us
I20260709 13:17:34.981441  8920 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:34.985016  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:34.893788 12147 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:35.137051 12147 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:35.139598  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:34.989931 12145 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:34.997707 12055 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:34.983930 12194 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.385s	user 0.007s	sys 0.000s
I20260709 13:17:34.972548 12148 raft_consensus.cc:3055] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.977628 12012 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:35.149014 12012 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.149554 12012 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.970265  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:35.152812  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 182618us
I20260709 13:17:35.154075  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:35.155131  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:34.997943  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:35.157289 12001 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:35.157943 12145 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:35.158241 12001 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:35.158648 12145 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:35.158993 12001 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:34.977857 12196 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:35.110322  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.190225  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.973416  8923 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 5. Current term is 7. Ops: []
I20260709 13:17:35.111270  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:35.113085  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1640) took 1034 ms. Trace:
I20260709 13:17:35.192162  8293 rpcz_store.cc:276] 0709 13:17:34.078270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.078407 (+   137us) service_pool.cc:224] Handling call
0709 13:17:34.078723 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.079137 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:34.090328 (+ 11191us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.700081 (+609753us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b18003ee8a0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb123a 00007f31fd41ba2a
0709 13:17:34.803943 (+103862us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.805774 (+  1831us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.805917 (+   143us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:34.805947 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.806005 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.112819 (+306814us) raft_consensus.cc:1685] finished
0709 13:17:35.112903 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.113026 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6304,"prepare.queue_time_us":13928,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1337,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":11467,"spinlock_wait_cycles":21209856,"thread_start_us":103605,"threads_started":1,"wal-append.queue_time_us":719479}
I20260709 13:17:35.195183  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:35.129935  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:34.993902 11867 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:35.197763  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:35.159899 12145 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:35.163107 12148 raft_consensus.cc:740] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:35.253593  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:35.256738  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.283392  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1790) took 1394 ms (client timeout 1513 ms). Trace:
W20260709 13:17:35.284139  8212 rpcz_store.cc:269] 0709 13:17:33.888592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.889540 (+   948us) service_pool.cc:224] Handling call
0709 13:17:35.209957 (+1320417us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b5400379bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:35.283295 (+ 73338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771444480}
I20260709 13:17:35.307269  8927 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:35.338949  8215 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
W20260709 13:17:35.359591  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.931350  8293 consensus_meta.cc:287] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.000s
I20260709 13:17:35.201594 12196 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:36.026041  8293 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:36.051962  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2240) took 1165 ms. Trace:
I20260709 13:17:36.052341  8293 rpcz_store.cc:276] 0709 13:17:34.886703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.197496 (+310793us) service_pool.cc:224] Handling call
0709 13:17:36.051895 (+854399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:35.463738 12190 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.053566  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.053766 12190 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:36.054354  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2236) took 1168 ms. Trace:
I20260709 13:17:36.054735  8293 rpcz_store.cc:276] 0709 13:17:34.885735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.053294 (+1167559us) service_pool.cc:224] Handling call
0709 13:17:36.054294 (+  1000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.055682  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.025946  8217 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:35.879689  8288 consensus_meta.cc:287] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.000s
I20260709 13:17:36.056818  8288 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
W20260709 13:17:36.057757  8258 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.008s	sys 0.008s
W20260709 13:17:36.058346  8258 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.008s	sys 0.008s
I20260709 13:17:36.057830  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2246) took 1069 ms. Trace:
W20260709 13:17:36.058751  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 740108us
W20260709 13:17:36.026722  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 1.05476e+06us
I20260709 13:17:36.058970  8288 rpcz_store.cc:276] 0709 13:17:34.988683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.253262 (+264579us) service_pool.cc:224] Handling call
0709 13:17:36.057769 (+804507us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:36.050642  8334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.009s	sys 0.004s
W20260709 13:17:36.062922  8334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.009s	sys 0.004s
W20260709 13:17:36.063789  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.063410  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:36.064311  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.064640  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.064858  8288 raft_consensus.cc:2393] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:36.065557  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2245) took 1088 ms. Trace:
I20260709 13:17:36.066061  8288 rpcz_store.cc:276] 0709 13:17:34.976910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.062994 (+1086084us) service_pool.cc:224] Handling call
0709 13:17:36.065479 (+  2485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.067328  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.068382  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2247) took 1067 ms. Trace:
I20260709 13:17:36.068893  8288 rpcz_store.cc:276] 0709 13:17:35.000756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.066997 (+1066241us) service_pool.cc:224] Handling call
0709 13:17:36.068301 (+  1304us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:35.844009  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.002s	sys 0.001s
W20260709 13:17:35.499006  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.070204  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.005s	sys 0.001s
W20260709 13:17:36.070627  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.070741  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 939823us
W20260709 13:17:36.028132 12140 consensus_meta.cc:287] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.866s	user 0.007s	sys 0.004s
I20260709 13:17:35.379670  8215 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:36.072019  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1561) took 1240 ms. Trace:
W20260709 13:17:36.004027 11867 consensus_meta.cc:287] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.002s
W20260709 13:17:35.741436 11997 consensus_meta.cc:287] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.410s	user 0.012s	sys 0.000s
W20260709 13:17:35.736727 12139 consensus_meta.cc:287] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.538s	user 0.008s	sys 0.006s
W20260709 13:17:35.855259  8335 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.002s	sys 0.005s
W20260709 13:17:36.086422  8335 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.004s	sys 0.006s
W20260709 13:17:35.746300 12080 consensus_meta.cc:287] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.861s	user 0.008s	sys 0.000s
W20260709 13:17:35.748728 12207 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 13:17:35.524969  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.855445 11897 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.006s	sys 0.002s
W20260709 13:17:35.855554 12076 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.004s	sys 0.003s
I20260709 13:17:35.466476 12159 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:35.637253 12000 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:35.939606 12193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.000s	sys 0.008s
W20260709 13:17:35.840765  8369 consensus_meta.cc:287] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
W20260709 13:17:36.071130  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.072381  8215 rpcz_store.cc:276] 0709 13:17:34.831419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.339772 (+508353us) service_pool.cc:224] Handling call
0709 13:17:35.379336 (+ 39564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.071763 (+692427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.071971 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.094291  8369 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
W20260709 13:17:36.094901  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.095019  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2528) took 1208 ms. Trace:
W20260709 13:17:35.740767 12124 consensus_meta.cc:287] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.016s	user 0.008s	sys 0.003s
W20260709 13:17:35.939230 12098 consensus_meta.cc:287] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.000s
W20260709 13:17:35.986356 12055 consensus_meta.cc:287] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.839s	user 0.006s	sys 0.006s
W20260709 13:17:36.029397 12012 consensus_meta.cc:287] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.879s	user 0.004s	sys 0.011s
I20260709 13:17:36.074430  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:35.655436 12148 consensus_queue.cc:260] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:35.996905 11857 consensus_meta.cc:287] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 1.190s	user 0.008s	sys 0.002s
W20260709 13:17:35.939381 12153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.008s	sys 0.000s
I20260709 13:17:36.086170  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:35.629103  8183 leader_election.cc:336] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.505s (SENT)
W20260709 13:17:36.088089  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.092852  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.095585  8369 rpcz_store.cc:276] 0709 13:17:34.886352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.893629 (+  7277us) service_pool.cc:224] Handling call
0709 13:17:36.094959 (+1201330us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:36.094046 12193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.000s	sys 0.010s
I20260709 13:17:36.105882  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 817) took 1310 ms. Trace:
I20260709 13:17:36.098753  8220 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:35.552222 12079 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.089030 12140 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.557698 12001 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:36.093212 11897 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.006s	sys 0.004s
W20260709 13:17:36.092743 12076 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.005s	sys 0.005s
I20260709 13:17:36.097172  8215 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:36.118438  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1797) took 1283 ms. Trace:
I20260709 13:17:36.118922  8215 rpcz_store.cc:276] 0709 13:17:34.835348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.095143 (+1259795us) service_pool.cc:224] Handling call
0709 13:17:36.095415 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.118070 (+ 22655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.118361 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.121186  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1798) took 1285 ms. Trace:
I20260709 13:17:36.121672  8215 rpcz_store.cc:276] 0709 13:17:34.835577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.120069 (+1284492us) service_pool.cc:224] Handling call
0709 13:17:36.120505 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.120751 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.120791 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.120852 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:36.120908 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.120987 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.121117 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:36.126982  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 497878us
I20260709 13:17:36.134615  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 576) took 2351 ms. Trace:
I20260709 13:17:36.098235 11697 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.103502  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2243) took 1215 ms. Trace:
I20260709 13:17:35.741990 12063 consensus_queue.cc:1059] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.347s
I20260709 13:17:36.091693 11997 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:36.106504  8922 rpcz_store.cc:276] 0709 13:17:34.795170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.795275 (+   105us) service_pool.cc:224] Handling call
0709 13:17:34.795548 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.795898 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:34.795930 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.798097 (+  2167us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.979921 (+181824us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:34.979960 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.980030 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.105608 (+1125578us) raft_consensus.cc:1685] finished
0709 13:17:36.105637 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.105808 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":622,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6278,"thread_start_us":154964,"threads_started":1,"wal-append.queue_time_us":200874}
W20260709 13:17:36.101061 12153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.009s	sys 0.000s
I20260709 13:17:36.090930 12139 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.096305 11867 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:36.102852 12124 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.136107  8288 rpcz_store.cc:276] 0709 13:17:34.887711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.092561 (+1204850us) service_pool.cc:224] Handling call
0709 13:17:36.103429 (+ 10868us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.135138  8291 rpcz_store.cc:276] 0709 13:17:33.758562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.758673 (+   111us) service_pool.cc:224] Handling call
0709 13:17:33.768202 (+  9529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.894729 (+126527us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:33.914266 (+ 19537us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.052769 (+138503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:34.052818 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:34.052858 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.110219 (+2057361us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54002e59d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:36.110268 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.110383 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20073,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":10053,"raft.queue_time_us":87,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":10081,"spinlock_wait_cycles":290541696,"thread_start_us":138157,"threads_started":1,"wal-append.queue_time_us":245675,"wal-append.run_cpu_time_us":1132,"wal-append.run_wall_time_us":1027898}
I20260709 13:17:36.096349 12000 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:36.139360  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 65069.9us
W20260709 13:17:36.141014  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 54935.8us
I20260709 13:17:36.092952 12080 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.100924 12215 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:36.106935 12199 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:36.150833 12192 log.cc:927] Time spent T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.538s	user 0.010s	sys 0.004s
I20260709 13:17:36.145117 12193 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:36.151157 12199 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:36.151825 12193 raft_consensus.cc:697] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:36.152503  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 724) took 2542 ms. Trace:
I20260709 13:17:36.153046 12193 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:36.153033  8925 rpcz_store.cc:276] 0709 13:17:33.610457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.610577 (+   120us) service_pool.cc:224] Handling call
0709 13:17:33.610938 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:33.871622 (+260684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.871653 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:33.881747 (+ 10094us) log.cc:844] Serialized 52 byte log entry
0709 13:17:34.521612 (+639865us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:34.521673 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.521790 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.136730 (+1614940us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:36.152114 (+ 15384us) raft_consensus.cc:1685] finished
0709 13:17:36.152137 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.152400 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37260,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10071,"spinlock_wait_cycles":206165120,"thread_start_us":828364,"threads_started":2,"wal-append.queue_time_us":698612}
I20260709 13:17:36.135637 12216 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:36.137322  8183 leader_election.cc:336] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.577s (SENT)
I20260709 13:17:36.102481 12098 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.146751  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.175196  8291 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:36.147006 12063 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:36.149667 12080 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:36.119215 12140 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.218166 12219 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.102442 11857 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:36.219485 12208 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:36.219113 12219 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.220580 11857 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:36.220697  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1792) took 1394 ms. Trace:
I20260709 13:17:36.140545 12159 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.221705 12219 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:36.165277  8293 raft_consensus.cc:2368] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10.
I20260709 13:17:36.172587 12223 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.182947  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:36.144876  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.223551  8363 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.179939  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:36.224637  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44837.1us
I20260709 13:17:36.221161  8219 rpcz_store.cc:276] 0709 13:17:34.826571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.826707 (+   136us) service_pool.cc:224] Handling call
0709 13:17:34.828130 (+  1423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.828416 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.828443 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.828912 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.108450 (+279538us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:35.108490 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.108582 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.220471 (+1111889us) raft_consensus.cc:1685] finished
0709 13:17:36.220491 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.220634 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22371,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7949,"thread_start_us":279220,"threads_started":1,"wal-append.queue_time_us":1265180}
I20260709 13:17:36.222689 12223 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:36.214145  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 66952.8us
I20260709 13:17:36.233470  8361 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:36.218262 12140 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:36.223897  8288 raft_consensus.cc:2410] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:36.237370  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2238) took 1351 ms. Trace:
I20260709 13:17:36.237818  8288 rpcz_store.cc:276] 0709 13:17:34.886218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.144555 (+1258337us) service_pool.cc:224] Handling call
0709 13:17:36.237297 (+ 92742us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:36.184382  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 47927.6us
I20260709 13:17:36.104485 12012 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:36.232419  8219 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:36.214619 12224 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:36.239264  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.246968  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.247135  8183 leader_election.cc:336] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.630s (SENT)
I20260709 13:17:36.242933  8291 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:36.244831  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1564) took 1400 ms. Trace:
I20260709 13:17:36.247908  8219 rpcz_store.cc:276] 0709 13:17:34.844908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.226054 (+1381146us) service_pool.cc:224] Handling call
0709 13:17:36.232154 (+  6100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.244490 (+ 12336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.244763 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.250130  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.247246  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:36.247430  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.141489 11697 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:36.253894  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.255072  8363 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:36.256170  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:36.257151  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:36.257555  8889 connection.cc:256] RPC call timeout handler was delayed by -2.1291086839999025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:17:36.257928  8889 connection.cc:256] RPC call timeout handler was delayed by -2.1084653440000238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:17:36.258251  8889 connection.cc:256] RPC call timeout handler was delayed by -1.975208683999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
I20260709 13:17:36.204622 12063 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:36.260157  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:36.156409 12124 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.260708  8288 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:36.234859 12219 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:36.269678  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.277088  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.277791  8291 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.280680  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.288884  8219 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:36.150837 12215 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.156258 12216 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:36.259080  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1794) took 1432 ms. Trace:
I20260709 13:17:36.296176  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2244) took 1408 ms. Trace:
I20260709 13:17:36.300753  8288 rpcz_store.cc:276] 0709 13:17:34.887985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.280389 (+1392404us) service_pool.cc:224] Handling call
0709 13:17:36.296115 (+ 15726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.301640  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.302160  8288 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:36.304380  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 69897.7us
W20260709 13:17:36.294646  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 47486.7us
I20260709 13:17:36.310171  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:36.305054  8211 rpcz_store.cc:276] 0709 13:17:34.827103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.156796 (+329693us) service_pool.cc:224] Handling call
0709 13:17:35.157241 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.157657 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.157697 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.035041 (+877344us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.106099 (+ 71058us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:36.140662 (+ 34563us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.258115 (+117453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.258400 (+   285us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.258447 (+    47us) raft_consensus.cc:1685] finished
0709 13:17:36.258462 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.259024 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34299,"prepare.queue_time_us":30580,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":35,"raft.queue_time_us":3825,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":19983,"thread_start_us":187615,"threads_started":2,"wal-append.queue_time_us":108976}
W20260709 13:17:36.316728  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 90334.4us
I20260709 13:17:36.277172 12080 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:36.318015  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1800) took 1464 ms. Trace:
I20260709 13:17:36.321137  8211 rpcz_store.cc:276] 0709 13:17:34.853926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.311795 (+1457869us) service_pool.cc:224] Handling call
0709 13:17:36.317419 (+  5624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.317621 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.317656 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.317714 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:36.317760 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.317829 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.317949 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.329552  8288 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:36.331372  8291 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:36.288980 11867 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:36.335179  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.298681 12213 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:36.342310  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.344738  8291 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:36.308883 12076 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:17:36.384014  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 74520.8us
I20260709 13:17:36.409510 12218 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:36.343930 12213 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.408167 12241 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:17:36.421689  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.425982  8291 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
W20260709 13:17:36.422879  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 112726us
I20260709 13:17:36.344352 12212 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.429256  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:36.336192 12080 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:36.440660  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 90028.1us
I20260709 13:17:36.310525 12063 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.410032 12215 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:36.338497 11867 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.452191  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.460857  8291 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:36.454005  8183 leader_election.cc:336] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.885s (SENT)
I20260709 13:17:36.351023  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.425433 11808 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:36.341499 12226 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:17:36.419515 12235 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:36.457585  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 142482us
W20260709 13:17:36.449177 12233 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 13:17:36.465119  8889 connection.cc:256] RPC call timeout handler was delayed by -1.9050086839997675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 13:17:36.437482 12139 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:36.465734  8183 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:36.469250  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.464183  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37894 (request call id 16) took 1567 ms. Trace:
I20260709 13:17:36.474151 12235 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.456549 12076 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:36.486264 12216 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:36.486588 12076 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:36.486959 12216 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:36.487362 12216 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.487500 12076 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.489034 12076 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.489682 12147 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.491034  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2237) took 1605 ms. Trace:
I20260709 13:17:36.491441  8293 rpcz_store.cc:276] 0709 13:17:34.885973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.055429 (+1169456us) service_pool.cc:224] Handling call
0709 13:17:36.490838 (+435409us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002e63d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:36.490975 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250234624}
I20260709 13:17:36.492549  8291 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:36.492630  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:36.449779 12098 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:36.476291  8889 connection.cc:256] RPC call timeout handler was delayed by -1.7158337479997954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 13:17:36.477901  8211 rpcz_store.cc:276] 0709 13:17:34.896854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.450338 (+1553484us) service_pool.cc:224] Handling call
0709 13:17:36.464104 (+ 13766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.481073 12226 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:36.481263 12124 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:36.481529 11697 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:36.460218 12229 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:36.483408 12222 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:17:36.467222 12012 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:36.494386  8288 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:36.495436 12242 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:36.432107 12218 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:36.445498 12212 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:36.495731  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.909124  8293 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:36.910529  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 481326us
W20260709 13:17:36.666890  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 348912us
I20260709 13:17:36.559064  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.912091  8291 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:36.912931  8889 connection.cc:256] RPC call timeout handler was delayed by -1.5259961130000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:17:36.909144  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:36.913323  8889 connection.cc:256] RPC call timeout handler was delayed by -1.4440961130001142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:17:36.913838  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1652) took 2742 ms. Trace:
W20260709 13:17:36.914013  8889 connection.cc:256] RPC call timeout handler was delayed by -1.1707764390000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:17:36.914512  8889 connection.cc:256] RPC call timeout handler was delayed by -1.1707764390000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:17:36.914968  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 527) took 2215 ms (client timeout 1863 ms). Trace:
I20260709 13:17:36.914352  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:36.915745  8288 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:36.915491  8220 rpcz_store.cc:269] 0709 13:17:34.699873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.718924 (+ 19051us) service_pool.cc:224] Handling call
0709 13:17:36.914762 (+2195838us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002f4c54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:36.914864 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3171337088}
I20260709 13:17:36.595218  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2531) took 1472 ms. Trace:
I20260709 13:17:36.916810  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:36.501060  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.917747  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.918469  8364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59420 (request call id 518) took 2243 ms (client timeout 1776 ms). Trace:
I20260709 13:17:36.916752  8369 rpcz_store.cc:276] 0709 13:17:35.123180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.102229 (+979049us) service_pool.cc:224] Handling call
0709 13:17:36.102611 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.102860 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:36.240001 (+137141us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.580569 (+340568us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.594781 (+ 14212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.594892 (+   111us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:36.594939 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.595008 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.595147 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18269,"prepare.queue_time_us":194573,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":7097,"raft.queue_time_us":50125,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":41972,"thread_start_us":434858,"threads_started":3,"wal-append.queue_time_us":324172}
W20260709 13:17:36.918845  8364 rpcz_store.cc:269] 0709 13:17:34.675319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.676850 (+  1531us) service_pool.cc:224] Handling call
0709 13:17:36.918268 (+2241418us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b54001dfe54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:36.918403 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77617024}
W20260709 13:17:36.645226  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.911834  8261 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:36.921437  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.920279  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.922816  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1542) took 2846 ms (client timeout 1508 ms). Trace:
I20260709 13:17:36.487814 12216 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.923341  8220 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:36.998775  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 544714us
I20260709 13:17:37.000826  8892 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:36.923015  8261 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:37.002321  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:37.005219  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:37.021616  8220 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.587719  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:36.922914  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.023571  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.914230  8289 rpcz_store.cc:276] 0709 13:17:34.171802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.788534 (+616732us) service_pool.cc:224] Handling call
0709 13:17:34.797401 (+  8867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.823042 (+ 25641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.913632 (+2090590us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b5400002dd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:36.913791 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57688832}
I20260709 13:17:36.999262  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1560) took 2168 ms. Trace:
I20260709 13:17:37.025736  8212 rpcz_store.cc:276] 0709 13:17:34.830833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.285423 (+454590us) service_pool.cc:224] Handling call
0709 13:17:35.285838 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.347159 (+ 61321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.347188 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.036122 (+688934us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.106601 (+ 70479us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:36.106638 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.106701 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.998992 (+892291us) raft_consensus.cc:1685] finished
0709 13:17:36.999014 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.999186 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60850,"raft.queue_time_us":174978,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":46385,"thread_start_us":70043,"threads_started":1,"wal-append.queue_time_us":197915}
W20260709 13:17:37.005852  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.006426  8183 leader_election.cc:336] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.162s (SENT)
I20260709 13:17:37.029505  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:36.923352  8218 rpcz_store.cc:269] 0709 13:17:34.076228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.077090 (+   862us) service_pool.cc:224] Handling call
0709 13:17:36.922648 (+2845558us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b54001d5454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:36.922745 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17267584}
W20260709 13:17:37.013200  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 90246.4us
I20260709 13:17:37.016398  8288 raft_consensus.cc:2410] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:37.020707  8293 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:36.904109 12247 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:37.044230  8220 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:37.045579  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:36.666038 12190 consensus_meta.cc:287] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.612s	user 0.008s	sys 0.000s
W20260709 13:17:36.514354 12228 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:17:36.907122 12159 consensus_meta.cc:287] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.686s	user 0.005s	sys 0.003s
W20260709 13:17:36.662475 12196 consensus_meta.cc:287] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.005s
I20260709 13:17:37.055130  8291 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:36.657406 11867 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:37.058281  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 51875.2us
I20260709 13:17:37.087136  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:36.905227 12080 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:36.657877 12243 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:36.564661 12223 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:37.062362  8289 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:37.094134  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2239) took 2207 ms. Trace:
I20260709 13:17:37.056316 12242 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:37.001466 12193 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.084414  8293 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:37.085942  8288 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:37.087954  8183 leader_election.cc:336] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.168s (SENT)
I20260709 13:17:37.099208  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.099781  8293 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:37.100786  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2242) took 2213 ms. Trace:
I20260709 13:17:37.059068 12248 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.062693  8925 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:37.055871 12124 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:37.094776  8289 rpcz_store.cc:276] 0709 13:17:34.886451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.057987 (+2171536us) service_pool.cc:224] Handling call
0709 13:17:37.061970 (+  3983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.093609 (+ 31639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.094012 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:37.066506  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 478814us
I20260709 13:17:37.056031 12230 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:37.102190  8291 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:36.999461 12260 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:17:37.102509  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.101195  8293 rpcz_store.cc:276] 0709 13:17:34.887438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.099068 (+2211630us) service_pool.cc:224] Handling call
0709 13:17:37.099488 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.100466 (+   978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.100720 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.018666 12229 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:37.088899 12244 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.011s	sys 0.035s
I20260709 13:17:37.001271 12226 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.137879  8289 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:17:37.090160 11617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.047s	sys 0.090s
I20260709 13:17:37.091885 12012 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:37.037043 12241 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:17:37.093672 12235 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:37.064316  8363 raft_consensus.cc:2410] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:37.121554  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2241) took 2234 ms. Trace:
I20260709 13:17:37.122550  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:37.123154  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:37.174834  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.155615  8258 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.182310  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:37.183040  8218 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:37.184119  8291 rpcz_store.cc:276] 0709 13:17:34.887133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.090270 (+2203137us) service_pool.cc:224] Handling call
0709 13:17:37.102030 (+ 11760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.121294 (+ 19264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.121502 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.124538  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:37.113418 11697 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:37.129256  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:37.197613  8211 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:37.193497  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1793) took 2366 ms. Trace:
I20260709 13:17:37.199302  8213 rpcz_store.cc:276] 0709 13:17:34.826870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.140902 (+314032us) service_pool.cc:224] Handling call
0709 13:17:35.141280 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.141692 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.141733 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.062661 (+920928us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.270758 (+208097us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:36.343017 (+ 72259us) log.cc:844] Serialized 14 byte log entry
0709 13:17:36.350680 (+  7663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.350764 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.193241 (+842477us) raft_consensus.cc:1685] finished
0709 13:17:37.193270 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.193428 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46550,"prepare.queue_time_us":63354,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":121169,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":14893,"thread_start_us":246550,"threads_started":2,"wal-append.queue_time_us":347799}
I20260709 13:17:37.059252 12251 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:37.130766  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:37.133714  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:37.201730  8925 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:37.137435 12243 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:37.138713  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2250) took 1093 ms. Trace:
W20260709 13:17:37.172506 11617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.048s	sys 0.091s
I20260709 13:17:37.116189 12248 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.204957  8289 rpcz_store.cc:276] 0709 13:17:36.045725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.116950 (+1071225us) service_pool.cc:224] Handling call
0709 13:17:37.137595 (+ 20645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.138438 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.138651 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.141579 12053 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:37.141913 12224 consensus_meta.cc:287] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.878s	user 0.003s	sys 0.005s
I20260709 13:17:37.114748 12213 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:37.145288  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet d81288332c1b4610a2fe2b09dba77503: Illegal state: Replica 9e95b04d03d241329435b6d08dd1f236 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:37.226361  8289 raft_consensus.cc:1240] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:37.227053  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2255) took 1135 ms. Trace:
I20260709 13:17:37.227404  8289 rpcz_store.cc:276] 0709 13:17:36.091422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.205870 (+1114448us) service_pool.cc:224] Handling call
0709 13:17:37.226102 (+ 20232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.226802 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.227001 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:37.146816  8183 leader_election.cc:336] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.295s (SENT)
W20260709 13:17:37.132762 12244 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.011s	sys 0.036s
I20260709 13:17:37.121330 12230 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:37.106016 12242 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:17:37.145781 12147 consensus_meta.cc:287] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.001s
I20260709 13:17:37.185814  8212 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:37.105063 12193 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:37.202013  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 68392.3us
I20260709 13:17:37.090714 12196 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.206720  8927 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:37.224915 12224 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.208243 12053 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:37.236814  8218 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 7.
W20260709 13:17:37.237699  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 90911.2us
W20260709 13:17:37.241113  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 209054us
I20260709 13:17:37.209142 12256 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:37.238549 12230 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:37.206342 12012 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:37.247859  8289 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:37.249024  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.267198  8920 raft_consensus.cc:2393] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:37.267251  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2258) took 1125 ms. Trace:
I20260709 13:17:37.267768  8289 rpcz_store.cc:276] 0709 13:17:36.142183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.234222 (+1092039us) service_pool.cc:224] Handling call
0709 13:17:37.247459 (+ 13237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.266908 (+ 19449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.267181 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.234756  8925 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6.
W20260709 13:17:37.250131  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 327632us
I20260709 13:17:37.150208 12225 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
W20260709 13:17:37.258458  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.259629  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.263386  8367 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:37.262163 12073 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.262744  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.273387  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.258366 12263 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.275193 12257 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:17:37.275457 12053 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.208715 12243 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:37.283106 12187 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 2.644s	user 0.019s	sys 0.016s
I20260709 13:17:37.275161 12225 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:37.285564  8921 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:37.271435  8927 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:37.287247  8920 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:37.289947  8183 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.290867  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.262863 12218 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:37.297473  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 573) took 3539 ms. Trace:
I20260709 13:17:37.308174  8286 rpcz_store.cc:276] 0709 13:17:33.757672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.757798 (+   126us) service_pool.cc:224] Handling call
0709 13:17:33.758111 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.045469 (+287358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.294458 (+3248989us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400426b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:37.297414 (+  2956us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529248128}
I20260709 13:17:37.309302  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:37.309821  8286 raft_consensus.cc:2376] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11. Re-sending same reply.
I20260709 13:17:37.294322 11697 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:37.290786 12073 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.306236 11617 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:37.312506 12226 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:37.285717 12212 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:37.313575 12225 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:37.314395 12073 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:37.314486 12225 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.302071  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:37.310571  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:37.266253 12256 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:37.310611  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.319877  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:37.323758  8286 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:37.321678  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 166135us
I20260709 13:17:37.319118  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.327241  8889 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:37.331828  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.337299  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.341249  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:37.332979 11809 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:37.342195 12267 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:37.342959 12264 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:37.335047 12124 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:17:37.344460 12193 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:37.346843  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1807) took 1100 ms. Trace:
I20260709 13:17:37.347621  8291 raft_consensus.cc:1240] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:37.353113  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 513) took 2724 ms. Trace:
I20260709 13:17:37.355899  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:37.356259 12005 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:37.356752  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:37.357359  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1956) took 2490 ms. Trace:
I20260709 13:17:37.322301 12226 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.351946  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1646) took 3260 ms. Trace:
I20260709 13:17:37.332513 11697 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:37.331991 12235 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:37.361917  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.296353 12263 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.364166  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:37.514182  8925 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:37.513789  8295 rpcz_store.cc:276] 0709 13:17:34.091785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.612593 (+520808us) service_pool.cc:224] Handling call
0709 13:17:34.612904 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.899389 (+286485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.351672 (+2452283us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b5400389854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:37.351877 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657482112}
I20260709 13:17:37.514640  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:37.515062  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:37.515197  8926 raft_consensus.cc:2376] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6. Re-sending same reply.
I20260709 13:17:37.515751  8925 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:37.516129  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:37.417750  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.517498  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.542011  8367 rpcz_store.cc:276] 0709 13:17:34.867412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.867529 (+   117us) service_pool.cc:224] Handling call
0709 13:17:34.867737 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.271407 (+2403670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.357166 (+ 85759us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b54000f4454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:37.357308 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5508841344}
W20260709 13:17:37.542613  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.376210  8921 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:17:37.543780  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:37.543888  8925 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:37.515240  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.545337  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:37.452248  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 200279us
I20260709 13:17:37.546193  8219 rpcz_store.cc:276] 0709 13:17:36.246399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.248943 (+  2544us) service_pool.cc:224] Handling call
0709 13:17:37.346629 (+1097686us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b54000375d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:37.346767 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59048832}
W20260709 13:17:37.378639  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.549571  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.375823  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.551394  8289 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 8: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:37.518296  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.554126  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.554913  8295 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
W20260709 13:17:37.555576  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.555979  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:37.547816  8217 rpcz_store.cc:276] 0709 13:17:34.628815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.628930 (+   115us) service_pool.cc:224] Handling call
0709 13:17:36.025744 (+1396814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.061857 (+ 36113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.352875 (+1291018us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400379bd0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:37.353044 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335790336}
W20260709 13:17:37.556418  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.338928 12053 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:37.562602  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:37.562999  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:37.545153  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.563581  8295 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.564118  8925 raft_consensus.cc:2410] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:17:37.563347  8367 raft_consensus.cc:2376] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7. Re-sending same reply.
I20260709 13:17:37.565207  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:37.565650  8367 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:37.566224  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:37.556890  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.567034  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.513514 11697 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:37.562269  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.567876  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.568017  8927 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:37.568691  8926 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
W20260709 13:17:37.496327 12265 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:17:37.571251  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:37.483862 12224 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:37.577702  8921 raft_consensus.cc:2393] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:37.496917 12266 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:37.430048 11617 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:37.582912  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.584566  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 246605us
I20260709 13:17:37.581091  8927 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:37.300287 12242 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.634399  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1660) took 2901 ms. Trace:
I20260709 13:17:37.634508  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2527) took 2748 ms. Trace:
I20260709 13:17:37.634965  8361 rpcz_store.cc:276] 0709 13:17:34.886060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.991362 (+105302us) service_pool.cc:224] Handling call
0709 13:17:35.109950 (+118588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.233943 (+1123993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.634262 (+1400319us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400355f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:37.634449 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583333632}
W20260709 13:17:37.588416  8892 connection.cc:256] RPC call timeout handler was delayed by -1.4019099009999536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 13:17:37.376112 12012 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.593811  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:37.581668  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 248789us
I20260709 13:17:37.639546  8289 raft_consensus.cc:2376] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11. Re-sending same reply.
I20260709 13:17:37.570132 11697 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.571874 12264 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.554217 11857 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:37.637149  8921 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:37.641491  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:37.637765  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.572841 12267 raft_consensus.cc:2764] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:37.634824  8287 rpcz_store.cc:276] 0709 13:17:34.732699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.805471 (+ 72772us) service_pool.cc:224] Handling call
0709 13:17:34.805720 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.834197 (+ 28477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.634158 (+2799961us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b54001284d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:37.634338 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36409216}
I20260709 13:17:37.642472  8925 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:37.643359  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.643873  8925 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:37.641922  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:37.642838  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.644764  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.645438  8925 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:37.645076  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.645155  8287 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:37.586264 12080 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:37.572703 12218 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:37.586222 12224 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:37.586068 12147 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:37.596378 12083 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:37.649072  8258 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:37.665014  8258 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:37.653482  8295 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:37.649864  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:37.667361  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.553941 12230 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.662815  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1958) took 1487 ms. Trace:
I20260709 13:17:37.668247  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:37.657843  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.668282  8218 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:37.652360 11617 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:37.718171  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:37.725054  8289 raft_consensus.cc:2376] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12. Re-sending same reply.
I20260709 13:17:37.670753  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:37.730156  8219 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:37.716719  8369 rpcz_store.cc:276] 0709 13:17:36.175581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.919375 (+743794us) service_pool.cc:224] Handling call
0709 13:17:37.047499 (+128124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.047979 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.048021 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.048614 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.243412 (+194798us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:37.550312 (+306900us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.550638 (+   326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.550733 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.662577 (+111844us) raft_consensus.cc:1685] finished
0709 13:17:37.662597 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.662748 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":795,"prepare.queue_time_us":342294,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3293,"raft.queue_time_us":14914,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":34583,"thread_start_us":430715,"threads_started":2,"wal-append.queue_time_us":234253}
I20260709 13:17:37.750006  8217 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:37.748673  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 98850.9us
I20260709 13:17:37.716334  8926 raft_consensus.cc:2376] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7. Re-sending same reply.
I20260709 13:17:37.752135  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:37.756922  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1547) took 3667 ms (client timeout 2101 ms). Trace:
I20260709 13:17:37.671957  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:37.652024 12235 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:37.759682  8216 rpcz_store.cc:269] 0709 13:17:34.099565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.104616 (+  5051us) service_pool.cc:224] Handling call
0709 13:17:37.756442 (+3651826us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400198a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:37.756839 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045410048}
I20260709 13:17:37.663015 12218 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.715579 12244 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:37.669745 12248 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:17:37.658041 12213 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:17:37.715751 12196 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:37.653055 12264 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:37.632875 12266 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.781649 12230 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:37.660688 12080 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.647746 11857 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.724651 11617 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:37.784195  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 136284us
I20260709 13:17:37.803933  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.717856 12263 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:37.663622 12224 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.570372 12256 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.760455 12268 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:37.793836  8217 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:37.797684 12279 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:37.795130  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:37.757311 12278 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:37.767355 12225 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.797484 12216 consensus_meta.cc:287] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.749s	user 0.005s	sys 0.007s
I20260709 13:17:37.784139 12281 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:37.805905  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.792466 12243 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:37.794071 12244 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:37.670367 12147 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.815294  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1936) took 3878 ms. Trace:
I20260709 13:17:37.812304 12196 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.819377  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:37.816431 12209 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:37.819075 12216 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.830232  8920 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:37.823247 12144 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:37.830730 12282 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:37.831159 12216 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:37.824620 12280 consensus_queue.cc:1059] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:17:37.832633  8107 maintenance_manager.cc:419] P e8c3cea2f3524d70be8a4a6e5be1c492: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033362
I20260709 13:17:37.814576 12268 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.814541 12278 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.826089  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:37.841732  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.824791  8366 rpcz_store.cc:276] 0709 13:17:33.936488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.048491 (+112003us) service_pool.cc:224] Handling call
0709 13:17:34.050664 (+  2173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.050857 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:34.072483 (+ 21626us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.282396 (+3209913us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:37.757063 (+474667us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b1800384340. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fcfb94bc 00007f31fa30748b 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb123a
0709 13:17:37.814772 (+ 57709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:37.814830 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:37.814881 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.814965 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.815233 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22007,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":40924,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3134,"spinlock_wait_cycles":173473408,"thread_start_us":584312,"threads_started":2,"wal-append.queue_time_us":529283}
I20260709 13:17:37.828778 12283 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:37.828836 12209 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.829694 12244 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.825049 12281 raft_consensus.cc:697] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:37.832643 12280 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.816998 12279 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.817471 12225 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.828864 12243 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:37.840713 12268 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:37.848749 12278 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:37.849846 12276 log.cc:927] Time spent T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:17:37.824375 11617 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.810051 12235 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.842819  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:37.872874  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 120832us
W20260709 13:17:37.877139  8290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 581) took 4028 ms (client timeout 1500 ms). Trace:
W20260709 13:17:37.883420  8290 rpcz_store.cc:269] 0709 13:17:33.848819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.851332 (+  2513us) service_pool.cc:224] Handling call
0709 13:17:37.876874 (+4025542us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b540005df54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:37.877049 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804564224}
I20260709 13:17:37.884634 12284 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:37.885128  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:37.885963 12196 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:37.878325  8293 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:37.859745 12283 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.838729 12266 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:37.886325  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:37.863292 12014 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:37.898512  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 55755.1us
I20260709 13:17:37.898909 12293 raft_consensus.cc:3055] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:37.899899  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:37.901516 12293 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:37.901773 12287 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.902937 12287 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:37.903461 12287 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.902773 12293 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.900262 11617 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:37.904879 12293 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.900453  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:37.905563  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1662) took 1638 ms. Trace:
I20260709 13:17:37.906240 12284 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:37.906908 12284 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:37.906042  8290 rpcz_store.cc:276] 0709 13:17:36.267215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.884543 (+1617328us) service_pool.cc:224] Handling call
0709 13:17:37.884871 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.885207 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.885237 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.885736 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.901061 (+ 15325us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:37.901099 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.901162 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:37.905342 (+  4180us) raft_consensus.cc:1685] finished
0709 13:17:37.905363 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.905502 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4944,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":111,"thread_start_us":14997,"threads_started":1,"wal-append.queue_time_us":17828}
I20260709 13:17:37.907393 12284 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:37.903836 12287 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.908439  8290 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:37.909089  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1663) took 1641 ms. Trace:
I20260709 13:17:37.909399  8290 rpcz_store.cc:276] 0709 13:17:36.267483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.907938 (+1640455us) service_pool.cc:224] Handling call
0709 13:17:37.908265 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.908844 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.909040 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.910485  8290 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:37.910980  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 583) took 1513 ms. Trace:
I20260709 13:17:37.911266  8290 rpcz_store.cc:276] 0709 13:17:36.397131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.910078 (+1512947us) service_pool.cc:224] Handling call
0709 13:17:37.910337 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.910782 (+   445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.910938 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.912371  8290 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:37.914214  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:37.914558  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:37.914770  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 587) took 1468 ms. Trace:
W20260709 13:17:37.915266  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.912271 12293 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.915530 12284 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.915102  8290 rpcz_store.cc:276] 0709 13:17:36.446347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.911950 (+1465603us) service_pool.cc:224] Handling call
0709 13:17:37.912221 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.914560 (+  2339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.914725 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:37.917244  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:37.917819  8369 raft_consensus.cc:3055] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:37.918201  8369 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:37.918387  8290 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:37.920571  8361 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:17:37.918999  8369 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:37.916229 12293 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:37.921803  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:37.921967  8369 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:37.922489  8361 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:37.923449  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:37.916836  8366 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:37.924024  8361 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:37.924823  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:37.925038 12286 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:37.886351 12196 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:37.933683  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.895720 12283 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.936216  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.938467  8921 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:37.932556 12196 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.941715  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:37.942718 12271 log.cc:927] Time spent T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
W20260709 13:17:37.943797 12269 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:17:37.944305 12274 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:37.935354 12218 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:37.949288  8369 raft_consensus.cc:2410] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:37.949929  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:37.953684  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:37.954559  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:37.931418 12213 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:17:37.918905 12284 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:37.969620  8258 leader_election.cc:336] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.513s (SENT)
I20260709 13:17:37.970163  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:37.953109 12080 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:37.956303 12293 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:37.952539 12216 consensus_queue.cc:1059] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:17:37.999222  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:38.001402  8926 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:37.976677 12264 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:38.003778 12186 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 3.287s	user 0.020s	sys 0.004s
I20260709 13:17:37.999935 12147 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.000116 11697 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.009684 12243 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:37.930935 12281 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.018781 12055 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.020408 12225 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.026396 12287 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.022135 12301 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:17:38.019248 12264 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:38.034571 12280 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.031731 12243 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.042524 12274 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:38.083032  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 182987us
W20260709 13:17:38.089332  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 119559us
I20260709 13:17:38.089507  8364 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:38.091478  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.096692 12055 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.101145 11697 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.108112  8211 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 13:17:38.108071  8367 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 6.
I20260709 13:17:38.110728  8219 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:38.121534  8218 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:17:38.123467  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.124363  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 170751us
W20260709 13:17:38.125892  8258 leader_election.cc:336] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.620s (SENT)
I20260709 13:17:38.126776  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.047981 12274 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.130486 12281 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:38.137230 12264 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.139640 12264 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.140947  8218 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:38.142395 12264 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.142812  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.142397  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:38.173233  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.184036 12053 consensus_meta.cc:287] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.616s	user 0.015s	sys 0.000s
I20260709 13:17:38.035586 12224 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.217056  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.218701  8216 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:38.220888  8369 raft_consensus.cc:2410] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:38.224809  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:38.225760  8926 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:38.203152  8219 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:38.253908 12290 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.259593  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.261009  8216 raft_consensus.cc:2393] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:38.261683  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.262669  8219 raft_consensus.cc:2376] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 6. Re-sending same reply.
I20260709 13:17:38.265520  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.268316  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:38.266193 12308 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:17:38.268620  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.269281  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.273296  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.273578  8219 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:38.272161  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.275473  8219 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:17:38.280138  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 154402us
I20260709 13:17:38.286305  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.287532  8220 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:38.288546  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:38.301831  8293 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2252) took 2255 ms. Trace:
I20260709 13:17:38.302289  8293 rpcz_store.cc:276] 0709 13:17:36.046570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.121645 (+1075075us) service_pool.cc:224] Handling call
0709 13:17:37.878003 (+756358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.894030 (+ 16027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.301403 (+407373us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540005df50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.301601 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1738340736}
I20260709 13:17:38.299078  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.312685  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.313159  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:38.313876  8217 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:38.314502 12216 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:38.314918 12216 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:38.315048  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.315344 12216 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:38.316612  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:38.318301  8218 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.319190 12224 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.315881  8217 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:38.324033  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1799) took 3460 ms. Trace:
I20260709 13:17:38.330832  8220 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:38.332008  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.333340  8368 raft_consensus.cc:2410] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:17:38.341737  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.343657  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.345783  8924 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:38.355904 12089 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.356631 12089 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.357097  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.357969  8287 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:38.359234 12089 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.359227  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:38.361032  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.361537  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.362413  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.362987  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.363955  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.364773  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:38.342516  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 821) took 3517 ms. Trace:
I20260709 13:17:38.366945  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.324703  8215 rpcz_store.cc:276] 0709 13:17:34.835777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.124629 (+1288852us) service_pool.cc:224] Handling call
0709 13:17:36.125008 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.224360 (+ 99352us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:36.245686 (+ 21326us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.285544 (+2039858us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b1800422b60. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fcfb94bc 00007f31fa30748b 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287
0709 13:17:38.285732 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.285812 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:38.285915 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.287899 (+  1984us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b54001d4554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:38.287946 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.295780 (+  7834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1339,"prepare.queue_time_us":21541,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2811,"raft.queue_time_us":74722,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12297,"spinlock_wait_cycles":341930880,"thread_start_us":188826,"threads_started":2,"wal-append.queue_time_us":249632}
I20260709 13:17:38.378324 12283 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.366732  8923 rpcz_store.cc:276] 0709 13:17:34.824860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.825051 (+   191us) service_pool.cc:224] Handling call
0709 13:17:34.838293 (+ 13242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.191272 (+352979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.341884 (+3150612us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400508054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:38.342266 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310305152}
I20260709 13:17:38.386053  8218 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
W20260709 13:17:38.391553 12206 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 3.182s	user 0.011s	sys 0.012s
I20260709 13:17:38.391953 12196 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.393217  8287 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:38.402041 12278 consensus_meta.cc:287] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.009s
W20260709 13:17:38.400230  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51212.4us
W20260709 13:17:38.402727 12220 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 2.251s	user 0.004s	sys 0.014s
W20260709 13:17:38.403265 12181 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 3.806s	user 0.016s	sys 0.018s
I20260709 13:17:38.405229 12216 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.401937  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 815) took 3624 ms. Trace:
I20260709 13:17:38.408257 12283 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:38.411896 12231 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 2.003s	user 0.017s	sys 0.000s
I20260709 13:17:38.415778  8919 rpcz_store.cc:276] 0709 13:17:34.770325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.770470 (+   145us) service_pool.cc:224] Handling call
0709 13:17:34.770816 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.771217 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.771253 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.795079 (+ 23826us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.877992 (+ 82913us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:34.878017 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.878061 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.390593 (+3512532us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:38.394051 (+  3458us) raft_consensus.cc:1685] finished
0709 13:17:38.394070 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.394532 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":499,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3406,"spinlock_wait_cycles":235163904,"thread_start_us":63537,"threads_started":1,"wal-append.queue_time_us":182793}
I20260709 13:17:38.420095  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1559) took 3589 ms. Trace:
I20260709 13:17:38.419636  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 730) took 4553 ms. Trace:
I20260709 13:17:38.420537  8214 rpcz_store.cc:276] 0709 13:17:34.830174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.191953 (+361779us) service_pool.cc:224] Handling call
0709 13:17:35.349734 (+157781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.479602 (+129868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.479645 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.034754 (+555109us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.098802 (+ 64048us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:36.098865 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.098936 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.376826 (+2277890us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b4800080358. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f 00007f3202428f37 00007f320243d55c 00007f320243d508 00007f320243d488 00007f320243d443 00007f320243c6ec 00007f3201366a96
0709 13:17:38.399122 (+ 22296us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:38.419633 (+ 20511us) raft_consensus.cc:1685] finished
0709 13:17:38.419667 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.419862 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129356,"raft.queue_time_us":190333,"raft.run_cpu_time_us":35811,"raft.run_wall_time_us":2829325,"spinlock_wait_cycles":102194176,"thread_start_us":63572,"threads_started":1,"wal-append.queue_time_us":115954}
I20260709 13:17:38.420806  8928 rpcz_store.cc:276] 0709 13:17:33.864439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.864544 (+   105us) service_pool.cc:224] Handling call
0709 13:17:33.864790 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.871607 (+  6817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.871630 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.882626 (+ 10996us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.104966 (+222340us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:37.860021 (+3755055us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b18003ccb20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fcfb94bc 00007f31fa30748b 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa321455 00007f3200e093c7 00007f31fd41b9a7 00007f31fd42b0bf
0709 13:17:37.862022 (+  2001us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.862297 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.862403 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.375572 (+513169us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:38.414741 (+ 39169us) raft_consensus.cc:1685] finished
0709 13:17:38.414779 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.417727 (+  2948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6453,"prepare.queue_time_us":95233,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":87,"raft.queue_time_us":8199,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":19879,"spinlock_wait_cycles":304820864,"thread_start_us":522069,"threads_started":2,"wal-append.queue_time_us":340648}
I20260709 13:17:38.424036 12216 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.405261 12278 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:38.429904  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.430531  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.434669  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2530) took 3461 ms. Trace:
I20260709 13:17:38.435169  8360 rpcz_store.cc:276] 0709 13:17:34.973280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.080840 (+1107560us) service_pool.cc:224] Handling call
0709 13:17:36.081278 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.089283 (+  8005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.089333 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.089959 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:17:36.244517 (+154558us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:36.244558 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.244622 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.410683 (+2166061us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:38.424678 (+ 13995us) raft_consensus.cc:1685] finished
0709 13:17:38.424703 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.434427 (+  9724us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109254,"raft.queue_time_us":25556,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":26441,"spinlock_wait_cycles":2891520,"thread_start_us":141627,"threads_started":1,"wal-append.queue_time_us":239791}
I20260709 13:17:38.445984 12281 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:38.446589  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.447113 12239 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.951s	user 0.006s	sys 0.006s
I20260709 13:17:38.446893 12281 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.447824 12235 consensus_queue.cc:1059] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:38.449838 12234 raft_consensus.cc:3055] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:38.450328 12234 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:38.450341 12281 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.443228 12000 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.457000  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2538) took 1223 ms. Trace:
I20260709 13:17:38.457465  8367 rpcz_store.cc:276] 0709 13:17:37.233833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.571041 (+337208us) service_pool.cc:224] Handling call
0709 13:17:38.455762 (+884721us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54002ff8d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.456898 (+  1136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232776576}
I20260709 13:17:38.458381 12196 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.459271 12283 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.460067 12283 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.460480 12229 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.461899 12279 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.462631 12283 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.467371 12000 consensus_queue.cc:1059] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:38.468478 12235 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:38.469693 12000 raft_consensus.cc:3055] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:38.470094 12000 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:38.471483  8369 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:38.471129 12000 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.472661  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2230) took 3588 ms. Trace:
I20260709 13:17:38.472676 12000 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:38.473054  8292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1651) took 4317 ms (client timeout 2743 ms). Trace:
I20260709 13:17:38.473083  8288 rpcz_store.cc:276] 0709 13:17:34.883763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.039932 (+2156169us) service_pool.cc:224] Handling call
0709 13:17:37.085750 (+ 45818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.098837 (+ 13087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.472244 (+1373407us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b5400426650. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.472453 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104408832}
W20260709 13:17:38.473737  8292 rpcz_store.cc:269] 0709 13:17:34.155290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.244739 (+ 89449us) service_pool.cc:224] Handling call
0709 13:17:38.472696 (+4227957us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002e8bd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.472869 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383481728}
I20260709 13:17:38.475520  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.473273  8367 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:17:38.481348 12301 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:38.482554 12236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.941s	user 0.007s	sys 0.006s
W20260709 13:17:38.483068 12236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.994s	user 0.008s	sys 0.006s
W20260709 13:17:38.484531  8363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 1960) took 2303 ms (client timeout 3055 ms). Trace:
I20260709 13:17:38.454457 12234 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.485020 12080 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:38.485291 12153 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.485514 12080 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:38.486047 12234 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.486025 12153 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.482443  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:38.484984  8363 rpcz_store.cc:269] 0709 13:17:36.180779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.256957 (+ 76178us) service_pool.cc:224] Handling call
0709 13:17:38.484091 (+2227134us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540010ed54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.484289 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854018944}
I20260709 13:17:38.492358  8183 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.498735  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2253) took 2451 ms. Trace:
I20260709 13:17:38.499087  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:38.499187  8291 rpcz_store.cc:276] 0709 13:17:36.046869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.185158 (+1138289us) service_pool.cc:224] Handling call
0709 13:17:37.208670 (+ 23512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.547608 (+338938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.498226 (+950618us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400024754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:38.498548 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319104384}
I20260709 13:17:38.487020 12080 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.501636 12301 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:38.501999 12080 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.502154 12054 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:38.502609 12054 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:38.506148 12100 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.506341 12301 raft_consensus.cc:697] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:38.507227 12273 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:38.507651 12273 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:38.508517  8928 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:38.507678 12301 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.514730  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.515494  8219 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:38.517410  8889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.029s	sys 0.037s
I20260709 13:17:38.517750  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.518324  8219 raft_consensus.cc:2376] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9. Re-sending same reply.
W20260709 13:17:38.517746  8889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.029s	sys 0.037s
I20260709 13:17:38.506873 12100 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.511327  8214 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:38.512936  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:38.521605  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 1.15963e+06us
I20260709 13:17:38.524363  8889 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.525897 12242 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.526160 12100 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.508813 12273 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.528736 12099 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.529594 12209 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.530422 12273 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.531046  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:38.535542 12277 raft_consensus.cc:3055] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:38.536134 12277 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:38.535679 12241 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:38.540668  8360 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
W20260709 13:17:38.540077  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 76630.3us
I20260709 13:17:38.538129  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.541920  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:38.542382  8889 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.543056  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.544229 12260 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:38.544680 12260 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:38.537317 12277 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.547647  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:38.548113  8921 raft_consensus.cc:2410] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:38.548385  8288 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.551477  8211 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:38.547956 12277 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:38.554960  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 86963.6us
I20260709 13:17:38.566187 12278 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.568758  8288 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:38.540987 12241 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:38.579814  8889 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.572485 12216 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:17:38.575647 12241 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.585769  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:38.584175  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:38.574616 12153 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:34.597000  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:38.591823 12278 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:38.592777 12268 consensus_meta.cc:287] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.010s
I20260709 13:17:38.595650  8919 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.589094 12291 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.602655  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.605086 12055 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.606264 12226 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:38.606431 12055 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:38.607064 12055 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.607055 12014 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:17:38.598762  8924 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:17:38.595114  8258 leader_election.cc:336] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.773s (SENT)
I20260709 13:17:38.607506 12079 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.608300  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.604590  8117 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 10, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 10 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:38.612917  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.607807 12055 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.593341 12268 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:38.611302  8258 leader_election.cc:336] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.811s (SENT)
I20260709 13:17:38.608659 12014 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:38.624214 12285 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.694s	user 0.000s	sys 0.005s
I20260709 13:17:38.624385 12014 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:38.625849  8919 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:38.611227 11997 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:38.620169 12323 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:17:38.625532 12014 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.633970  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:38.636135 12252 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 2.117s	user 0.005s	sys 0.008s
I20260709 13:17:38.636518  8295 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:38.636533 12212 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.637915 12223 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:38.638513 12223 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:38.637849 12148 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:38.634325  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 62119.1us
W20260709 13:17:38.640712  8294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 582) took 4462 ms (client timeout 1818 ms). Trace:
I20260709 13:17:38.640937  8289 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:38.640607 12223 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.641440 12199 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:38.642447  8294 rpcz_store.cc:269] 0709 13:17:34.178468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.217809 (+ 39341us) service_pool.cc:224] Handling call
0709 13:17:38.634959 (+4417150us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54002bcad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.640484 (+  5525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576335104}
W20260709 13:17:38.647549  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 71946.5us
I20260709 13:17:38.651356  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:38.653316  8258 leader_election.cc:336] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.985s (SENT)
I20260709 13:17:38.622808 12260 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.655047 12014 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.655267 12260 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.659044 12268 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.662022  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 611) took 1325 ms. Trace:
I20260709 13:17:38.662499  8920 rpcz_store.cc:276] 0709 13:17:37.336806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.336973 (+   167us) service_pool.cc:224] Handling call
0709 13:17:38.661476 (+1324503us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54003df754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.661725 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131713920}
I20260709 13:17:38.666759  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1947) took 3859 ms. Trace:
I20260709 13:17:38.667199  8362 rpcz_store.cc:276] 0709 13:17:34.807743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.807896 (+   153us) service_pool.cc:224] Handling call
0709 13:17:34.808214 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.809896 (+  1682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.809925 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.812210 (+  2285us) log.cc:844] Serialized 52 byte log entry
0709 13:17:38.486373 (+3674163us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b180039efe0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:17:38.577911 (+ 91538us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:38.581244 (+  3333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.585566 (+  4322us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.666388 (+ 80822us) raft_consensus.cc:1685] finished
0709 13:17:38.666405 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.666603 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2482,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4197,"spinlock_wait_cycles":2648960,"thread_start_us":80820,"threads_started":1,"wal-append.queue_time_us":3824632}
I20260709 13:17:38.673583 12216 raft_consensus.cc:2764] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:38.659765 11857 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.677074  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.677556  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.678249  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:38.678911  8286 raft_consensus.cc:2376] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12. Re-sending same reply.
I20260709 13:17:38.679445  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:38.680009  8293 raft_consensus.cc:2376] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10. Re-sending same reply.
I20260709 13:17:38.680881  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:38.681399  8293 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.682143 12241 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.683678  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:38.684693  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.684494  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.686136  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.686607  8183 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:38.688566  8291 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:17:38.689963 12223 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.672782  8117 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 5 to 8, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 8 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:38.692637  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.692974  8889 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.695664 12277 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.695880  8928 raft_consensus.cc:2410] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:38.696426  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:38.696609  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:38.697939  8258 leader_election.cc:336] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.996s (SENT)
I20260709 13:17:38.684559  8294 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:38.700201 12251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.369s	user 0.008s	sys 0.011s
W20260709 13:17:38.700750 12251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.456s	user 0.008s	sys 0.012s
I20260709 13:17:38.701051 12199 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:38.701141 12251 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:38.701843 12199 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.702328 12199 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:38.702678 12251 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.704548  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2533) took 1512 ms. Trace:
I20260709 13:17:38.704950  8364 rpcz_store.cc:276] 0709 13:17:37.192499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.197044 (+  4545us) service_pool.cc:224] Handling call
0709 13:17:37.197268 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.117695 (+920427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.704297 (+586602us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400370854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:38.704466 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049730816}
I20260709 13:17:38.703068  8183 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:38.707788  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.710079 12287 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.711486 12284 raft_consensus.cc:3055] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:38.693169  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.708737 12103 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:38.712387 12103 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.712538 11857 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:38.712903 12103 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:38.711862 12284 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:38.719991 11857 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:38.721424 12284 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.722900 12284 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:38.725756 12058 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.726286 12058 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.726778 12327 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:38.727746 11857 consensus_queue.cc:1059] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:38.728673 12058 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.729398  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.717558  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.729415 12076 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:38.708956  8183 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.706732  8293 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:38.733104 12193 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:38.733575 12216 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:38.734756  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56040 (request call id 601) took 1632 ms. Trace:
I20260709 13:17:38.746028 12216 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:38.745986  8922 rpcz_store.cc:276] 0709 13:17:37.102141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.102286 (+   145us) service_pool.cc:224] Handling call
0709 13:17:38.734441 (+1632155us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001e78d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.734598 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359525248}
W20260709 13:17:38.739451  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.742220 12291 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.747319 12216 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.748734  8218 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:38.751170 12287 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:38.742878 12214 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.752417  8923 raft_consensus.cc:3055] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:38.752827  8923 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:38.753024 12287 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:38.752732 12214 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.753631 12287 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.753767  8923 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.755071 12214 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.755008  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:38.743396 12083 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.742525 12301 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.747439 12291 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.756012  8928 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:38.756971  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:38.757647  8919 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:38.757822  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:38.757969 12291 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.755021  8923 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:38.757341  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:38.756155 12301 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.759380  8920 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:38.756080 12083 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.760846 12301 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.755318 12055 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.761780 12083 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.755738 12287 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.763581 12055 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.758646  8922 raft_consensus.cc:2376] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7. Re-sending same reply.
I20260709 13:17:38.773337  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.767925  8923 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:38.771327  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:38.773005  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.767100  8218 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:38.774504  8213 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:38.775435  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.775913  8213 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:38.776245  8218 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.777469 12273 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:38.777906  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.777987 12273 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:38.779287 12273 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.780937  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.782909  8214 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:38.785101  8214 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:38.784770  8183 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:38.790737  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 94264us
I20260709 13:17:38.742560 12080 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.791844 12080 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:38.792205  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 52682.9us
I20260709 13:17:38.793077 12054 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.794206 12080 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.794958  8921 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:38.800616  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:38.802143  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:38.803443  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.805226  8364 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 6.
I20260709 13:17:38.795982 12241 leader_election.cc:290] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:38.745139 12076 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:38.794240 12054 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.807891  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:38.808326  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 79035us
I20260709 13:17:38.808590  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.807045  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:38.808034  8362 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:38.807083  8363 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:38.810436  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:38.820362  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.809257  8361 raft_consensus.cc:2376] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9. Re-sending same reply.
I20260709 13:17:38.807469  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.800235  8218 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:38.829272  8214 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:38.805619 12273 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:38.831437  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:38.834306  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.807951 12063 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.838442  8365 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:38.847594  8295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2264) took 1569 ms. Trace:
I20260709 13:17:38.828740 12199 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:38.850598  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.849630  8889 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:38.848009  8295 rpcz_store.cc:276] 0709 13:17:37.269301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.669707 (+400406us) service_pool.cc:224] Handling call
0709 13:17:38.834181 (+1164474us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b540030c854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.838807 (+  4626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006140800}
I20260709 13:17:38.837531 12273 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:38.856649  8361 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:38.861894  8218 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:38.862074  8361 pending_rounds.cc:85] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 5
I20260709 13:17:38.869608  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.853557 12199 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.881968 12273 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.884470 12103 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.866626  8361 pending_rounds.cc:107] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:38.885452  8361 raft_consensus.cc:2889] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:38.886459  8369 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:38.886775 12290 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.887228 12103 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.887296 12290 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.888137 12241 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.875629  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.875903 12079 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.877624  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.845011 12058 consensus_queue.cc:1059] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:17:38.880369  8214 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:17:38.890872  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 106637us
I20260709 13:17:38.892002  8368 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:38.894395  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 44836.7us
I20260709 13:17:38.901206 12080 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:38.901644  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:38.904359  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:38.904686 12148 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:38.905087 12148 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.905264  8213 raft_consensus.cc:2410] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:38.905433 12148 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.903784  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.913246  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.914273  8361 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:38.914492  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:38.912060 11857 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:38.920202  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.921876  8287 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:38.927420  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:38.927625  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.893321 12079 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.928129  8295 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:38.928969  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:38.928028  8366 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:38.942229  8288 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:17:38.944610 12328 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:17:38.946501  8218 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:38.948313  8369 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:17:38.948683  8369 pending_rounds.cc:85] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 4
I20260709 13:17:38.948904  8369 pending_rounds.cc:107] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:38.949127  8369 raft_consensus.cc:2889] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:38.949859  8889 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:38.958566 12103 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:38.959489 12103 consensus_queue.cc:1243] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:38.959545  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:38.959805 12014 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:38.960353 12103 raft_consensus.cc:3055] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:38.960824 12103 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:38.961040  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.961782 12310 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.962358 12310 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:38.962678 12055 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:38.964237 12212 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:38.964515  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.964735 12212 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:38.965113 12212 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:38.965314  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.965920  8366 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:38.959568 12287 consensus_queue.cc:1059] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:17:38.962365  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:38.967464  8362 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:38.967901 11857 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:38.958688  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:38.934475 12241 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:38.971232  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2259) took 2814 ms. Trace:
I20260709 13:17:38.972851 12241 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:38.973910 12241 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:38.978700 12279 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.979290  8183 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:38.971704  8289 rpcz_store.cc:276] 0709 13:17:36.157004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.751447 (+1594443us) service_pool.cc:224] Handling call
0709 13:17:38.640517 (+889070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.644632 (+  4115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.968357 (+323725us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54002bcad0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:38.971163 (+  2806us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008785280}
I20260709 13:17:38.967145 12234 raft_consensus.cc:3055] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:38.964286 12055 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.965934 12310 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:38.991497  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:38.969460 11857 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:38.995577  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:38.989943 12290 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:38.991017 12287 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.989401 12234 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:38.995249 11857 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:39.020128  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.022843  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:39.023485  8364 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:39.021639  8117 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 9, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 9 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.016325 12080 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:39.028949 12079 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:39.030824 12251 raft_consensus.cc:3055] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:38.989069 12103 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:39.037030  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.040514  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:39.039953  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.043349  8365 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:39.046563  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 53826us
W20260709 13:17:39.046852  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 50002.2us
I20260709 13:17:39.048238 11809 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:39.019168 12279 consensus_queue.cc:1059] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:17:39.052085  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:39.052075  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.053221  8361 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:39.053930  8368 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:39.054471  8368 pending_rounds.cc:85] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 5
I20260709 13:17:39.054773  8368 pending_rounds.cc:107] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:39.055086  8368 raft_consensus.cc:2889] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:39.051153  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.033305 12251 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:39.049475  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:39.049564  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.048987  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:39.051108  8369 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:39.058149  8364 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:39.048926 12310 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.064309  8363 raft_consensus.cc:2376] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12. Re-sending same reply.
I20260709 13:17:39.066890  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.021252 12076 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.072202  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.070922  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:39.071327  8889 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:39.073192  8117 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:39.079141 12334 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.002s
I20260709 13:17:39.079319  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:39.068282 12103 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:39.034533 12234 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.064996 11809 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:39.084547 12000 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:39.085124 12286 consensus_queue.cc:1059] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:39.085955 12295 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:39.088191 12260 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:39.088899 12212 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.091018  8261 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:39.095947  8117 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 5 to 11, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 11 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:39.097021  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.074728 12054 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:39.097980  8366 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:39.102972  8363 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:39.080148 12080 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:39.108897  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:39.097541 12076 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.101928 12199 raft_consensus.cc:3055] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:39.116799  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 58764.1us
I20260709 13:17:39.095391 12148 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.119932 12266 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:39.122679  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.123428 12229 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:39.123839 12229 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:39.124258 12001 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:39.125144 12212 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:39.124691 12229 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:39.126322  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.125998 11809 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.126263 12229 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:39.111029 12287 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.133297  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.135087  8361 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 7.
I20260709 13:17:39.136528  8365 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:39.111162 12295 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:39.114367 12199 raft_consensus.cc:740] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:39.135867  8117 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 9, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 9 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.117302 12054 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:39.118465 12000 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:39.142637  8367 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:39.132995 12234 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:39.144461 12199 consensus_queue.cc:260] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.137548 12286 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.146423  8186 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:39.141592 12310 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:39.153772  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 44976.5us
W20260709 13:17:39.155869  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.138779 12287 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.158535 12054 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.160794 12295 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.157006 12310 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:39.156916 12199 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:39.163152 12148 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:39.163568 12287 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:39.168172  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:39.155598 12279 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:39.168919  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:39.173286  8117 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:39.146693 12268 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:39.181792  8117 catalog_manager.cc:5697] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 8, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:39.183175  8117 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.185539 12241 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.178782 12310 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.146818 12251 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.188522 12251 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:39.192436  8186 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:39.194785 12279 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:39.195376 12279 raft_consensus.cc:697] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:39.185130  8117 catalog_manager.cc:5697] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 1 to 7, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:39.172879 12000 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.196542 12279 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:39.202716  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46347.1us
I20260709 13:17:39.204450  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:39.205389 12241 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:39.206755  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.207288  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.207386  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.208259  8922 raft_consensus.cc:2410] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:39.208374  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.209069  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.209290  8919 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:39.209659  8920 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:39.209726  8261 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:39.208526  8921 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:39.206874  8924 pending_rounds.cc:85] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 7
I20260709 13:17:39.211126 12230 consensus_queue.cc:1059] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:39.211653  8924 pending_rounds.cc:107] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:17:39.211885 12230 consensus_queue.cc:1243] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:39.212030  8924 raft_consensus.cc:2889] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:39.212926 12230 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:39.213312 12230 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:39.213653 12230 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:39.195680  8186 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:39.218010  8920 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
W20260709 13:17:39.231235  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.231963  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:39.233186  8258 leader_election.cc:336] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.560s (SENT)
I20260709 13:17:39.236785  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.226567 12258 raft_consensus.cc:3055] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:39.250769  8920 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:39.253089  8922 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:39.254067  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.254336  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.254794  8922 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:39.254905  8923 raft_consensus.cc:2376] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11. Re-sending same reply.
I20260709 13:17:39.255724  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.255854  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.256358  8928 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
W20260709 13:17:39.256987  8118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46484 (request call id 260) took 20638 ms (client timeout 15000 ms). Trace:
I20260709 13:17:39.257344  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.257144  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.258199  8925 raft_consensus.cc:2410] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:39.259148  8261 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:39.227880 12148 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:39.262236  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 93425.3us
W20260709 13:17:39.264169  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 68578.1us
I20260709 13:17:39.265758  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.266455  8923 raft_consensus.cc:2376] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10. Re-sending same reply.
I20260709 13:17:39.269533  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.271104  8362 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:39.226580 11857 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:39.270895  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 175431us
I20260709 13:17:39.259810 12286 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:39.272922  8921 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.273046  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.248593 12001 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.275998  8920 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:39.260149 12258 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:39.261529 12079 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.280280  8186 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:39.282969 12073 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:39.285986  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:39.288305 12340 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:39.276839 12001 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.292330 12001 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:39.294497  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.314254 12342 consensus_queue.cc:1059] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:39.315649 11809 raft_consensus.cc:3055] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:39.316004 11809 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:39.316978 11809 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.277104 12290 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.280876 12058 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:39.324911  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 65832.6us
W20260709 13:17:39.325335  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 45122.3us
I20260709 13:17:39.325662  8261 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:39.326947 11809 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:39.328162  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:39.294620 11857 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:39.321153 12295 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:39.344599  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:39.351161  8293 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:39.351583  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.351912  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.352701  8219 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:39.355537  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.361357  8287 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:17:39.366518  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.368964  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.331100 11997 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:39.371522  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.379159  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.379436  8220 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:39.380882  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:39.381119  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.382130  8214 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:39.383227  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.384270  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:39.388267  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:39.388568  8217 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:17:39.389061  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:39.389596  8928 raft_consensus.cc:1240] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:39.327118 12342 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:39.389957  8289 raft_consensus.cc:2393] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 7: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:39.381637  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:39.391906  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.392944  8293 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:39.394281  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:39.257552  8118 rpcz_store.cc:269] 0709 13:17:18.618177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.618442 (+   265us) service_pool.cc:224] Handling call
0709 13:17:39.256654 (+20638212us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:30.299310 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:30.484779 (+185469us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:30.491101 (+  6322us) write_op.cc:435] Acquired schema lock
0709 13:17:30.498331 (+  7230us) tablet.cc:662] Decoding operations
0709 13:17:31.071193 (+572862us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:31.101027 (+ 29834us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:31.102734 (+  1707us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:17:31.220030 (+117296us) tablet.cc:701] Row locks acquired
0709 13:17:31.220102 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:17:31.220274 (+   172us) write_op.cc:270] Start()
0709 13:17:31.220442 (+   168us) write_op.cc:276] Timestamp: P: 1783603051220199 usec, L: 0
0709 13:17:31.220464 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:31.242013 (+ 21549us) log.cc:844] Serialized 8962 byte log entry
0709 13:17:32.587055 (+1345042us) op_driver.cc:464] REPLICATION: finished
0709 13:17:32.965536 (+378481us) write_op.cc:301] APPLY: starting
0709 13:17:32.968691 (+  3155us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:33.224882 (+256191us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:33.248488 (+ 23606us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:33.516542 (+268054us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:33.517204 (+   662us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:17:33.517257 (+    53us) write_op.cc:312] APPLY: finished
0709 13:17:33.517676 (+   419us) log.cc:844] Serialized 158 byte log entry
0709 13:17:33.682357 (+164681us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.709046 (+ 26689us) write_op.cc:454] Released schema lock
0709 13:17:33.754196 (+ 45150us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:33.866915 (+112719us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.871889 (+  4974us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195684,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":373031,"apply.run_cpu_time_us":26754,"apply.run_wall_time_us":885100,"num_ops":23,"prepare.queue_time_us":109679,"prepare.run_cpu_time_us":23391,"prepare.run_wall_time_us":1256325,"raft.queue_time_us":404221,"raft.run_cpu_time_us":14142,"raft.run_wall_time_us":288439,"replication_time_us":1320561,"thread_start_us":693482,"threads_started":5,"wal-append.queue_time_us":533960,"wal-append.run_cpu_time_us":28385,"wal-append.run_wall_time_us":3013277}]]}
W20260709 13:17:39.398062 12341 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:39.400179 12256 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:17:39.403060  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.389564  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.380009  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:39.308108 12079 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.407770  8920 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:39.410826  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 78941.9us
I20260709 13:17:39.411108  8215 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:39.407358  8212 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:39.415074  8186 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:39.368088 12260 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:39.328210 12058 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.424469  8211 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:39.415333  8927 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:39.427501  8218 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:39.378890 11997 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.441790  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.442734  8220 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:39.444159  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:39.445990  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.446074  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:39.449599  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:39.450333  8212 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:39.453564  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:39.454365  8213 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:39.455675  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 122867us
I20260709 13:17:39.457398  8261 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.457368  8921 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:39.462613  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.467018  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:39.467762  8295 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:39.467852  8286 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:39.466733  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:39.399880 12230 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.472312  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.478380  8927 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:17:39.473913  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 66343.7us
I20260709 13:17:39.337949 12258 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.451115 11997 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.447602 12295 raft_consensus.cc:2764] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:39.511138  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.415824 12290 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:17:39.488225 12268 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:39.488341  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:39.449009 12260 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:39.475924 12199 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.513980 12244 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:39.519644  8294 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:39.514562  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.473081 12063 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.521926  8927 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:39.528941  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:39.533360  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.539721  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 82377us
I20260709 13:17:39.548249  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:39.513103 12273 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:39.553211  8258 leader_election.cc:336] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.863s (SENT)
I20260709 13:17:39.520224 12244 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.553444  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.553236  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.554900  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.481622 12001 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.520368 12199 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:39.556501  8927 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:39.560387  8186 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:39.565496  8186 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:39.569619  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:39.542404 12063 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.554783 12273 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.517602 12099 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:39.562161 12258 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:39.559206 12244 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.573509  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:39.585480  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:39.591939  8927 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:39.561424 12199 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.594003  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:39.595232 12256 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:39.595400  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.595778 12256 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:39.596774 12347 log.cc:927] Time spent T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:39.596975 12256 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.600172 12350 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.576086 12295 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.584077 12273 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:39.604409  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:39.606894 12063 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:39.608651 12058 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:39.617264  8924 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:39.587280  8186 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:39.587890  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.563026 12268 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:39.586339 12073 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:39.620522 12073 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.620978 12073 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:39.623253 12268 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:39.631590  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.558495 11857 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:39.578708 12279 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:39.633237  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 46070.7us
I20260709 13:17:39.649794  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:39.653318  8368 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:39.655001  8927 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:17:39.655556  8927 pending_rounds.cc:85] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 8
I20260709 13:17:39.655889  8927 pending_rounds.cc:107] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:17:39.657215  8927 raft_consensus.cc:2889] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:39.659899  8360 raft_consensus.cc:1240] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:39.660414  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 148886us
I20260709 13:17:39.634495 12063 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:39.662254  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.662436  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.662339  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:39.663353  8363 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:39.663516  8289 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:39.667366  8366 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:39.667742  8366 pending_rounds.cc:85] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 6
I20260709 13:17:39.667944  8366 pending_rounds.cc:107] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:39.668176  8366 raft_consensus.cc:2889] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:39.640925 12279 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:39.674183  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.586544 12260 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.678402  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:39.680898  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.665984 12342 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.646437 12295 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:17:39.684841  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:39.664196 12079 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:39.689499  8186 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:39.675379 12279 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:39.687388  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 92073.7us
I20260709 13:17:39.701382  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:39.703248  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 155171us
I20260709 13:17:39.704767  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.694345 12230 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:39.710907  8220 raft_consensus.cc:2410] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:39.712019  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:39.703480 12099 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:17:39.716336 12355 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:39.717422 12286 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.718118  8261 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:39.708314 11857 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:39.737011 12351 log.cc:927] Time spent T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:39.749856  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:39.751104 12230 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:39.751619 12230 raft_consensus.cc:697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:39.752223 12058 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:39.752803 12058 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:39.752463 12251 consensus_queue.cc:1059] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:39.753754 12058 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:39.754284 12251 raft_consensus.cc:3055] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:39.704301 12079 consensus_queue.cc:1059] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:39.696554 12354 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:39.732664  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:39.735899  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:39.696767 12342 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.892961 12342 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:39.894400  8214 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:39.894773 12342 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.895318 12342 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:39.895759  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:39.899204  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.898985 12342 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:39.780159  8364 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:39.901288  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:39.901986  8364 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.784715  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:39.905231  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:39.766566  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.878835  8217 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:39.890879  8215 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:39.786708  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 237926us
W20260709 13:17:42.467734  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.965688  8212 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.504s	user 0.013s	sys 0.001s
I20260709 13:17:42.549677  8212 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
W20260709 13:17:42.550352  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1606) took 3174 ms (client timeout 1961 ms). Trace:
I20260709 13:17:41.902964  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:42.553110 12103 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:41.900477  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:42.563549  8215 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.901834  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:42.569015  8217 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 9: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:42.570168  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:42.157979  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1593) took 2815 ms. Trace:
I20260709 13:17:42.572458  8218 rpcz_store.cc:276] 0709 13:17:39.342817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.343215 (+   398us) service_pool.cc:224] Handling call
0709 13:17:39.343550 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.428085 (+ 84535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.157701 (+2729616us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b5400199954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:42.157904 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187499904}
I20260709 13:17:42.142426  8219 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
W20260709 13:17:42.576217  8219 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1599) took 3218 ms (client timeout 1914 ms). Trace:
W20260709 13:17:42.576617  8219 rpcz_store.cc:269] 0709 13:17:39.358301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.358460 (+   159us) service_pool.cc:224] Handling call
0709 13:17:42.575970 (+3217510us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b54001b2e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:42.576132 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6375936256}
I20260709 13:17:42.578420  8219 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:42.051337  8220 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:42.580996  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1842) took 2915 ms. Trace:
I20260709 13:17:42.581363  8220 rpcz_store.cc:276] 0709 13:17:39.665348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.050605 (+2385257us) service_pool.cc:224] Handling call
0709 13:17:42.050982 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.580701 (+529719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.580933 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:40.883221  8213 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.419s	user 0.014s	sys 0.001s
W20260709 13:17:40.974581  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08002b48a0 after lost signal to thread 7079
I20260709 13:17:39.844439  8287 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:42.585306  8218 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:42.585889  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08001d50c0 after lost signal to thread 8152
I20260709 13:17:42.587038  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1698) took 3043 ms. Trace:
I20260709 13:17:42.587392  8287 rpcz_store.cc:276] 0709 13:17:39.543713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.543838 (+   125us) service_pool.cc:224] Handling call
0709 13:17:39.553179 (+  9341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.585635 (+3032456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.586840 (+  1205us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54001270d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:42.586985 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668906368}
I20260709 13:17:41.928483  8286 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:41.129830  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.020145  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:42.595412  8288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2292) took 2551 ms (client timeout 2839 ms). Trace:
W20260709 13:17:42.595752  8288 rpcz_store.cc:269] 0709 13:17:40.043945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.019810 (+1975865us) service_pool.cc:224] Handling call
0709 13:17:42.595358 (+575548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.089510  8289 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:39.787493  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 75541.2us
I20260709 13:17:42.600914  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:42.096068  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.137976  8294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2290) took 2094 ms (client timeout 1793 ms). Trace:
W20260709 13:17:42.604803  8294 rpcz_store.cc:269] 0709 13:17:40.043592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.137799 (+2094207us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:42.137917 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:39.797860  8295 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
W20260709 13:17:42.607024  8295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1695) took 3172 ms (client timeout 2065 ms). Trace:
W20260709 13:17:42.607409  8295 rpcz_store.cc:269] 0709 13:17:39.434433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.434604 (+   171us) service_pool.cc:224] Handling call
0709 13:17:42.606957 (+3172353us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:42.186468  8360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.357s	user 0.033s	sys 0.004s
W20260709 13:17:42.610518  8360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.789s	user 0.035s	sys 0.005s
I20260709 13:17:42.611299  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1997) took 2851 ms. Trace:
I20260709 13:17:41.945122  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2559) took 2278 ms. Trace:
I20260709 13:17:42.613555  8361 rpcz_store.cc:276] 0709 13:17:39.666881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.667011 (+   130us) service_pool.cc:224] Handling call
0709 13:17:39.676946 (+  9935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.696641 (+ 19695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.696681 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.696727 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:39.696767 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.944822 (+2248055us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b5400356e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:41.944871 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:41.945054 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18702592}
I20260709 13:17:42.615226  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:42.035631  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2000) took 2270 ms. Trace:
W20260709 13:17:42.159554  8363 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.325s	user 0.019s	sys 0.014s
I20260709 13:17:42.617491 12424 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:42.618815  8363 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.784s	user 0.020s	sys 0.015s
I20260709 13:17:42.619098 12424 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:42.128969  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1995) took 2371 ms. Trace:
I20260709 13:17:42.621236 12424 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:42.620340  8365 rpcz_store.cc:276] 0709 13:17:39.757611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.757797 (+   186us) service_pool.cc:224] Handling call
0709 13:17:39.774135 (+ 16338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.789317 (+ 15182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.789386 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.810148 (+ 20762us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.882241 (+ 72093us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:39.882278 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.882364 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.911432 (+ 29068us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b480015c258. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f 00007f3202428f37 00007f320243d55c 00007f320243d508 00007f320243d488 00007f320243d443 00007f320243c6ec 00007f3201366a96
0709 13:17:42.128524 (+2217092us) raft_consensus.cc:1685] finished
0709 13:17:42.128557 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.128882 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14721,"raft.queue_time_us":16108,"raft.run_cpu_time_us":2773,"raft.run_wall_time_us":107201,"spinlock_wait_cycles":12780800,"thread_start_us":35073,"threads_started":1,"wal-append.queue_time_us":159869,"wal-append.run_cpu_time_us":1286,"wal-append.run_wall_time_us":1003318}
I20260709 13:17:42.621795 12424 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:42.622359 12424 consensus_queue.cc:1243] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:17:42.135041  8366 consensus_meta.cc:287] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 2.229s	user 0.005s	sys 0.024s
I20260709 13:17:42.625519  8366 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
W20260709 13:17:42.626139  8366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 2006) took 2844 ms (client timeout 2120 ms). Trace:
I20260709 13:17:42.389987  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:40.937479  8368 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.164s	user 0.018s	sys 0.010s
I20260709 13:17:42.558015  8106 maintenance_manager.cc:643] P e8c3cea2f3524d70be8a4a6e5be1c492: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.720s	user 0.162s	sys 0.120s Metrics: {"bytes_written":29698,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":57260,"dirs.run_cpu_time_us":409,"dirs.run_wall_time_us":2195,"drs_written":1,"lbm_read_time_us":360,"lbm_reads_lt_1ms":4,"lbm_write_time_us":38055,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":71244,"threads_started":1,"update_count":10}
W20260709 13:17:42.239535  8117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 190) took 12900 ms (client timeout 15000 ms). Trace:
W20260709 13:17:42.107069  8183 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.4:42491 timed out after 1.669s (SENT) [suppressed 55 similar messages]
I20260709 13:17:42.556252  8211 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:43.358799  8368 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.585s	user 0.028s	sys 0.012s
I20260709 13:17:42.582916  8213 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
W20260709 13:17:42.588195  8241 debug-util.cc:398] Leaking SignalData structure 0x7b0800343680 after lost signal to thread 8244
W20260709 13:17:43.369416  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9e20 after lost signal to thread 8319
W20260709 13:17:43.370822  8241 debug-util.cc:398] Leaking SignalData structure 0x7b080023b600 after lost signal to thread 8393
W20260709 13:17:43.371138  8241 debug-util.cc:398] Leaking SignalData structure 0x7b080039eca0 after lost signal to thread 8394
W20260709 13:17:42.597711  8261 connection.cc:256] RPC call timeout handler was delayed by -1.0932410279999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:17:42.478314  8258 connection.cc:256] RPC call timeout handler was delayed by -2.8433023540001159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 13:17:42.597956  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2293) took 2553 ms. Trace:
I20260709 13:17:43.378108  8289 rpcz_store.cc:276] 0709 13:17:40.044203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.088737 (+2044534us) service_pool.cc:224] Handling call
0709 13:17:42.089103 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.597611 (+508508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.597897 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.592818  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2291) took 2549 ms. Trace:
I20260709 13:17:42.593793  8215 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:43.380076  8286 rpcz_store.cc:276] 0709 13:17:40.043786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.927647 (+1883861us) service_pool.cc:224] Handling call
0709 13:17:41.928061 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.592561 (+664500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.592766 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:43.380786  8215 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 550) took 1481 ms (client timeout 1655 ms). Trace:
I20260709 13:17:43.376785  8294 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:17:43.381203  8215 rpcz_store.cc:269] 0709 13:17:41.899965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.900133 (+   168us) service_pool.cc:224] Handling call
0709 13:17:43.380700 (+1480567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.665745 12427 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.629238  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:42.616711  8362 rpcz_store.cc:276] 0709 13:17:39.765185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.775819 (+ 10634us) service_pool.cc:224] Handling call
0709 13:17:39.776218 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.789898 (+ 13680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.789942 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.790433 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.880984 (+ 90551us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:39.883403 (+  2419us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.883643 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.883731 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:41.978565 (+2094834us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b480015c258. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f320233aaa1 00007f3202331b37 00007f32023319ca 00007f320242926f 00007f3202428f37 00007f320243d55c 00007f320243d508 00007f320243d488 00007f320243d443 00007f320243c6ec 00007f3201366a96
0709 13:17:42.035216 (+ 56651us) raft_consensus.cc:1685] finished
0709 13:17:42.035349 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.035550 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13184,"prepare.queue_time_us":114675,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":515,"raft.queue_time_us":28605,"raft.run_cpu_time_us":18977,"raft.run_wall_time_us":2170013,"spinlock_wait_cycles":12284288,"thread_start_us":52612,"threads_started":2,"wal-append.queue_time_us":186602,"wal-append.run_cpu_time_us":1596,"wal-append.run_wall_time_us":1008621}
W20260709 13:17:43.384095  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 754835us
I20260709 13:17:43.385210  8362 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:43.385265  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:43.379340  8114 catalog_manager.cc:5697] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 7 to 9, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 9 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.385818  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2007) took 3603 ms. Trace:
I20260709 13:17:43.386279 12424 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:43.386163  8362 rpcz_store.cc:276] 0709 13:17:39.782079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.384763 (+3602684us) service_pool.cc:224] Handling call
0709 13:17:43.385055 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.385611 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.385769 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.386884 12424 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:41.951304  8364 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 2.049s	user 0.025s	sys 0.004s
I20260709 13:17:43.388620  8364 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
W20260709 13:17:43.389096  8364 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 2005) took 3607 ms (client timeout 1944 ms). Trace:
W20260709 13:17:43.389431  8364 rpcz_store.cc:269] 0709 13:17:39.781469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.900996 (+119527us) service_pool.cc:224] Handling call
0709 13:17:43.389034 (+3488038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.387104  8114 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:43.390618  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.626528  8366 rpcz_store.cc:269] 0709 13:17:39.781781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.904892 (+123111us) service_pool.cc:224] Handling call
0709 13:17:42.626044 (+2721152us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:41.970253  8369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.160s	user 0.009s	sys 0.036s
I20260709 13:17:42.174265  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 535) took 2655 ms. Trace:
I20260709 13:17:43.402099 12428 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:17:43.403846  8114 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 3 to 11, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.403635  8367 rpcz_store.cc:276] 0709 13:17:39.518519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.518645 (+   126us) service_pool.cc:224] Handling call
0709 13:17:39.541552 (+ 22907us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.541923 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.541952 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.586145 (+ 44193us) log.cc:844] Serialized 52 byte log entry
0709 13:17:39.812583 (+226438us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:39.812620 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.812685 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.173980 (+2361295us) raft_consensus.cc:1685] finished
0709 13:17:42.174002 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.174196 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6173,"thread_start_us":204587,"threads_started":1,"wal-append.queue_time_us":253011,"wal-append.run_cpu_time_us":42829,"wal-append.run_wall_time_us":3443899}
I20260709 13:17:43.404894 12428 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:43.405584 12428 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:43.405884  8367 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:43.406490  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2011) took 1377 ms. Trace:
I20260709 13:17:43.406826  8367 rpcz_store.cc:276] 0709 13:17:42.029208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.405409 (+1376201us) service_pool.cc:224] Handling call
0709 13:17:43.405692 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.406271 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.406438 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.406651 12428 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:42.039712  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.049569  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.904106  8919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.030s	user 0.004s	sys 0.012s
I20260709 13:17:42.102432  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:43.424901  8924 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:17:43.425452  8924 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 850) took 3552 ms (client timeout 2146 ms). Trace:
W20260709 13:17:43.425863  8924 rpcz_store.cc:269] 0709 13:17:39.873445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.873937 (+   492us) service_pool.cc:224] Handling call
0709 13:17:43.425350 (+3551413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:39.873466  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:39.842943 11809 consensus_meta.cc:287] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.001s
I20260709 13:17:39.808840 11857 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.815691 11997 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:42.043327 12000 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.988365 12001 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:42.100488 12014 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.466434 12014 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.468559 11997 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.113845 12058 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.469978 12000 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:42.006656 12063 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.845160 12073 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.473663 12063 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.475382 12073 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.475472 12000 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.476269  8367 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:42.070834 12079 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.247s	user 0.002s	sys 0.014s
I20260709 13:17:42.037338 12099 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:42.673964 12148 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:39.869303 12199 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:42.011935 12229 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.486711 12229 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.487211  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2012) took 1457 ms. Trace:
I20260709 13:17:43.487462 12199 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.487761  8367 rpcz_store.cc:276] 0709 13:17:42.029470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.409721 (+1380251us) service_pool.cc:224] Handling call
0709 13:17:43.419220 (+  9499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.476631 (+ 57411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.486904 (+ 10273us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b5400366fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:43.487139 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130280192}
I20260709 13:17:39.838112 12230 consensus_queue.cc:237] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.490744 12436 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.491441 12436 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:42.066906 12234 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:42.139700 12241 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.493923 12234 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.494688 12241 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:40.943627 12244 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.344s	user 0.018s	sys 0.000s
I20260709 13:17:39.754866 12251 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:43.499482  8214 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:43.499922 12251 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.501098 12251 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.006065 12256 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.504210 12256 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.498164 12244 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.506438 12256 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.507078 12244 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.077569 12258 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.175143 12260 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.515892 12258 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.517109 12260 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.519066 12258 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.519395 12260 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.593125 12266 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.531374 12384 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:39.843981 12273 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.542299 12273 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:39.841315 12279 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:41.904021 12286 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.547339 12286 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:42.205175 12287 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.340s	user 0.002s	sys 0.030s
I20260709 13:17:43.549453  8216 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:42.169754 12295 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.597312 12290 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.553099 12295 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.553983 12290 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.555860 12290 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:41.935731 12350 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.804339 12354 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.557893 12445 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.196558 12356 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.558813 12286 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:40.965792 12357 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:43.557242 12350 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.559242 12356 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.559892 12357 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.560565  8290 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:41.934506 12359 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.562407  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.562258 12359 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.562789 12356 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.563557 12350 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:40.001148 12365 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:17:40.953437 12378 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:41.950482 12381 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.570353 12381 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:41.968405 12382 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.573058 12382 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.575207 12382 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:41.928606 12380 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.576570 12380 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:41.972810 12383 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.580523 12383 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.582882 12383 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:42.011888 12385 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.585022 12381 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.584848 12385 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.585650 12380 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.587044 12385 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.058393 12387 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.588482 12387 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.590711 12387 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.025771 12388 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.592061 12388 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.593657 12445 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:42.104350 12391 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.597064 12391 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.597455 12445 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.599037 12391 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:42.102540 12392 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.600354 12392 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.601651  8217 raft_consensus.cc:2410] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:43.602383 12392 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.360733 12393 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.597904 12394 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.096217 12395 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:42.096813 12396 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.607728 12395 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.608472 12396 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:42.112741 12397 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.584345 12398 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.144585 12399 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.612888 12398 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.613595 12399 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.615734 12399 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.157308 12400 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.617087 12400 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.615895 12398 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.427755 12402 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.619190 12400 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.154157 12401 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.200955 12405 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.620497 12401 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.621196 12405 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.622730 12401 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:42.194984 12403 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.258230 12408 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.624148 12403 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.624887 12408 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.626416 12403 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.626992  8927 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:43.627620 12408 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.296903 12410 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:43.629266 12410 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:42.271240 12409 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.633183 12409 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.633831 12256 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:43.634418 12256 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.635505 12409 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.325162 12411 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.636469 12256 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.637032 12411 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.639395 12411 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:42.389587 12413 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.641136  8927 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:43.641264 12413 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:43.642663  8927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54790 (request call id 849) took 3769 ms (client timeout 1669 ms). Trace:
W20260709 13:17:43.643079  8927 rpcz_store.cc:269] 0709 13:17:39.873129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.873241 (+   112us) service_pool.cc:224] Handling call
0709 13:17:43.642245 (+3769004us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b540066e254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:43.642590 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459570432}
I20260709 13:17:43.643689 12413 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.644203  8365 pending_rounds.cc:85] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:43.644567  8365 pending_rounds.cc:107] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:43.644819  8365 raft_consensus.cc:2889] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.388761 12412 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.647471 12412 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:42.388302 12414 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.649515 12414 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.650563 12412 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.430207 12416 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.651598 12414 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.652099 12416 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.653543  8365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2003) took 3887 ms. Trace:
I20260709 13:17:43.654711 12416 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:42.429282 12418 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.493251 12421 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:42.608258 12423 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:42.674618  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2558) took 3010 ms. Trace:
I20260709 13:17:42.628866 12425 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:42.632980  8361 raft_consensus.cc:2410] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:42.611640  8360 rpcz_store.cc:276] 0709 13:17:39.759949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.760138 (+   189us) service_pool.cc:224] Handling call
0709 13:17:39.760572 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.788265 (+ 27693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.788315 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.788885 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.610927 (+2822042us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:42.610977 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.611052 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.611096 (+    44us) raft_consensus.cc:1685] finished
0709 13:17:42.611120 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.611247 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27185,"raft.queue_time_us":28130,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":10794,"thread_start_us":2789426,"threads_started":1,"wal-append.queue_time_us":193029,"wal-append.run_cpu_time_us":1152,"wal-append.run_wall_time_us":1001189}
W20260709 13:17:43.344595  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.357828  8107 maintenance_manager.cc:419] P e8c3cea2f3524d70be8a4a6e5be1c492: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10054 bytes on disk
I20260709 13:17:43.662603  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:43.360306  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1841) took 3695 ms. Trace:
I20260709 13:17:43.664423  8211 rpcz_store.cc:276] 0709 13:17:39.665071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.665180 (+   109us) service_pool.cc:224] Handling call
0709 13:17:42.556055 (+2890875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.358433 (+802378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.360085 (+  1652us) spinlock_profiling.cc:243] Waited 2.89 s on lock 0x7b54001d4550. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:43.360247 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6639357824}
I20260709 13:17:43.664944  8106 maintenance_manager.cc:643] P e8c3cea2f3524d70be8a4a6e5be1c492: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":374,"lbm_reads_lt_1ms":4}
I20260709 13:17:43.665723  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3caa82d776714435898936cb4c6041c0"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:43.666452  8211 raft_consensus.cc:606] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:43.666774  8211 raft_consensus.cc:614] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:42.550711  8212 rpcz_store.cc:269] 0709 13:17:39.375758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.422499 (+ 46741us) service_pool.cc:224] Handling call
0709 13:17:42.550254 (+3127755us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.669456  8212 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:17:43.354918  8117 rpcz_store.cc:269] 0709 13:17:29.366506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.379406 (+ 12900us) service_pool.cc:224] Handling call
0709 13:17:42.239454 (+12860048us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:39.488540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:39.489192 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:39.489256 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:17:39.489281 (+    25us) tablet.cc:662] Decoding operations
0709 13:17:39.612458 (+123177us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:39.612556 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:39.612597 (+    41us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:17:39.613732 (+  1135us) tablet.cc:701] Row locks acquired
0709 13:17:39.613789 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:17:39.614026 (+   237us) write_op.cc:270] Start()
0709 13:17:39.614156 (+   130us) write_op.cc:276] Timestamp: P: 1783603059613940 usec, L: 0
0709 13:17:39.614178 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:39.615130 (+   952us) log.cc:844] Serialized 3924 byte log entry
0709 13:17:39.754461 (+139331us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fa3070ac 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b
0709 13:17:42.003657 (+2249196us) op_driver.cc:464] REPLICATION: finished
0709 13:17:42.053794 (+ 50137us) write_op.cc:301] APPLY: starting
0709 13:17:42.053906 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:42.054766 (+   860us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:42.054807 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:42.056032 (+  1225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:42.056446 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:17:42.056516 (+    70us) write_op.cc:312] APPLY: finished
0709 13:17:42.056975 (+   459us) log.cc:844] Serialized 77 byte log entry
0709 13:17:42.086857 (+ 29882us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.087062 (+   205us) write_op.cc:454] Released schema lock
0709 13:17:42.087153 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:42.090369 (+  3216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.090398 (+    29us) write_op.cc:454] Released schema lock
0709 13:17:42.539105 (+448707us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd40e32a 00007f31fd393f14 00007f31fd393ec3 00007f31fd393e38 00007f31fd393df3 00007f31fd3930dc 00007f31fd3bce16 00007f31fd3a4cbb 00007f31fd38f39d 00007f31fd392d75
Metrics: {"mutex_wait_us":590484,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":49801,"apply.run_cpu_time_us":17158,"apply.run_wall_time_us":36556,"num_ops":10,"prepare.queue_time_us":203113,"prepare.run_cpu_time_us":93380,"prepare.run_wall_time_us":2514771,"raft.queue_time_us":5152,"raft.run_cpu_time_us":20558,"raft.run_wall_time_us":2529259,"replication_time_us":2389241,"spinlock_wait_cycles":4624028672,"thread_start_us":397628,"threads_started":5,"wal-append.queue_time_us":411693,"wal-append.run_cpu_time_us":4919,"wal-append.run_wall_time_us":1014691}]]}
W20260709 13:17:43.365619  8213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1607) took 3978 ms (client timeout 2057 ms). Trace:
I20260709 13:17:43.670054  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
W20260709 13:17:43.670475  8213 rpcz_store.cc:269] 0709 13:17:39.387731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.428803 (+ 41072us) service_pool.cc:224] Handling call
0709 13:17:43.365520 (+3936717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.670751  8211 raft_consensus.cc:606] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:43.366066 12342 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.671420  8211 raft_consensus.cc:614] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:43.671499 12342 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.376092  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.376732  8287 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:43.372030  8241 debug-util.cc:398] Leaking SignalData structure 0x7b0800386e80 after lost signal to thread 8927
I20260709 13:17:43.382179 12427 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.387300 12424 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.676440 12427 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:43.400701  8369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.596s	user 0.012s	sys 0.036s
I20260709 13:17:43.679754 12342 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.390980 12419 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.680382  8241 debug-util.cc:398] Leaking SignalData structure 0x7b0800390dc0 after lost signal to thread 8955
W20260709 13:17:42.368638  8889 connection.cc:256] RPC call timeout handler was delayed by -1.1892326020001747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:17:43.411502  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:43.683291  8889 connection.cc:256] RPC call timeout handler was delayed by -1.0938326020000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260709 13:17:43.682955 12424 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.683552  8294 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:43.414074  8286 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:43.416538  8114 catalog_manager.cc:5697] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 6 to 8, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.415016  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:43.680416 12419 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.685010  8220 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:43.685415 12424 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.685076  8114 catalog_manager.cc:5697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.686775 12419 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:43.422084  8919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.548s	user 0.006s	sys 0.012s
I20260709 13:17:43.429373 12379 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.688724  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 848) took 3816 ms. Trace:
I20260709 13:17:43.689172  8919 rpcz_store.cc:276] 0709 13:17:39.872794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.872933 (+   139us) service_pool.cc:224] Handling call
0709 13:17:39.873243 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.873427 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:39.873706 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.688377 (+3814671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.688431 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:43.688482 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.688560 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.688672 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":112124,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":43,"thread_start_us":3814310,"threads_started":1,"wal-append.queue_time_us":120416,"wal-append.run_cpu_time_us":1283,"wal-append.run_wall_time_us":1007206}
I20260709 13:17:43.414108 12431 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.453537  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 62389.5us
I20260709 13:17:43.460880 12433 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.453565  8292 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:43.691319 12431 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.691548 12433 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:43.692901  8292 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1699) took 4135 ms (client timeout 1736 ms). Trace:
W20260709 13:17:43.693312  8292 rpcz_store.cc:269] 0709 13:17:39.557125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.557274 (+   149us) service_pool.cc:224] Handling call
0709 13:17:43.692714 (+4135440us) spinlock_profiling.cc:243] Waited 3.88 s on lock 0x7b540005bc54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:43.692837 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8929860480}
I20260709 13:17:43.693733 12431 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.693802 12433 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.694802 12001 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.694757 12431 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:43.695664  8288 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:43.695462 12001 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:17:43.470525  8892 connection.cc:256] RPC call timeout handler was delayed by -1.5422541529999307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 13:17:43.698501 12001 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.463109 12435 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.699091 12407 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:43.699417 12435 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.699743 12407 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.700526 12411 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.701067 12411 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.702020 12435 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.702553 12435 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.702632 12407 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.703161 12411 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.703058 12435 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.703706  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2002) took 3938 ms. Trace:
I20260709 13:17:43.476646 12063 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:43.482789 12079 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.663s	user 0.002s	sys 0.015s
I20260709 13:17:43.483533 12099 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.704363 12428 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.704959 12428 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.705550 12443 consensus_queue.cc:1059] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:43.706091 12099 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.706800 12443 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:43.485678 12148 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.708827 12251 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:43.704123  8369 rpcz_store.cc:276] 0709 13:17:39.765768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.778753 (+ 12985us) service_pool.cc:224] Handling call
0709 13:17:39.779113 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.678999 (+3899886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.679037 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.679463 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.703336 (+ 23873us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:43.703378 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.703470 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.703522 (+    52us) raft_consensus.cc:1685] finished
0709 13:17:43.703534 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.703650 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25612,"raft.queue_time_us":35523,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4930,"thread_start_us":3897289,"threads_started":2,"wal-append.queue_time_us":10192}
I20260709 13:17:43.709236 12251 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:43.710019 12148 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.710175 12251 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.711457 12251 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.489821  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.497375 12241 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.498139 12436 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.712312 12076 raft_consensus.cc:3055] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:43.712764 12076 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:43.488991 12229 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.522753  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 1994) took 3767 ms. Trace:
W20260709 13:17:43.529980  8258 connection.cc:256] RPC call timeout handler was delayed by -2.0002607680000892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 13:17:43.522058 12260 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:43.714470  8258 connection.cc:256] RPC call timeout handler was delayed by -1.9993607680000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 13:17:42.588192 12268 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.537225  8214 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:43.716886 12268 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.714686 12260 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:43.718478  8214 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 552) took 1815 ms (client timeout 1901 ms). Trace:
I20260709 13:17:43.718607  8218 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:43.718899  8214 rpcz_store.cc:269] 0709 13:17:41.902598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.902718 (+   120us) service_pool.cc:224] Handling call
0709 13:17:43.718303 (+1815585us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b5400199e54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:43.718422 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176550144}
I20260709 13:17:43.537194 12234 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.536473 12266 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:43.538093  7081 debug-util.cc:398] Leaking SignalData structure 0x7b080016efa0 after lost signal to thread 8183
I20260709 13:17:43.720322 12260 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.710125  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.543598  8215 raft_consensus.cc:1240] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:43.721511  8369 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:43.722478  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.714174  8368 rpcz_store.cc:276] 0709 13:17:39.755883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.756083 (+   200us) service_pool.cc:224] Handling call
0709 13:17:39.756461 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.758344 (+  1883us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:43.361824 (+3603480us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.522195 (+160371us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.522406 (+   211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.522454 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:43.522496 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.522593 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.522707 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2198,"prepare.queue_time_us":288506,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":85,"raft.queue_time_us":34676,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":1942,"thread_start_us":3739864,"threads_started":4,"wal-append.queue_time_us":56108}
I20260709 13:17:43.536547 12384 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.723510  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.548914 12279 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.551815  8216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1843) took 3886 ms. Trace:
I20260709 13:17:43.724077  8114 catalog_manager.cc:5697] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.724457  8216 rpcz_store.cc:276] 0709 13:17:39.665571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.877072 (+211501us) service_pool.cc:224] Handling call
0709 13:17:39.877403 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.549898 (+3672495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.551639 (+  1741us) spinlock_profiling.cc:243] Waited 3.67 s on lock 0x7b54001b1f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:43.551770 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8444175744}
W20260709 13:17:43.549657 12287 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.685s	user 0.003s	sys 0.031s
I20260709 13:17:43.725437 12384 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:42.360709 12310 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:43.726672 12310 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.727254  8186 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:43.728446 12279 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:43.556329 12442 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.728825 12279 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.557142 12295 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.729336 12279 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.558000 12354 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.732107 12266 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.729770  8367 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:43.734830  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:42.045709 12355 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.729197 12442 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.736879 12355 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.739200 12355 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.564239 12359 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.739349 12442 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.565267 12357 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.594121 12388 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:42.026957 12389 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.741228 12389 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.603804  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1844) took 1136 ms. Trace:
I20260709 13:17:43.744197  8217 rpcz_store.cc:276] 0709 13:17:42.467191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.569861 (+102670us) service_pool.cc:224] Handling call
0709 13:17:43.603593 (+1033732us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400199954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:43.603743 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369885056}
I20260709 13:17:43.744947  8368 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:43.746057  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:43.606381 12393 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.728820 12310 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.748104 12393 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.607060 12394 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.751065  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2008) took 3968 ms. Trace:
I20260709 13:17:43.751166 12394 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.610391 12395 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.611549 12397 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.755874  8186 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:43.756735 12295 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:43.757160 12295 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.757503 12295 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.757613 12397 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.617350 12396 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.618970 12402 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.760541 12402 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:42.194118 12404 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.761981 12404 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.623282 12405 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:42.201998 12406 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.653918  8365 rpcz_store.cc:276] 0709 13:17:39.766051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.622156 (+2856105us) service_pool.cc:224] Handling call
0709 13:17:42.622488 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.645384 (+1022896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.645431 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.645882 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.652550 (+  6668us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:43.652594 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.653138 (+   544us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540010de54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:43.653184 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.653230 (+    46us) raft_consensus.cc:1685] finished
0709 13:17:43.653242 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.653464 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2349101952,"thread_start_us":6245,"threads_started":1,"wal-append.queue_time_us":978}
I20260709 13:17:43.765007 12406 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.765457  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.766261  8365 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:43.767411  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.768666  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.769541  8365 raft_consensus.cc:2410] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:43.770264  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.770311 12404 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.770825  8365 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:43.771665  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:42.427490 12417 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.735952  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.772915 12417 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.773571  8367 raft_consensus.cc:2410] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:43.774493  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:43.775032 12417 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.775216  8367 raft_consensus.cc:2368] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11.
I20260709 13:17:43.656064 12418 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.743734 12389 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.777695 12418 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.656847 12421 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.771728 12406 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.779650 12421 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:43.780377  8219 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:43.780654 12378 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:43.781111  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.781122 12378 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:43.781992  8365 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:43.782397 12378 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.658890  8363 rpcz_store.cc:276] 0709 13:17:39.664256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.664594 (+   338us) service_pool.cc:224] Handling call
0709 13:17:39.678259 (+ 13665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.702664 (+ 24405us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:39.816114 (+113450us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.673724 (+2857610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.673787 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:42.673836 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.674406 (+   570us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.674556 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":171689,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":63,"raft.queue_time_us":8736,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":2943965,"threads_started":3,"wal-append.queue_time_us":170533,"wal-append.run_cpu_time_us":1073,"wal-append.run_wall_time_us":1002238}
I20260709 13:17:43.661412  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2563) took 1156 ms. Trace:
I20260709 13:17:43.785532  8361 rpcz_store.cc:276] 0709 13:17:42.504490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.614941 (+110451us) service_pool.cc:224] Handling call
0709 13:17:43.661325 (+1046384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.673130  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:43.401285  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 1.29406e+06us
I20260709 13:17:43.789155 12268 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:43.681322  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0400 after lost signal to thread 12311
W20260709 13:17:43.792519  8241 debug-util.cc:398] Leaking SignalData structure 0x7b08003c33a0 after lost signal to thread 12316
W20260709 13:17:43.792866  8241 debug-util.cc:398] Leaking SignalData structure 0x7b0800392980 after lost signal to thread 12320
W20260709 13:17:43.793190  8241 debug-util.cc:398] Leaking SignalData structure 0x7b080025af00 after lost signal to thread 12330
I20260709 13:17:43.681733  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8942278c55614601a1290e32997fe007"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
W20260709 13:17:43.683648  8889 connection.cc:256] RPC call timeout handler was delayed by -1.092932602000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:17:43.688417 12379 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.440578  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2010) took 1411 ms. Trace:
W20260709 13:17:43.461829  8332 connection.cc:256] RPC call timeout handler was delayed by -2.6271924789998593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:17:43.462566  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08002eafa0 after lost signal to thread 7079
I20260709 13:17:43.469190 12014 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.471530 12058 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.707751 12428 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.508453  8293 raft_consensus.cc:2393] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:43.714987  8258 connection.cc:256] RPC call timeout handler was delayed by -1.9111607679999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 13:17:43.713629 12076 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:43.729228  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.563948  8290 raft_consensus.cc:1217] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-11.6]   Dedup: 7.4->[10.5-11.6]
W20260709 13:17:42.034257 12360 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 2.188s	user 0.007s	sys 0.017s
I20260709 13:17:43.631732 12410 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.657860 12423 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.783972 12378 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.796011 12435 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:43.797032  8332 connection.cc:256] RPC call timeout handler was delayed by -2.5002924789998815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:17:43.815549  8332 connection.cc:256] RPC call timeout handler was delayed by -2.5002924789998815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:17:43.816102  8332 connection.cc:256] RPC call timeout handler was delayed by -2.38959247899993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 13:17:43.816396  8332 connection.cc:256] RPC call timeout handler was delayed by -2.38959247899993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 13:17:43.816654  8332 connection.cc:256] RPC call timeout handler was delayed by -2.3652924789998906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 13:17:43.816907  8332 connection.cc:256] RPC call timeout handler was delayed by -2.3553924789998746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:17:43.817173  8332 connection.cc:256] RPC call timeout handler was delayed by -2.34009247899985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 13:17:43.817428  8332 connection.cc:256] RPC call timeout handler was delayed by -2.2977924790000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:17:43.817684  8332 connection.cc:256] RPC call timeout handler was delayed by -2.2851924789999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:17:43.817962  8332 connection.cc:256] RPC call timeout handler was delayed by -2.2113924789998691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:17:43.818234  8332 connection.cc:256] RPC call timeout handler was delayed by -2.2041924789998575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:17:43.818501  8332 connection.cc:256] RPC call timeout handler was delayed by -2.19339247899984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 13:17:43.818770  8332 connection.cc:256] RPC call timeout handler was delayed by -2.1690924789998007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:17:43.819073  8332 connection.cc:256] RPC call timeout handler was delayed by -2.1285924789999626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 13:17:43.819368  8332 connection.cc:256] RPC call timeout handler was delayed by -2.1024924789999204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260709 13:17:43.801100  8291 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:43.821278  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2294) took 3776 ms. Trace:
W20260709 13:17:43.821698  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800378460 after lost signal to thread 7079
W20260709 13:17:43.801316  8258 connection.cc:256] RPC call timeout handler was delayed by -1.9111607679999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
W20260709 13:17:43.822568  8258 connection.cc:256] RPC call timeout handler was delayed by -1.6303607679999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2542s for a response
W20260709 13:17:43.822866  8258 connection.cc:256] RPC call timeout handler was delayed by -1.2364395070001137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3792s for a response
W20260709 13:17:43.823182  8258 connection.cc:256] RPC call timeout handler was delayed by -1.0993607679999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31320000000000003s for a response
W20260709 13:17:43.823271  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080005bf20 after lost signal to thread 8152
I20260709 13:17:43.823477  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.824308  8367 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:43.825601  8258 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:43.826275  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.826486  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.803040  8290 pending_rounds.cc:85] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 4
I20260709 13:17:43.827320  8361 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:43.827498  8290 pending_rounds.cc:107] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:43.827845  8290 raft_consensus.cc:2889] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.804822 12423 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:43.823798  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08001afa00 after lost signal to thread 8166
I20260709 13:17:43.828998  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:43.829311  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080005ec40 after lost signal to thread 8183
I20260709 13:17:43.830178  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:43.830464  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad520 after lost signal to thread 8244
I20260709 13:17:43.831287  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:43.831660  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800357740 after lost signal to thread 8319
I20260709 13:17:43.828409  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.832449  8365 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:43.828918  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.827553  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.833616  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:43.832732  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.834287  8365 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:43.834771  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:43.835191  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.835357  8369 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.799026 12379 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.836331  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.821607  8291 rpcz_store.cc:276] 0709 13:17:40.044406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.907597 (+1863191us) service_pool.cc:224] Handling call
0709 13:17:43.800877 (+1893280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.820485 (+ 19608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.821085 (+   600us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b5400387a50. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:43.821220 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4353105280}
I20260709 13:17:43.837550  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:43.845098  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.806260  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:43.797827  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0180 after lost signal to thread 8152
W20260709 13:17:43.800812  8293 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1697) took 4289 ms (client timeout 1859 ms). Trace:
I20260709 13:17:43.799515 12058 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:43.832474  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080005c240 after lost signal to thread 8364
I20260709 13:17:43.879664 12379 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:43.796916  8366 rpcz_store.cc:276] 0709 13:17:42.028964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.392979 (+1364015us) service_pool.cc:224] Handling call
0709 13:17:43.401297 (+  8318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.432585 (+ 31288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.432615 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.432659 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:43.432687 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.440253 (+  7566us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b5400355554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:43.440323 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.440507 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71419648}
W20260709 13:17:43.880069  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800389a40 after lost signal to thread 8367
I20260709 13:17:43.880107 12379 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:43.880430  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08000559c0 after lost signal to thread 8244
W20260709 13:17:43.799108  8889 connection.cc:256] RPC call timeout handler was delayed by -1.0650326020002012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:17:43.880643  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080027dae0 after lost signal to thread 8369
W20260709 13:17:43.879509  8293 rpcz_store.cc:269] 0709 13:17:39.511682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.511941 (+   259us) service_pool.cc:224] Handling call
0709 13:17:43.800621 (+4288680us) spinlock_profiling.cc:243] Waited 3.98 s on lock 0x7b5400387a54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:43.800749 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9149239680}
W20260709 13:17:43.881182  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08003713c0 after lost signal to thread 8287
W20260709 13:17:43.881613  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800148220 after lost signal to thread 8393
I20260709 13:17:43.880643  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:43.881934  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08002efee0 after lost signal to thread 8295
W20260709 13:17:43.881986  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003bad60 after lost signal to thread 8394
I20260709 13:17:43.880713 12379 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:43.882215  8366 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
W20260709 13:17:43.882835  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08003edc80 after lost signal to thread 8319
W20260709 13:17:43.883424  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08003c64e0 after lost signal to thread 8332
I20260709 13:17:43.883877  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:43.884449  8390 debug-util.cc:398] Leaking SignalData structure 0x7b080036f0c0 after lost signal to thread 8393
W20260709 13:17:43.884758  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6ca0 after lost signal to thread 8394
I20260709 13:17:43.885366  8369 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:43.866417  8363 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:43.800029  8289 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:43.833799  8360 raft_consensus.cc:2410] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:17:43.819907  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:43.877331 12394 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:43.838274 12357 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:43.805243 12076 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:43.889016  8360 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:43.889657  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2564) took 1384 ms. Trace:
I20260709 13:17:43.889990  8360 rpcz_store.cc:276] 0709 13:17:42.504731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.888410 (+1383679us) service_pool.cc:224] Handling call
0709 13:17:43.888696 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.889391 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.889605 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.825316  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:43.891309  8360 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:43.751438  8362 rpcz_store.cc:276] 0709 13:17:39.782392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.387099 (+3604707us) service_pool.cc:224] Handling call
0709 13:17:43.387373 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.677314 (+289941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.677347 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.677827 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.710412 (+ 32585us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:43.710466 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.750675 (+ 40209us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400356454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:43.750725 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.750772 (+    47us) raft_consensus.cc:1685] finished
0709 13:17:43.750785 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.751012 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6406,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":665929472,"thread_start_us":32174,"threads_started":1,"wal-append.queue_time_us":8758}
W20260709 13:17:43.882720  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800223d80 after lost signal to thread 8889
W20260709 13:17:43.885564  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2240 after lost signal to thread 8927
W20260709 13:17:43.891986  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08000e06e0 after lost signal to thread 8891
W20260709 13:17:43.892325  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800223d60 after lost signal to thread 8892
W20260709 13:17:43.892408  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8040 after lost signal to thread 8955
W20260709 13:17:43.892805  8390 debug-util.cc:398] Leaking SignalData structure 0x7b080015d1a0 after lost signal to thread 8956
W20260709 13:17:43.892987  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800379460 after lost signal to thread 8919
W20260709 13:17:43.893045  8390 debug-util.cc:398] Leaking SignalData structure 0x7b080023b4c0 after lost signal to thread 11809
I20260709 13:17:43.867035  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:43.893673  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080037f9e0 after lost signal to thread 8924
I20260709 13:17:43.894151  8367 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:43.894412  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080033dde0 after lost signal to thread 8927
I20260709 13:17:43.894547 12428 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:43.894646  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 74818.7us
W20260709 13:17:43.895262  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080028f3e0 after lost signal to thread 8955
I20260709 13:17:43.895148 12428 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:43.893695  8390 debug-util.cc:398] Leaking SignalData structure 0x7b080034c520 after lost signal to thread 11857
W20260709 13:17:43.881088  8889 connection.cc:256] RPC call timeout handler was delayed by -1.0650326020002012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:17:43.895753  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08003790e0 after lost signal to thread 11997
I20260709 13:17:43.895709 12428 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:43.896310  8390 debug-util.cc:398] Leaking SignalData structure 0x7b0800397620 after lost signal to thread 12073
I20260709 13:17:43.896377  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2014) took 1300 ms. Trace:
W20260709 13:17:43.896745  8390 debug-util.cc:398] Leaking SignalData structure 0x7b0800361fa0 after lost signal to thread 12199
W20260709 13:17:43.897073  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08003ff860 after lost signal to thread 12230
W20260709 13:17:43.897481  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc9e0 after lost signal to thread 12251
I20260709 13:17:43.893162  8362 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:17:43.898075  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0340 after lost signal to thread 12273
W20260709 13:17:43.898325  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbd40 after lost signal to thread 12279
I20260709 13:17:43.898375  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2013) took 1303 ms. Trace:
W20260709 13:17:43.895587  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08000a9020 after lost signal to thread 8956
W20260709 13:17:43.899443  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003cacc0 after lost signal to thread 11809
I20260709 13:17:43.898874  8362 rpcz_store.cc:276] 0709 13:17:42.595340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.892400 (+1297060us) service_pool.cc:224] Handling call
0709 13:17:43.892785 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.898129 (+  5344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.898319 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:43.899840  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2660 after lost signal to thread 11857
W20260709 13:17:43.900121  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3ae0 after lost signal to thread 11997
W20260709 13:17:43.900350  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080017c360 after lost signal to thread 12000
W20260709 13:17:43.900573  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002d54e0 after lost signal to thread 12001
W20260709 13:17:43.900774  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5bc0 after lost signal to thread 12014
W20260709 13:17:43.900969  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080040d560 after lost signal to thread 12058
W20260709 13:17:43.901171  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080038a560 after lost signal to thread 12063
W20260709 13:17:43.901363  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800344580 after lost signal to thread 12073
I20260709 13:17:43.901278  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2015) took 1305 ms. Trace:
W20260709 13:17:43.901816  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080033c420 after lost signal to thread 12079
W20260709 13:17:43.902097  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080035ce60 after lost signal to thread 12099
W20260709 13:17:43.902362  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2440 after lost signal to thread 12199
W20260709 13:17:43.902592  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed360 after lost signal to thread 12229
W20260709 13:17:43.902908  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1780 after lost signal to thread 12230
W20260709 13:17:43.903198  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800372dc0 after lost signal to thread 12234
I20260709 13:17:43.902657 12423 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:43.898772  8390 debug-util.cc:398] Leaking SignalData structure 0x7b08000ecee0 after lost signal to thread 12354
I20260709 13:17:43.904879 12423 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.905658 12428 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.906786 12354 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.907802 12428 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:43.891685  8360 pending_rounds.cc:85] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 6
I20260709 13:17:43.908550  8360 pending_rounds.cc:107] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:43.909373 12354 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:43.908818  8360 raft_consensus.cc:2889] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.910530  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2565) took 1405 ms. Trace:
I20260709 13:17:43.894752  8368 raft_consensus.cc:2376] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13. Re-sending same reply.
I20260709 13:17:43.915035  8360 rpcz_store.cc:276] 0709 13:17:42.504960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.890731 (+1385771us) service_pool.cc:224] Handling call
0709 13:17:43.890997 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.910245 (+ 19248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.910462 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:43.882325  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 76145.9us
I20260709 13:17:43.916366  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2016) took 1320 ms. Trace:
I20260709 13:17:43.895510  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:43.917229 12421 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:43.916705  8368 rpcz_store.cc:276] 0709 13:17:42.596266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.915527 (+1319261us) service_pool.cc:224] Handling call
0709 13:17:43.915871 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.916097 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.916118 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.916155 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:43.916184 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.916232 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.916319 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.917937 12421 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:43.918686  8368 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:43.918954  8186 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:43.919803 12418 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:43.919904  8368 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:17:43.920423 12418 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.920907 12418 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:43.903427  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800342e20 after lost signal to thread 12241
I20260709 13:17:43.918152  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:43.912725  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.775501 12295 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.896926  8367 rpcz_store.cc:276] 0709 13:17:42.595680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.895212 (+1299532us) service_pool.cc:224] Handling call
0709 13:17:43.895868 (+   656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.896066 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.896090 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.896134 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:43.896168 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.896223 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.896323 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.923614  8365 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:43.924422  8362 rpcz_store.cc:276] 0709 13:17:42.595969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.900364 (+1304395us) service_pool.cc:224] Handling call
0709 13:17:43.900688 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.900888 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.900915 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.901002 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:43.901037 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.901096 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.901226 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:43.957633  8261 leader_election.cc:400] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11.
I20260709 13:17:43.969048  8261 leader_election.cc:403] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.933672  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.971825  8289 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:43.972105  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:43.973024  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.974123  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.974287  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:43.974668  8289 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:43.931991 12421 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:43.976436 12421 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:43.977022 12421 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.933349  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:43.980479  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.981155  8293 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:43.982147  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.982722  8293 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:43.983582  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.985885 12355 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:43.975625  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.989177  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.990027  8289 raft_consensus.cc:2410] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:43.990749  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.991454 12073 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:43.991883 12073 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:43.992089  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.992326 12073 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:43.993250  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.993860  8293 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:43.994689  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.934417  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.996942 12431 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:43.997221  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.998028  8291 raft_consensus.cc:2393] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:43.998790  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.998926 12431 raft_consensus.cc:697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:43.934866  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:43.999902 12431 consensus_queue.cc:237] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:43.927107  8889 connection.cc:256] RPC call timeout handler was delayed by -1.723739427000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2847s for a response
I20260709 13:17:43.929592 12418 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:43.936237  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.936560  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.936968  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.933776  8361 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:43.937695  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.941182  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:43.951265  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 50989.5us
I20260709 13:17:43.935595  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:43.929764  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080039f1e0 after lost signal to thread 12244
I20260709 13:17:43.933506  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2009) took 1904 ms. Trace:
I20260709 13:17:43.931187  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:44.040166  8889 connection.cc:256] RPC call timeout handler was delayed by -1.3367394270001114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32770000000000005s for a response
W20260709 13:17:44.020000  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.069146  8889 connection.cc:256] RPC call timeout handler was delayed by -1.3367394270001114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32770000000000005s for a response
W20260709 13:17:44.068310  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800352100 after lost signal to thread 12251
I20260709 13:17:44.043452  8213 raft_consensus.cc:606] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:44.070312  8294 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:44.007184  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 57485.4us
I20260709 13:17:44.069875  8295 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:44.006253  8363 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
W20260709 13:17:44.070204  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800396460 after lost signal to thread 12256
I20260709 13:17:44.074303  8366 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:17:44.074673  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff080 after lost signal to thread 12258
W20260709 13:17:44.074908  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8660 after lost signal to thread 12260
I20260709 13:17:44.068905  8364 rpcz_store.cc:276] 0709 13:17:42.028678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.391705 (+1363027us) service_pool.cc:224] Handling call
0709 13:17:43.391955 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:43.745425 (+353470us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:43.745781 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 13:17:43.932660 (+186879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:43.932710 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:43.932751 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.933297 (+   546us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400355054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:43.933338 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.933451 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3116,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":113,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":81,"spinlock_wait_cycles":812293376,"thread_start_us":186243,"threads_started":1,"wal-append.queue_time_us":180141}
I20260709 13:17:44.072299  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:44.075196  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3dc0 after lost signal to thread 12273
W20260709 13:17:44.078382  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800298dc0 after lost signal to thread 12279
W20260709 13:17:44.078781  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003d55a0 after lost signal to thread 12286
W20260709 13:17:44.079160  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080039eb60 after lost signal to thread 12287
W20260709 13:17:44.079526  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080031ed80 after lost signal to thread 12295
W20260709 13:17:44.080230  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003e19a0 after lost signal to thread 12310
I20260709 13:17:44.070995  8292 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:43.995716  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:43.948243 12396 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.128s
I20260709 13:17:44.076278  8927 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:44.077684  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 102555us
W20260709 13:17:44.077764  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 136641us
W20260709 13:17:44.087450  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003ddec0 after lost signal to thread 12350
W20260709 13:17:44.087888  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc2e0 after lost signal to thread 12354
W20260709 13:17:44.088243  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800342360 after lost signal to thread 12355
W20260709 13:17:44.088543  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800314260 after lost signal to thread 12356
W20260709 13:17:44.088840  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002acb80 after lost signal to thread 12357
W20260709 13:17:44.089151  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3d40 after lost signal to thread 12359
W20260709 13:17:44.089490  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6680 after lost signal to thread 12360
W20260709 13:17:44.089811  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfb60 after lost signal to thread 12365
W20260709 13:17:44.090135  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003707e0 after lost signal to thread 12378
W20260709 13:17:44.090445  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003f8e80 after lost signal to thread 12380
W20260709 13:17:44.090741  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080032b5e0 after lost signal to thread 12381
W20260709 13:17:44.091048  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800164360 after lost signal to thread 12382
W20260709 13:17:44.091339  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9400 after lost signal to thread 12383
W20260709 13:17:44.092387  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 161230us
I20260709 13:17:44.092372  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.093034  8258 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:44.093550  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080012f8a0 after lost signal to thread 12385
I20260709 13:17:44.093662  8919 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:17:44.094003  8316 debug-util.cc:398] Leaking SignalData structure 0x7b0800151840 after lost signal to thread 12387
I20260709 13:17:44.094198 12251 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:43.942967 12295 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:44.096863  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003ec2e0 after lost signal to thread 12388
I20260709 13:17:44.098073  8186 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:44.095069  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:43.951131 12357 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:44.096766  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2561) took 1592 ms. Trace:
I20260709 13:17:44.096820  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:44.099457  8366 rpcz_store.cc:276] 0709 13:17:42.503982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.885034 (+1381052us) service_pool.cc:224] Handling call
0709 13:17:44.074071 (+189037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.074771 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.096568 (+ 21797us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400354150. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:44.096706 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433861888}
I20260709 13:17:44.100847  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:43.950405 12394 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:44.093832 12458 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.148s	user 0.009s	sys 0.000s
W20260709 13:17:44.096556 12459 log.cc:927] Time spent T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.008s
I20260709 13:17:43.948714 12354 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:17:43.947738 12402 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.147s
I20260709 13:17:44.108104  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:43.947268 12417 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.151s
W20260709 13:17:44.093272 12460 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.126s	user 0.006s	sys 0.003s
W20260709 13:17:44.110427 12462 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.127s	user 0.004s	sys 0.000s
I20260709 13:17:44.040518 12397 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:17:44.110862  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.127882  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.128295  8217 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:44.128800  8219 raft_consensus.cc:2410] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:44.106374  8924 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.947229 12379 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.111121  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.092424 12423 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:44.109275 12268 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:43.935014 12279 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.117223  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.115952  8186 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:44.094740 12382 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:44.125067 12457 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.147s	user 0.005s	sys 0.005s
I20260709 13:17:44.113317  8261 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:44.119738  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.100382 12383 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:44.102177 12357 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:44.110459  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.120728  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:44.122915  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.111368 12076 consensus_queue.cc:1059] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:17:44.125138 12454 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.145s	user 0.000s	sys 0.010s
I20260709 13:17:44.124984 12395 consensus_queue.cc:1059] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:44.125928  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.149344  8212 raft_consensus.cc:2393] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:44.126605  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.108856 12428 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:44.151957 12379 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:44.106465 11997 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:44.133347  8216 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:44.134177  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 429626us
I20260709 13:17:44.154706  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:44.155346  8368 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:44.121450 12389 raft_consensus.cc:2764] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:44.156559  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:44.136233 12382 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:44.123972  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:44.111312 12443 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:44.106521 12410 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:17:44.144256  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2562) took 1640 ms. Trace:
I20260709 13:17:44.163059  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.163491  8919 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:44.162365  8369 rpcz_store.cc:276] 0709 13:17:42.504252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.886136 (+1381884us) service_pool.cc:224] Handling call
0709 13:17:43.886419 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.903905 (+ 17486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.903945 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.904442 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.946104 (+ 41662us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:43.946145 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.946218 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.144075 (+197857us) raft_consensus.cc:1685] finished
0709 13:17:44.144094 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.144206 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7497,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":41248,"threads_started":1,"wal-append.queue_time_us":40441}
I20260709 13:17:44.142841 12058 raft_consensus.cc:2804] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:44.106215 12435 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:44.147534 12342 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:17:44.156064  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.156622  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.156939  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:44.119047 12391 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:44.157480  8211 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 7: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:44.105943  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080038adc0 after lost signal to thread 12389
I20260709 13:17:44.157979  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.138252 12396 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:44.158972  8921 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:44.139423 12383 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.180150 12383 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.174439 12391 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.180809 12391 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:44.181675 12355 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11.
I20260709 13:17:44.154045 12295 consensus_queue.cc:1059] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:17:44.182688  8922 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:44.183636  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.138017 12268 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:44.183887 12279 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:44.184180  8922 raft_consensus.cc:2376] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7. Re-sending same reply.
I20260709 13:17:44.184868  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.184736 12268 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.185153  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.185746  8922 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.185935  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.186652  8926 raft_consensus.cc:2393] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 12: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:44.187698  8926 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:44.175184 12058 raft_consensus.cc:697] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:44.179257 12396 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.160818 12394 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.189514  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:44.182689 12295 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:44.190572 12295 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:44.191354 12295 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.192381  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:44.192564 12295 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.193118  8211 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:44.174307 12357 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.194075 12058 consensus_queue.cc:237] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.194624 12357 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.161806  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.169263 12389 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:44.196346  8925 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:44.171083 12428 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:44.197645  8925 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:44.199317 12396 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.142355  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:44.200631  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 58339.9us
I20260709 13:17:44.146528  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:44.166891  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:44.201306  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:44.201897 12443 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:44.148231 12258 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:44.202286 12443 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.202527 12258 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.202661 12443 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.202921 12258 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.202941  8924 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:44.203550 12428 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:44.167523  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.204788  8220 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:44.172175  8364 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:44.203039 12355 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:44.180168  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.169212 11997 raft_consensus.cc:3055] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:44.206866 11997 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:44.171911  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.143477 12397 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:17:44.161007 12382 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.178706  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.161631  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.197321 12421 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.187520 12073 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.204002 12428 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:44.175240  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1260 after lost signal to thread 12391
I20260709 13:17:44.172154  8927 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:44.205904 12355 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:44.231266  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.215250  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.245779 12418 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:44.212563  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.207990 12389 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:44.248202 12413 raft_consensus.cc:3055] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:44.245388 12414 raft_consensus.cc:3055] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:44.208787  8923 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:44.207510  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:44.264585  8367 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:44.263541  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.281709  8927 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:44.271629  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:44.265316  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.283648  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.283797  8926 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:44.284473  8927 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:17:44.273285  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003f71a0 after lost signal to thread 12392
W20260709 13:17:44.285301  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080037abc0 after lost signal to thread 12393
I20260709 13:17:44.284334  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:44.286537  8360 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.257745  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:44.286108  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002b7f60 after lost signal to thread 12395
I20260709 13:17:44.274191  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:44.276001  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.276424 12413 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:44.224025  8364 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:44.272825  8925 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:44.273895  8921 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.280155  8368 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:44.287652  8924 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:44.207608  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 61161.2us
W20260709 13:17:44.283823  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 76719.6us
I20260709 13:17:44.293427 12079 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:44.294034  8216 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:44.290657  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:44.300376  8183 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:44.298743  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.298823  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:44.291730  8919 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:44.301426  8215 raft_consensus.cc:2410] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:17:44.270685  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet a7984a0dbb5d4008936cec86daf790e9: Illegal state: Replica 9e95b04d03d241329435b6d08dd1f236 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:44.302259  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:44.302721  8889 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:44.303517  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:44.303725 12014 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:44.304559 12406 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:44.304922  8211 raft_consensus.cc:2376] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12. Re-sending same reply.
I20260709 13:17:44.305159 12079 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:44.304979 12406 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.306083 12079 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.306658 12354 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:44.306293 12413 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.302817  8218 raft_consensus.cc:2376] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12. Re-sending same reply.
I20260709 13:17:44.307822 12413 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:44.296921  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:44.278756  8922 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:44.318045  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:44.322327  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080032df60 after lost signal to thread 12396
W20260709 13:17:44.322690  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9300 after lost signal to thread 12397
W20260709 13:17:44.322993  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080032dcc0 after lost signal to thread 12399
W20260709 13:17:44.323415  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002847e0 after lost signal to thread 12400
W20260709 13:17:44.323670  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08002b08c0 after lost signal to thread 12401
W20260709 13:17:44.323925  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003643a0 after lost signal to thread 12402
I20260709 13:17:44.308413 12428 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.306339 12406 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:44.328783  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 127538us
I20260709 13:17:44.330252  8923 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 9: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:44.330816  8368 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:44.332901  8183 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:44.317058  8186 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:44.266860 12073 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:44.378453  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:44.378543  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:44.281608 12414 raft_consensus.cc:740] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:44.379441  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:44.380101  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:44.381958  8289 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:44.404379  8287 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:44.327616 12395 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:44.268667 12421 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:44.378786  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:44.395823  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 61787.7us
I20260709 13:17:44.269631 12443 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.456056  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:44.458701  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:44.459657  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:44.398152  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:44.460120 12099 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:44.460359  8367 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.460918 12099 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:44.461871 12229 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:44.462333 12099 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:44.462745 12099 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.463090 12099 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.463645 12234 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:44.464077 12234 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.464469 12234 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.251425 12391 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.467962 12391 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:44.299427 12359 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:44.425022  8360 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:44.385108  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.434834  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:44.272110 12396 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.471207  8183 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:44.472175 12396 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:44.472280 12391 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:44.207672 11997 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.473272 11997 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.473448  8183 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:44.474193 12391 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:44.402155  8921 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:44.474646 12391 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:44.475448  8927 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:44.475507 12391 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.334124 12076 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:17:44.480448  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:44.407101  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 90138us
I20260709 13:17:44.334247 12417 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:44.484273  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:44.488134  8293 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.334524 12354 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:44.490886 12354 raft_consensus.cc:697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:44.485961  8186 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:44.421777 12342 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:44.498816  8294 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:44.498684  8186 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:44.434567 12395 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.501827  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:44.487812 12458 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:44.507239  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:44.515614  8364 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:44.508941  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:44.497871 12396 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:44.421276 12397 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:17:44.395900 12290 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:17:44.480237 12431 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:17:44.435285 12389 consensus_queue.cc:1059] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:17:44.526235  8927 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:44.527700  8364 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:44.489833  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:44.515633 12395 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:44.551910 12443 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:44.528723 12342 raft_consensus.cc:697] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:44.552475 12258 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.568457 12099 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.570482 12234 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.571478  8367 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:44.520272 12418 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:44.545493  8293 raft_consensus.cc:2410] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:44.575543  8186 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:44.576216  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 86452.7us
I20260709 13:17:44.533846 12396 raft_consensus.cc:697] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:44.591926  8214 raft_consensus.cc:606] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:44.610752  8214 raft_consensus.cc:614] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:44.488543 12355 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.602893 12423 raft_consensus.cc:3055] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:44.574271 12266 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:44.608071  8369 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:44.578299 12417 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:44.615231  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.618013  8286 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:44.622025  8183 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:44.613404 12295 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:44.614379 12423 raft_consensus.cc:740] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:44.617063 12266 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:44.639740  8183 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:44.619345 12417 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.643853 12229 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:44.646368 12402 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:17:44.652127 12234 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:44.653999  8214 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fea6012070404ef6b810517d977625da"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:44.655272 12099 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:44.656383 12396 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.657582 12342 consensus_queue.cc:237] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.630715 12418 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:44.689364 12418 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.536446 12354 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.681172  8214 raft_consensus.cc:606] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:44.722855  8214 raft_consensus.cc:614] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:44.655761  8287 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:44.659940 12417 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:44.727090  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.727883  8919 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.684016  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:44.650942 12295 raft_consensus.cc:697] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:44.637741 12414 consensus_queue.cc:260] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.734546  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:44.736887  8926 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:44.736969  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.701025 12394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.025s
I20260709 13:17:44.660588 12383 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:44.760811  8183 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:44.769673  8919 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:44.772181  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:44.742858 12394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.009s	sys 0.025s
I20260709 13:17:44.824054  8212 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:44.809762 12414 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.814246 12014 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:44.856208  8926 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
W20260709 13:17:44.855635  8220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.028s
W20260709 13:17:44.860417  8220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.008s	sys 0.028s
I20260709 13:17:44.850999 12491 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:44.824110 12402 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:44.871841 12391 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:44.872705 12279 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:44.770463 12423 consensus_queue.cc:260] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:44.898299  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.876303 12014 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:17:44.893303  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.810118 12266 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:44.900785  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 507750us
W20260709 13:17:44.886529  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 505169us
I20260709 13:17:44.884658 12258 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:44.905906  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.887112 12477 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.936887 12477 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:44.939582 12477 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:44.894217 12391 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.935508  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:44.879206 12295 consensus_queue.cc:237] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:44.950659  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 178557us
W20260709 13:17:44.951016  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 267060us
I20260709 13:17:44.934602 12079 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:44.951202 12466 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:17:44.961014  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:44.960711  8889 leader_election.cc:304] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:44.957949  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:44.950017 12266 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.941260 12378 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:17:44.940284 12394 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:17:44.962442 12391 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.989162  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:44.993974  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:44.996595  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:44.989080 12471 log.cc:927] Time spent T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Append to log took a long time: real 0.171s	user 0.001s	sys 0.003s
I20260709 13:17:44.978504 12410 raft_consensus.cc:2804] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:45.010432  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.012645 12058 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:45.013221 12058 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:45.014132 12058 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:44.989113 12476 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:17:44.986869 12383 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:44.971354 12079 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.030619 12491 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:45.025924  8332 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.010s	sys 0.021s
I20260709 13:17:45.032300  8183 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.017318  8258 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:45.030231 12410 raft_consensus.cc:697] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:45.007526 12234 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:45.061559  8332 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.010s	sys 0.021s
W20260709 13:17:45.072412  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 750419us
W20260709 13:17:45.038760 12464 log.cc:927] Time spent T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 13:17:45.038725 12406 consensus_meta.cc:287] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.711s	user 0.004s	sys 0.008s
W20260709 13:17:45.064073  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 46824.4us
I20260709 13:17:45.061314 12491 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.072103 12234 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:45.072444 12460 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:17:45.082616  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.074651 12479 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.010290 12014 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.090355  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:45.088698 12382 consensus_meta.cc:287] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.000s
I20260709 13:17:45.093735 12489 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:45.093909  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 61944us
I20260709 13:17:45.087052 12491 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.103328 12475 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.100924 12421 raft_consensus.cc:3055] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:45.077240 12076 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:17:45.087966 12234 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.110749  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.107262  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:45.080655 12406 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.082821 12413 consensus_queue.cc:1059] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:17:45.121727  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.107419 12473 log.cc:927] Time spent T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:17:45.145823  8183 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.110805 12428 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:45.160883  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:45.163203  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.162240  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.165779  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.164132  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.171167  8367 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:45.171329  8294 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.172454  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.171271  8293 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.120690 12421 raft_consensus.cc:740] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:45.152138 11997 consensus_meta.cc:287] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.678s	user 0.004s	sys 0.009s
I20260709 13:17:45.176426  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.148125 12418 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:45.111048 12382 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.188230  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.195469 12496 raft_consensus.cc:3060] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.161091 12428 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:45.198136  8367 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:45.160609 12402 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.109601 12497 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
W20260709 13:17:45.204965  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 97810.5us
W20260709 13:17:45.262374  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 58936.8us
I20260709 13:17:45.178467 12396 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:45.263772  8367 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:17:45.265344  8364 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:45.125010 12475 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.268823  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:45.269578  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.269903  8926 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:45.272634  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:45.273422  8919 raft_consensus.cc:2393] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:45.274609 12467 log.cc:927] Time spent T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.457s	user 0.000s	sys 0.003s
I20260709 13:17:45.275616  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:45.276281  8922 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:45.277329  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:45.278801  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:45.279398  8923 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:45.274472  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:45.281576  8919 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.281317  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:45.283442  8922 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:45.283823  8922 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:45.279623 12421 consensus_queue.cc:260] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.284615  8922 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.285709  8922 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:45.290212 12485 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:17:45.290381  8287 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:45.291443  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.292315  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.293416  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:45.294216 12498 log.cc:927] Time spent T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:45.294391  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.270198  8290 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:45.266472  8367 pending_rounds.cc:85] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 8
I20260709 13:17:45.295622  8367 pending_rounds.cc:107] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:17:45.295579  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.296114  8367 raft_consensus.cc:2889] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.296321  8290 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
W20260709 13:17:45.292470 12481 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:17:45.197209 12378 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.271107  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.297399  8293 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:45.299299  8919 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:45.299503  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.299882  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.301429  8928 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:45.301373  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:45.173765 12431 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:45.316565  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.317186  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.152932 12480 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:17:45.333415  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.334173  8215 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:45.302419  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 571) took 1005 ms. Trace:
I20260709 13:17:45.334621  8220 rpcz_store.cc:276] 0709 13:17:44.296667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.296775 (+   108us) service_pool.cc:224] Handling call
0709 13:17:44.297071 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.297361 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.297388 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.304421 (+  7033us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.861958 (+557537us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:44.862013 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.862107 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.302215 (+440108us) raft_consensus.cc:1685] finished
0709 13:17:45.302237 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.302362 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2081,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8807,"thread_start_us":557149,"threads_started":1,"wal-append.queue_time_us":661329}
I20260709 13:17:45.206223 12428 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:45.322631  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.185966 12397 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:17:45.333981  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.323284  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.339294  8216 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
I20260709 13:17:45.327325  8922 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:17:45.332948  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.341148  8218 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:45.205355 12418 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:45.302357  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 101379us
I20260709 13:17:45.337128  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.342337  8922 pending_rounds.cc:85] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 9
I20260709 13:17:45.343469  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.346757  8295 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:45.346788  8922 pending_rounds.cc:107] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:17:45.157011 12410 consensus_queue.cc:237] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:45.344591  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.350379  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.343592  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.351343  8215 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:45.301288 12076 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:45.347913  8922 raft_consensus.cc:2889] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:45.348986  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 160822us
I20260709 13:17:45.346920  8211 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:45.354264  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.360066  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.361968  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.370411  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:45.388931  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.295342 12383 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:17:45.402697  8218 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:45.405040  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.406288  8183 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.410276  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.414112  8183 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.317377 12290 consensus_queue.cc:1059] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 13:17:45.364863 12484 log.cc:927] Time spent T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260709 13:17:45.420261  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.434432  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.439945  8292 raft_consensus.cc:2368] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9.
I20260709 13:17:45.440841  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:45.443599  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.449401  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2599) took 1156 ms. Trace:
I20260709 13:17:45.449956  8363 rpcz_store.cc:276] 0709 13:17:44.292698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.292805 (+   107us) service_pool.cc:224] Handling call
0709 13:17:44.303774 (+ 10969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.304134 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:44.694784 (+390650us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.028844 (+334060us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.029373 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.029550 (+   177us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:45.029585 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.029657 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.449161 (+419504us) raft_consensus.cc:1685] finished
0709 13:17:45.449180 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.449323 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23203,"prepare.queue_time_us":24126,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":11459,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":21413,"thread_start_us":582567,"threads_started":2,"wal-append.queue_time_us":411038}
I20260709 13:17:45.465981  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.470304  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.410173 12479 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:17:45.473484  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.484586  8295 raft_consensus.cc:2368] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10.
I20260709 13:17:45.473608  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.488075 12076 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.488688 12076 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.490824  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:45.491148  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.491510  8292 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.491883  8289 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:45.492998  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.493383  8293 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:45.494364  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.496479  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.497623  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.498667  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:45.499243  8220 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.500097  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:45.500626  8214 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.501067  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.501757  8218 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:45.503187  8219 raft_consensus.cc:1240] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.506181 12099 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:45.506588 12099 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:45.507318 12099 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.508495 12099 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.509359  8220 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:45.510707  8295 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:45.508086  8292 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
W20260709 13:17:45.512246 12395 consensus_meta.cc:287] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.004s
I20260709 13:17:45.512866 12395 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.514966 12406 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:45.516628 12493 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
W20260709 13:17:45.522485 12469 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.705s	user 0.002s	sys 0.000s
I20260709 13:17:45.461879 12489 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:45.475958 12421 raft_consensus.cc:3060] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:45.477366 12465 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.704s	user 0.003s	sys 0.003s
W20260709 13:17:45.478432 12470 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.661s	user 0.001s	sys 0.002s
I20260709 13:17:45.532007  8920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56040 (request call id 647) took 1373 ms. Trace:
I20260709 13:17:45.532496  8920 rpcz_store.cc:276] 0709 13:17:44.158527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.158648 (+   121us) service_pool.cc:224] Handling call
0709 13:17:44.165755 (+  7107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.166078 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.166126 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.170064 (+  3938us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.240959 (+ 70895us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18001457e0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:17:44.609463 (+368504us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:44.609502 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.609565 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.476776 (+867211us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:45.531718 (+ 54942us) raft_consensus.cc:1685] finished
0709 13:17:45.531746 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.531916 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4750,"spinlock_wait_cycles":137428608,"thread_start_us":367969,"threads_started":1,"wal-append.queue_time_us":588157}
I20260709 13:17:45.540390 12079 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.461664 12379 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:45.541604 12379 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.542148 12379 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:45.545189 12502 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 13:17:45.546590  8288 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2332) took 1166 ms. Trace:
I20260709 13:17:45.478649  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:45.467659 12058 raft_consensus.cc:3055] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:45.508347  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:45.548022 12058 raft_consensus.cc:740] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:45.548223  8215 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.546983  8288 rpcz_store.cc:276] 0709 13:17:44.380071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.380208 (+   137us) service_pool.cc:224] Handling call
0709 13:17:44.380607 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.760655 (+380048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.760690 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.851081 (+ 90391us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.069376 (+218295us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:45.069688 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.070071 (+   383us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.544519 (+474448us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:45.546244 (+  1725us) raft_consensus.cc:1685] finished
0709 13:17:45.546272 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.546522 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13866,"raft.queue_time_us":39549,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":26546,"spinlock_wait_cycles":43995008,"thread_start_us":553652,"threads_started":2,"wal-append.queue_time_us":312454}
I20260709 13:17:45.444199 12516 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:45.548980 12058 consensus_queue.cc:260] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.550179 12058 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:45.465549 12378 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:45.499341 12495 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:17:45.474763 12509 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:17:45.552351 12518 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:45.488741 12500 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:17:45.554548  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2039) took 1188 ms. Trace:
I20260709 13:17:45.554901  8368 rpcz_store.cc:276] 0709 13:17:44.366458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.366643 (+   185us) service_pool.cc:224] Handling call
0709 13:17:44.367066 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.721830 (+354764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.721863 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.726934 (+  5071us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.038814 (+311880us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:45.038849 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.038915 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.554331 (+515416us) raft_consensus.cc:1685] finished
0709 13:17:45.554351 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.554482 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58572,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":47352,"thread_start_us":577711,"threads_started":2,"wal-append.queue_time_us":423740}
I20260709 13:17:45.556125 12423 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:45.559139 12417 consensus_meta.cc:287] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.000s
I20260709 13:17:45.559902  8215 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:45.561219 12475 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.466147 12443 consensus_queue.cc:1059] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 13:17:45.562860 12472 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.790s	user 0.004s	sys 0.002s
I20260709 13:17:45.565467  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2598) took 1275 ms. Trace:
I20260709 13:17:45.565876  8366 rpcz_store.cc:276] 0709 13:17:44.290240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.290383 (+   143us) service_pool.cc:224] Handling call
0709 13:17:45.565246 (+1274863us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5400155c54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:45.565382 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350852352}
W20260709 13:17:45.567032 12391 consensus_meta.cc:287] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.002s
W20260709 13:17:45.567858  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.568202 12489 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.568671 12489 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.568240  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2597) took 1282 ms. Trace:
I20260709 13:17:45.572592 12382 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:45.571128 12489 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:45.575183  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.575932 12389 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.472579 12418 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:45.576582 12389 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.570578  8361 rpcz_store.cc:276] 0709 13:17:44.286106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.286268 (+   162us) service_pool.cc:224] Handling call
0709 13:17:44.302071 (+ 15803us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.302403 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.302433 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.302857 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.731038 (+428181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:44.731078 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.731151 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.562218 (+831067us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:45.567938 (+  5720us) raft_consensus.cc:1685] finished
0709 13:17:45.567960 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.568181 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":978,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":92285696,"thread_start_us":427841,"threads_started":1,"wal-append.queue_time_us":469614}
I20260709 13:17:45.580727 12389 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.583789  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:45.586364  8215 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:45.593361  8368 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:45.596824  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.610594  8294 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:45.614488  8214 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
W20260709 13:17:45.624567 12508 log.cc:927] Time spent T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.167s	user 0.000s	sys 0.004s
I20260709 13:17:45.630117  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2037) took 1317 ms. Trace:
I20260709 13:17:45.515767 12395 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.631148  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.646353  8294 raft_consensus.cc:2393] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:45.630692  8362 rpcz_store.cc:276] 0709 13:17:44.312210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.312340 (+   130us) service_pool.cc:224] Handling call
0709 13:17:44.392501 (+ 80161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.392716 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:44.898336 (+505620us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.629724 (+731388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.629776 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:45.629834 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.629908 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.630056 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74429,"prepare.queue_time_us":84274,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":146151,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":81,"thread_start_us":1116925,"threads_started":3,"wal-append.queue_time_us":290700}
I20260709 13:17:45.653723  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.654644  8361 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
W20260709 13:17:45.658334  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.559741 12417 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:45.652787 12414 consensus_meta.cc:287] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.794s	user 0.005s	sys 0.007s
I20260709 13:17:45.567480 12391 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:45.691021  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 53247.5us
I20260709 13:17:45.676106  8186 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:45.690011  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 275964us
I20260709 13:17:45.668201  8294 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:45.692221  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:45.685758  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 400823us
I20260709 13:17:45.652488 12486 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.693674 12486 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.695190  8361 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:45.695374  8362 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:45.696224 12395 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:45.696971  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.696947 12395 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.698148  8362 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:45.699507  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.701416  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.701738 12486 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:45.702751 12395 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.703130  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.704155  8368 raft_consensus.cc:2410] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:45.704806  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.706300  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.709831  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:45.711643  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.711699  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.722090  8294 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:17:45.711050 12354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.016s
I20260709 13:17:45.657523 12479 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:45.728276  8183 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:45.660414 12290 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:17:45.720814 12295 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.740590  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.736292  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:45.740602  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 322995us
W20260709 13:17:45.735522 12354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.006s	sys 0.016s
I20260709 13:17:45.721863 12517 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:45.727910 12382 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:45.744175  8183 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:45.747077  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.749902  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.750684  8288 raft_consensus.cc:2368] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10.
I20260709 13:17:45.728880 12279 consensus_queue.cc:1059] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:17:45.730222 12229 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:17:45.757375 12234 consensus_meta.cc:287] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.006s
W20260709 13:17:45.749845 12266 consensus_meta.cc:287] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.002s
W20260709 13:17:45.762140 12501 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 13:17:45.767648 12491 consensus_meta.cc:287] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
I20260709 13:17:45.785068  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.793016  8290 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:45.793768  8362 raft_consensus.cc:2410] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:17:45.794647  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 50537.7us
W20260709 13:17:45.774601 12531 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:45.797658  8294 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:45.773188 12417 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.750311 12518 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:45.774953 12234 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.771987 12428 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.803812 12234 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:45.804358 12428 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.752297 12523 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.806035 12523 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.808132  8288 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:45.808576 12503 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:17:45.809248 12076 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.809810  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2333) took 1429 ms. Trace:
I20260709 13:17:45.810279  8291 rpcz_store.cc:276] 0709 13:17:44.380367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.380973 (+   606us) service_pool.cc:224] Handling call
0709 13:17:44.381428 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.823436 (+442008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.825561 (+  2125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.855302 (+ 29741us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.062010 (+206708us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:45.062158 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.062362 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.809594 (+747232us) raft_consensus.cc:1685] finished
0709 13:17:45.809617 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.809752 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13941,"raft.queue_time_us":73842,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":9816,"thread_start_us":586715,"threads_started":2,"wal-append.queue_time_us":751679}
I20260709 13:17:45.812608 12491 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.801254  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.814127  8360 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:45.814913  8368 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:45.815186  8212 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:45.811321 12076 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.748716 12517 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.795816  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:45.822326  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.779412 12524 log.cc:927] Time spent T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:45.832710  8291 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:45.840854  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 878) took 1174 ms. Trace:
I20260709 13:17:45.843144 12234 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:45.843057  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 47347.4us
I20260709 13:17:45.843811 12234 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:45.844765  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 54a6cfa6f2cf49b6b8ad9a3beb86c0be: Illegal state: Replica 9e95b04d03d241329435b6d08dd1f236 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:45.844722 12234 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:45.851215  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.851595  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.852165  8289 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:45.852638  8292 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:45.853122  8292 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:45.853327  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.854102  8294 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.855082  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.858331  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.859058  8291 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.860685  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.841733 12418 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.872107 12494 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:45.852519  8289 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:45.875020  8289 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.876366  8289 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.877234 12391 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:45.877354 12491 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:45.878013 12279 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.880697  8922 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:17:45.868316 12522 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:45.841457  8925 rpcz_store.cc:276] 0709 13:17:44.665955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.666099 (+   144us) service_pool.cc:224] Handling call
0709 13:17:44.687236 (+ 21137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.725012 (+ 37776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.725056 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.728674 (+  3618us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.085888 (+357214us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:45.085927 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.085998 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.840562 (+754564us) raft_consensus.cc:1685] finished
0709 13:17:45.840591 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.840774 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4093,"raft.queue_time_us":39456,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3439,"thread_start_us":270687,"threads_started":1,"wal-append.queue_time_us":563563}
I20260709 13:17:45.842115 12099 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:45.816322 12521 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:45.883248  8922 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:45.895154  8293 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:45.885639 12496 consensus_meta.cc:287] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.000s
I20260709 13:17:45.848529 12523 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:45.886893 12518 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.885660  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:45.911414  8213 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:45.889257  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.890208  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:45.911605  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.890617  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.892421  8294 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:45.912994  8290 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.854022  8292 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:45.916940  8292 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.895537  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:45.828236 12517 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.906046  8295 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:45.907119  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:45.909013  8889 leader_election.cc:336] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.623s (SENT)
I20260709 13:17:45.921228  8920 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:45.921664  8889 leader_election.cc:336] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.624s (SENT)
W20260709 13:17:45.922583  8889 leader_election.cc:336] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.655s (SENT)
I20260709 13:17:45.908952  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:45.923377  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.878521 12279 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:45.923841  8287 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.925052  8925 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:45.893875 12099 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:45.910104 12496 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:45.955586  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.957664  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:45.943045  8290 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:45.944747  8292 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:45.995885  8920 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
W20260709 13:17:45.998198  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.998095  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.999933  8368 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:46.002610  8217 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:45.908308 12402 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:17:46.015527  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.012542 12410 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.014430  8287 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
W20260709 13:17:46.004032 12534 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:17:46.019243  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.025175  8287 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:46.026079  8289 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:45.918825 12391 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:17:46.031728  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:45.996687 12290 consensus_queue.cc:1059] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:46.033802 12290 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:46.034152 12290 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:46.035002 12290 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.036113 12099 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.037442 12099 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.924115 12518 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.018882 12397 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.058429  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.055441  8291 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:46.056710  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.062791  8289 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:46.065789  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:46.066905  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:46.067481  8365 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:46.067919  8367 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:46.068785  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:46.071187  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.053907 12290 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:46.072232  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.073571  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.077913  8291 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:46.078805 12477 raft_consensus.cc:3055] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:46.079250 12477 raft_consensus.cc:740] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:46.060741 12397 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.082053 12417 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:46.082557 12397 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:46.087975  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.031847 12410 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.089665  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.043510 12379 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.092782  8213 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:46.093690  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:46.097755  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.098390  8291 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:46.100180  8211 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:46.114486  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.117172  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:46.118018  8367 raft_consensus.cc:2410] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:46.132153  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.136217  8369 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
W20260709 13:17:46.136557  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 58982.9us
W20260709 13:17:46.144553  8889 leader_election.cc:336] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.933s (SENT)
I20260709 13:17:46.145035  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.146559  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:46.132061 12512 log.cc:927] Time spent T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.688s	user 0.001s	sys 0.002s
I20260709 13:17:46.146548  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.149295  8291 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:46.091207 12477 consensus_queue.cc:260] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:46.155164  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.158238  8369 pending_rounds.cc:85] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 6
I20260709 13:17:46.160486  8369 pending_rounds.cc:107] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:46.160651  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.160961  8369 raft_consensus.cc:2889] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.168383 12410 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:46.172611 12537 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:17:46.173756 12517 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.176033 12517 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:46.177135  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:46.177726  8365 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.181761 12518 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:46.182711  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.157236  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.184968  8365 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
W20260709 13:17:46.185683 12548 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:46.186081  8186 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:46.186292  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.187091 12517 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:46.188341  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.187811 12517 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:46.156003 12494 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.189963 12517 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.191813 12379 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:46.192833  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:46.193383  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 877) took 1528 ms. Trace:
I20260709 13:17:46.193771  8921 rpcz_store.cc:276] 0709 13:17:44.664695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.664865 (+   170us) service_pool.cc:224] Handling call
0709 13:17:44.687862 (+ 22997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.730462 (+ 42600us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:45.062074 (+331612us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.149108 (+ 87034us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.168816 (+ 19708us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.169378 (+   562us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:45.169538 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.169813 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.536873 (+367060us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b180030f820. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:46.016330 (+479457us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:46.193179 (+176849us) raft_consensus.cc:1685] finished
0709 13:17:46.193201 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.193329 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36747,"prepare.queue_time_us":443447,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":43981,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":46375,"spinlock_wait_cycles":337000448,"thread_start_us":305681,"threads_started":2,"wal-append.queue_time_us":240688}
I20260709 13:17:46.199216 12523 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.199744 12523 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.201973 12523 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:46.202953  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.212338  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.222785  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.224936  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.226080  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:46.227195  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:46.185257  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.230607  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:46.232831  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.233842  8287 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:46.233711  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.235512  8286 raft_consensus.cc:2368] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10.
I20260709 13:17:46.233281 12076 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:46.236629 12421 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:46.237262 12076 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:46.240150 12076 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.228420 12477 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.219588 12523 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:17:46.245934  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:46.248111  8366 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:46.250418  8286 raft_consensus.cc:2368] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 9. Current term is 10.
I20260709 13:17:46.231848 12423 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:17:46.254298  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:46.255555  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:46.255980  8294 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:46.272884  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.273528  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.256345  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.275204  8292 raft_consensus.cc:2368] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
I20260709 13:17:46.275467  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.276086  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.276891  8292 raft_consensus.cc:2393] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:46.257057  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.257035  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.278014  8295 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:46.278163  8290 raft_consensus.cc:2410] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:17:46.260921  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:46.261374  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:46.278913  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.279634  8218 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:46.263473  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.233167 12290 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:17:46.266721  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.268464  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.249414 12523 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.261581  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:46.281332  8220 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:46.252065 12421 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:46.288739 12421 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:46.289705 12539 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 13:17:46.291517 12290 raft_consensus.cc:3055] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:46.291920 12290 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:46.292721 12290 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:46.293696 12541 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:17:46.294224 12290 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.296978  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.298192  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.300393  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.283143  8289 raft_consensus.cc:2393] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:46.284814  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:46.284816  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 49734.1us
I20260709 13:17:46.300982  8293 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:46.263602 12099 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:46.302114  8332 leader_election.cc:400] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9.
I20260709 13:17:46.309077  8218 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:46.321051  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.322255  8332 leader_election.cc:403] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:46.308887  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:46.322074  8288 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:46.313622  8214 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:46.324015  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:46.324456 12521 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:46.298187 12507 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.862s	user 0.005s	sys 0.006s
I20260709 13:17:46.338817  8293 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:17:46.339434  8293 pending_rounds.cc:85] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 4
I20260709 13:17:46.339772  8293 pending_rounds.cc:107] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:17:46.340126  8293 raft_consensus.cc:2889] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.343580  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:46.349746  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.351824  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:46.354497  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.355178  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:46.356508  8363 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:46.358892  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:46.355940 12342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.012s	sys 0.011s
I20260709 13:17:46.378626  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:46.379326  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.405176  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:46.353716 12518 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:46.404472  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:46.377614 12342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.013s	sys 0.011s
I20260709 13:17:46.414376  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 876) took 1750 ms. Trace:
I20260709 13:17:46.414769  8924 rpcz_store.cc:276] 0709 13:17:44.663976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.664140 (+   164us) service_pool.cc:224] Handling call
0709 13:17:44.688660 (+ 24520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.965297 (+276637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.965350 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.965937 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.120999 (+155062us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:45.121040 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.121133 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.297671 (+1176538us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:46.409798 (+112127us) raft_consensus.cc:1685] finished
0709 13:17:46.409828 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.414316 (+  4488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36171,"raft.queue_time_us":71189,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":42617,"spinlock_wait_cycles":12618496,"thread_start_us":380868,"threads_started":2,"wal-append.queue_time_us":355634}
I20260709 13:17:46.309206 12523 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.360339 12354 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:46.418280  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.402442 12550 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:46.423115  8258 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.408845 12417 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:46.426000  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.432108  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.433772 12550 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:46.437237 12550 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.437871 12268 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.438112  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:46.439196  8220 raft_consensus.cc:2410] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:46.440126 12076 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.442075  8258 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.442298 12076 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:46.442935 12076 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.443560 12229 raft_consensus.cc:3055] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.444073 12229 raft_consensus.cc:740] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:46.445035 12229 consensus_queue.cc:260] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.445708 12268 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.451864  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:46.457257  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.458153  8220 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:46.443382 12076 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.408551 12234 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:46.424209 12428 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9.
I20260709 13:17:46.468617  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.406451 12545 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:17:46.463443  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 161473us
I20260709 13:17:46.429389 12342 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:46.500334  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.434545 12479 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:46.517210 12076 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:46.457840 12266 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.532955  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1632) took 1035 ms. Trace:
W20260709 13:17:46.533324  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.533792  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1615) took 1326 ms. Trace:
I20260709 13:17:46.534150  8212 rpcz_store.cc:276] 0709 13:17:45.207198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.297185 (+ 89987us) service_pool.cc:224] Handling call
0709 13:17:45.333438 (+ 36253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.815534 (+482096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.533571 (+718037us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54000370d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:46.533715 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107482368}
I20260709 13:17:46.535398  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:46.521106  8291 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:46.538800  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:46.527861  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.529134  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.544642  8212 raft_consensus.cc:1240] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:46.533354  8211 rpcz_store.cc:276] 0709 13:17:45.497431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.508852 (+ 11421us) service_pool.cc:224] Handling call
0709 13:17:45.509160 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.100708 (+591548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.532729 (+432021us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540043dd54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:46.532900 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358413696}
I20260709 13:17:46.522140  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:46.522938 12342 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:46.418804 12521 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.524269  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:46.552289  8892 leader_election.cc:336] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.901s (SENT)
I20260709 13:17:46.552834  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:46.526804  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.527820  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:46.553788  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 142548us
I20260709 13:17:46.528527  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.529115 12418 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.555215  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:46.529419  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.530861 12423 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:46.531435  8217 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:46.458263 12417 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:46.529233  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.556928  8217 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:46.557443  8212 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:46.560681  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.562592  8288 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:46.554101  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:46.565188  8212 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:46.564944  8294 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:46.533355 12421 consensus_queue.cc:1059] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:17:46.577770  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:46.579195  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:46.579919  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:46.582419  8922 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
W20260709 13:17:46.582657  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 179449us
W20260709 13:17:46.592065  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet eacbb7965099474082590e4b50221087: Illegal state: Replica 4cf23888b4fe42b594b9443ae6ee9cd2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:46.579919  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:46.594337  8889 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.595029  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:46.595911  8928 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:46.600723  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.605057 12544 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.605172 12014 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:46.605707 12014 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:46.563555 12428 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:46.581418 12494 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.577383 12379 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:46.599084  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:46.563685 12564 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:46.591928 12414 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:46.563422 12406 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:46.576839 12410 consensus_queue.cc:1059] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:17:46.602636 12561 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:46.605916 12544 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.561504 12556 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:17:46.576541 12418 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.615716 12379 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.616134 12295 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.595316 12543 consensus_queue.cc:1059] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:46.613279 12492 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.598615 12354 raft_consensus.cc:697] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:46.643612  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.651345  8294 raft_consensus.cc:1240] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:46.652281  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:46.630442 12561 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.611218 12266 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:17:46.666822  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:46.668545 12545 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:46.659801  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.653223 12543 consensus_queue.cc:1243] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:46.639036 12379 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:46.678541  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 84246.1us
I20260709 13:17:46.680364  8889 leader_election.cc:400] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
I20260709 13:17:46.682060  8889 leader_election.cc:403] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:46.631695 12234 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:17:46.664014 12561 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.631524 12494 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.709496  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.671718 12402 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:46.709946  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 78256us
I20260709 13:17:46.628770 12342 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:46.679916 12544 raft_consensus.cc:3055] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:46.739355  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.700119 12523 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:46.742772  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.708559 12543 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.638114 12417 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.749893  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.733549 12421 consensus_queue.cc:1243] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:46.760888  8295 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:46.718948  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:46.700635 12410 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:17:46.780679  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 201532us
I20260709 13:17:46.685422 12492 raft_consensus.cc:3055] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:46.743309 12556 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:46.844344  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 96952.7us
I20260709 13:17:46.879699  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.744455 12544 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:46.744445 12402 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:46.845635  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 96070.1us
W20260709 13:17:46.848966 12574 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 13:17:46.850397  8394 heartbeater.cc:646] Failed to heartbeat to 127.6.233.62:38939 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.6.233.62:38939 timed out after 15.000s (SENT)
W20260709 13:17:46.852626 12553 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:17:46.853956 12576 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:17:46.856829 12570 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:17:46.860646 12577 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:17:46.862082 12229 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.865932  8213 raft_consensus.cc:2468] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
W20260709 13:17:46.866504 12529 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.144s	user 0.001s	sys 0.004s
W20260709 13:17:46.868026  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 160026us
I20260709 13:17:46.918298  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.868336  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:46.746287 12406 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:46.887512  8364 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:46.891260  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.892174  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.893023  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.921314  8294 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 9: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:46.921716  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.922328  8289 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:46.922959  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:46.893919  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:46.894732  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:46.924718  8290 raft_consensus.cc:2410] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:46.925138  8287 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:46.895577  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.910626  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:46.913086  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:46.926795  8292 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:46.927173  8368 raft_consensus.cc:2410] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:46.865979 12585 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.878599 12492 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:46.888144 12496 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.887756 12583 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:46.932014  8289 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: [8.7-11.9]
I20260709 13:17:46.751506 12354 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:46.948642  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.910133 12510 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:46.974397 12510 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.976876 12510 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:46.964366 12544 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:47.005504 12544 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.006357  8219 raft_consensus.cc:2410] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:17:47.006872 12538 log.cc:927] Time spent T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.911s	user 0.000s	sys 0.003s
W20260709 13:17:46.966118 12580 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:46.966424 12479 consensus_queue.cc:1059] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:17:47.009868 12479 consensus_queue.cc:1243] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:47.010484 12479 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:47.010828 12479 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:46.932850 12258 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:46.969743  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.971020 12402 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:47.018247  8369 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:46.973109 12494 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:46.973757 12584 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.986019 12406 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.939790 12583 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.025725 12583 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.987383 12492 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:47.027308 12492 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:46.989372 12410 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:46.990078 12418 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:46.949747 12496 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:46.948273 12397 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:46.960304 12590 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.020233 12545 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:47.020251  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:47.042268  8212 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:47.001228 12570 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:47.022908  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:47.032155  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 292747us
I20260709 13:17:47.044991  8214 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
W20260709 13:17:47.034844  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.038364  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 158726us
I20260709 13:17:47.047928  8889 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:47.048838  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.050853 12556 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.052371  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:47.030339 12379 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.059508  8212 raft_consensus.cc:2410] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:17:47.061908  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.011620 12479 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:47.074347  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.074692  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:47.067884  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:47.032775 12510 consensus_queue.cc:1059] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:47.061287 12410 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.075780  8214 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:47.066699 12234 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:47.081838  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 213506us
I20260709 13:17:47.083168  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:47.086331  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:47.086779  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:47.086437  8212 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:47.088341 12597 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:47.090644 12557 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.091132 12557 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:47.092396  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:47.093127  8924 raft_consensus.cc:2393] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:47.093263 12557 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:47.093954  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:47.094606  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:47.095129  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:47.097776  8925 raft_consensus.cc:2368] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11.
I20260709 13:17:47.098337  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:47.098384  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:47.106858  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:47.167886  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:47.169178  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:47.169850  8925 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:17:47.085711 12584 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.087903 12402 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:47.172298  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:47.172969  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:47.100157 12479 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.188870  8921 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:47.096339 12406 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:17:47.170188 12556 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:47.096935 12234 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.218446  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:47.179663 12596 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:47.232466  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:47.233518  8925 raft_consensus.cc:2410] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:17:47.252820  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:47.253906  8214 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:47.229236 12543 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
I20260709 13:17:47.232010 12496 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:47.228879 12342 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:47.336509  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:47.318466 12417 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:47.325937 12561 consensus_meta.cc:287] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.590s	user 0.011s	sys 0.000s
I20260709 13:17:47.314240 12354 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.318936 12594 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.354452  8214 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:47.376572  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.197014 12402 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:47.350395 12598 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:17:47.424763  8925 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:47.427340  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.465785  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1869) took 1069 ms. Trace:
I20260709 13:17:47.466661  8214 rpcz_store.cc:276] 0709 13:17:46.368112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.334066 (+965954us) service_pool.cc:224] Handling call
0709 13:17:47.354045 (+ 19979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.437002 (+ 82957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.437307 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:47.469889 12602 log.cc:927] Time spent T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:17:47.470141  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:47.471351 12600 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:17:47.441308 12591 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:47.377642 12594 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.476557 12591 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.477561  8292 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:47.478322 12594 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:47.375303 12592 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.479077 12592 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:47.479641 12605 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:47.481256 12592 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:47.353452 12417 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.483644 12417 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:47.484632 12496 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.352883 12342 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.485082 12496 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.486819 12342 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:47.462797 12379 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:47.441392 12510 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.478634 12591 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:47.514781  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.544901  8212 raft_consensus.cc:2410] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:17:47.577853  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.487692 12510 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:47.587894  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:47.582986  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 476162us
I20260709 13:17:47.594039  8892 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:47.591814  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:47.600312  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:47.604241  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.605921  8293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.019s	sys 0.023s
W20260709 13:17:47.606365  8293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.019s	sys 0.023s
I20260709 13:17:47.608268  8293 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:47.609825  8293 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:47.486843 12234 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:47.628093  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.772730  8258 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.1:43925 timed out after 1.513s (SENT) [suppressed 45 similar messages]
I20260709 13:17:47.541438 12594 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.858448  8214 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:47.859339  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1871) took 1446 ms. Trace:
I20260709 13:17:47.859757  8214 rpcz_store.cc:276] 0709 13:17:46.412455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.554854 (+1142399us) service_pool.cc:224] Handling call
0709 13:17:47.858230 (+303376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.859032 (+   802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.859275 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:47.862432  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 269356us
I20260709 13:17:47.863626  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:47.376329 12354 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:47.554203 12342 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.356933 12561 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:47.898581  8927 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:17:47.899250  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 43650.7us
W20260709 13:17:47.899605  8921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.027s	sys 0.047s
W20260709 13:17:47.900067  8921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.027s	sys 0.047s
W20260709 13:17:47.902073  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.886760 12544 consensus_meta.cc:287] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.881s	user 0.012s	sys 0.000s
I20260709 13:17:47.611218 12579 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.884294 12355 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.885205 12596 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.855226 12477 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.913498  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1872) took 1484 ms. Trace:
I20260709 13:17:47.921967  8214 rpcz_store.cc:276] 0709 13:17:46.428796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.888464 (+1459668us) service_pool.cc:224] Handling call
0709 13:17:47.912872 (+ 24408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.913098 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.913134 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.913190 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:47.913234 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.913302 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.913432 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.923960  8927 raft_consensus.cc:1240] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:47.945458  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:47.946545  8290 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:47.954598  8926 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:47.893046  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:47.957548  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 64599us
I20260709 13:17:47.958563  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:47.970182 12592 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.970916 12592 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.924319 12579 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:47.923918 12355 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.008170  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:47.896754 12594 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.009006  8927 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:47.925195 12379 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:17:48.007052 12544 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:47.910416 12342 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:48.040010  8294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.012s	sys 0.017s
I20260709 13:17:47.930675 12477 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:48.040481  8294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.013s	sys 0.017s
I20260709 13:17:48.024978 12234 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:17:48.052587 12544 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:48.122643 12611 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:48.123405 12611 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.126056 12611 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.061653 12496 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.095388 12579 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.115978 12591 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.132615 12611 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.148078 12610 log.cc:927] Time spent T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:17:48.150676 12603 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:17:48.131855 12510 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.159298 12342 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:48.161221 12584 consensus_meta.cc:287] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.965s	user 0.009s	sys 0.000s
I20260709 13:17:48.162360 12477 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.137907 12561 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.142328 12355 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.222335 12609 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.166211 12594 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.146718 12591 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.189831  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1873) took 1757 ms. Trace:
W20260709 13:17:48.259025  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.007s	sys 0.010s
W20260709 13:17:48.290442  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.008s	sys 0.010s
I20260709 13:17:48.275308  8214 rpcz_store.cc:276] 0709 13:17:46.432863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.943256 (+1510393us) service_pool.cc:224] Handling call
0709 13:17:48.189090 (+245834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.189343 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.189383 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:48.189446 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.189517 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.189593 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.189750 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:48.303277  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 344790us
W20260709 13:17:48.300493  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 388575us
W20260709 13:17:48.227223 12479 consensus_meta.cc:287] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.030s	user 0.009s	sys 0.000s
I20260709 13:17:48.250345 12609 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:48.316172 12567 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.697s	user 0.058s	sys 0.073s
I20260709 13:17:48.295018 12561 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:48.329216 12609 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.292426 12518 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.329052 12561 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.329967 12518 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:48.320806  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 548048us
I20260709 13:17:48.248966 12584 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:48.255537 12583 consensus_meta.cc:287] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.229s	user 0.007s	sys 0.004s
I20260709 13:17:48.333068  8214 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:17:48.274688 12354 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.336763  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.344895  8927 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:48.258952 12591 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:48.337839  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.346635  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.346740  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1860) took 2022 ms. Trace:
I20260709 13:17:48.347091  8219 rpcz_store.cc:276] 0709 13:17:46.324268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.521887 (+197619us) service_pool.cc:224] Handling call
0709 13:17:48.346542 (+1824655us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b5400092754. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.346680 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053884288}
I20260709 13:17:48.347771  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:48.348203  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:48.348512 12591 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.349360  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:48.349629  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:48.350051  8219 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:48.350335 12591 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:48.350787  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:48.332036 12561 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.258654 12014 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.325235  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:48.351604  8258 leader_election.cc:400] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11.
I20260709 13:17:48.272758 12402 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.337836  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.355356  8922 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:48.338268  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.331930 12518 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:48.338855  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.339423  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.335469 12609 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.231582 12611 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.340140 12596 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:48.340164  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.356292  8923 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:48.361327  8924 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:48.361724  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.357082  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.358261  8919 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:48.360308  8922 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:48.362668  8927 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 7.
I20260709 13:17:48.379712  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:48.357193 12584 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.358760 12014 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.346182 12583 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.360761 12609 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.413057 12609 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.418354  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:48.419150  8922 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:48.435142 12590 raft_consensus.cc:3055] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:48.435568 12590 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:48.436352 12590 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.437266 12590 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:48.485780 12614 log.cc:927] Time spent T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:17:48.515148 12611 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.551779 12583 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.344198  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1638) took 1778 ms. Trace:
I20260709 13:17:48.592510  8214 rpcz_store.cc:276] 0709 13:17:46.566194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.301659 (+1735465us) service_pool.cc:224] Handling call
0709 13:17:48.332735 (+ 31076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.338264 (+  5529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.344141 (+  5877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.594805  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:48.597230  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:48.598589  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:48.600620  8214 raft_consensus.cc:1240] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:48.611196  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1640) took 2042 ms. Trace:
I20260709 13:17:48.351346  8219 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:48.353186  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:48.618132  8290 consensus_meta.cc:287] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.670s	user 0.006s	sys 0.005s
W20260709 13:17:48.622350  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.624483  8291 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 611) took 2468 ms (client timeout 2073 ms). Trace:
W20260709 13:17:48.625912  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.639628  8214 rpcz_store.cc:276] 0709 13:17:46.568982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.599559 (+2030577us) service_pool.cc:224] Handling call
0709 13:17:48.600288 (+   729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.610712 (+ 10424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.611069 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.669298  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 775) took 1449 ms. Trace:
W20260709 13:17:48.642962  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.642095  8219 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:48.692159  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.681447  8220 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1852) took 2410 ms (client timeout 2650 ms). Trace:
I20260709 13:17:48.707362  8215 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:48.705376  8217 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:48.676915  8218 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1870) took 2270 ms (client timeout 1513 ms). Trace:
W20260709 13:17:48.692672  8216 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1848) took 2430 ms (client timeout 1847 ms). Trace:
I20260709 13:17:48.685096  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 779) took 1195 ms. Trace:
W20260709 13:17:48.689081  8926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 766) took 1603 ms (client timeout 1763 ms). Trace:
W20260709 13:17:48.693778  8212 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 578) took 2044 ms (client timeout 2111 ms). Trace:
I20260709 13:17:48.738317  8219 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 579) took 2082 ms. Trace:
I20260709 13:17:48.747704  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1874) took 2072 ms. Trace:
I20260709 13:17:48.748241  8217 rpcz_store.cc:276] 0709 13:17:46.674920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.704281 (+2029361us) service_pool.cc:224] Handling call
0709 13:17:48.704910 (+   629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.744126 (+ 39216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.747594 (+  3468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.749281 12279 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.749727 12423 raft_consensus.cc:3055] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:48.644933  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2367) took 1467 ms. Trace:
I20260709 13:17:48.750445 12423 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:48.750488  8292 rpcz_store.cc:276] 0709 13:17:47.177765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.469854 (+292089us) service_pool.cc:224] Handling call
0709 13:17:48.644400 (+1174546us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b540005c3d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.644702 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15365504}
I20260709 13:17:48.728771  8921 rpcz_store.cc:276] 0709 13:17:47.220298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.221381 (+  1083us) service_pool.cc:224] Handling call
0709 13:17:47.221756 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.227484 (+  5728us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:47.265590 (+ 38106us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.335018 (+1069428us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.352014 (+ 16996us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.352266 (+   252us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:48.667778 (+315512us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.668467 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.668641 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.668724 (+    83us) raft_consensus.cc:1685] finished
0709 13:17:48.668740 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.669015 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14544,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":2400,"raft.queue_time_us":26112,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":89621,"spinlock_wait_cycles":736000,"thread_start_us":1297957,"threads_started":3,"wal-append.queue_time_us":688337}
W20260709 13:17:48.738143  8220 rpcz_store.cc:269] 0709 13:17:46.270600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.468298 (+197698us) service_pool.cc:224] Handling call
0709 13:17:48.680906 (+2212608us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b5400037ad4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.681203 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578326784}
I20260709 13:17:48.714979 12099 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.757205  8220 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:48.757052 12523 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:48.758347 12523 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.759869 12584 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:48.713228 12076 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:48.760756  8922 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:48.761122 12076 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:48.760923 12584 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.762001 12543 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:48.763054 12564 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:48.762817 12076 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:48.728353  8291 rpcz_store.cc:269] 0709 13:17:46.155863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.156718 (+   855us) service_pool.cc:224] Handling call
0709 13:17:48.623908 (+2467190us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400389354. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.624169 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771746048}
I20260709 13:17:48.764923 12564 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.767074  8928 raft_consensus.cc:2410] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:48.767382 12342 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.767644 12583 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.750276  8217 raft_consensus.cc:1240] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:48.741587  8218 rpcz_store.cc:269] 0709 13:17:46.406818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.676337 (+2269519us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:48.676653 (+   316us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:48.768546 12510 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:48.684243  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.682119  8923 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:48.744889  8219 rpcz_store.cc:276] 0709 13:17:46.649362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.640590 (+1991228us) service_pool.cc:224] Handling call
0709 13:17:48.641418 (+   828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.730070 (+ 88652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.732097 (+  2027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.776595  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 580) took 2126 ms. Trace:
W20260709 13:17:48.776811  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:48.743624  8926 rpcz_store.cc:269] 0709 13:17:47.085970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.086115 (+   145us) service_pool.cc:224] Handling call
0709 13:17:48.688427 (+1602312us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540059f6d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.688768 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918659328}
W20260709 13:17:48.742550  8216 rpcz_store.cc:269] 0709 13:17:46.261982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.262124 (+   142us) service_pool.cc:224] Handling call
0709 13:17:48.692274 (+2430150us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b540043d854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.692475 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5346938240}
W20260709 13:17:48.744207  8212 rpcz_store.cc:269] 0709 13:17:46.649074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.094833 (+445759us) service_pool.cc:224] Handling call
0709 13:17:48.693315 (+1598482us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b5400198554. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.693584 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030783360}
W20260709 13:17:48.642732  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 289547us
I20260709 13:17:48.746673  8290 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:48.777100  8215 rpcz_store.cc:276] 0709 13:17:46.650543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.679056 (+2028513us) service_pool.cc:224] Handling call
0709 13:17:48.706492 (+ 27436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.747464 (+ 40972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.776542 (+ 29078us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.768548 12590 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:48.792521 12354 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.802214  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 43998.3us
I20260709 13:17:48.803409 12428 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:48.768546 12583 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.805718 12428 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.806787 12583 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.808333 12510 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.809414 12099 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.810626 12510 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.811225 12342 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.813730 12342 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.816555 12014 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:48.817713 12591 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.818080 12014 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:48.818720 12014 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:48.818581 12591 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.821162  8364 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:48.823977  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.825047  8920 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:48.802109  8924 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:48.827824  8290 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2368) took 1280 ms. Trace:
I20260709 13:17:48.789904 12590 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:48.832782  8290 rpcz_store.cc:276] 0709 13:17:47.547240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.602781 (+ 55541us) service_pool.cc:224] Handling call
0709 13:17:48.800131 (+1197350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.826700  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:48.811847 12099 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.836205  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.836355 12479 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.836992  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37894 (request call id 19) took 2188 ms. Trace:
I20260709 13:17:48.796406 12354 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.840415 12423 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.840953  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:48.840660 12014 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.835654  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.843773  8218 rpcz_store.cc:276] 0709 13:17:46.648739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.778251 (+2129512us) service_pool.cc:224] Handling call
0709 13:17:48.836883 (+ 58632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.845439  8214 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:48.841741 12583 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.846511  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.846925 12523 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:48.847117  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.849282 12418 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:48.843353 12590 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:48.743083  8925 rpcz_store.cc:276] 0709 13:17:47.489734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.489848 (+   114us) service_pool.cc:224] Handling call
0709 13:17:47.490246 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.490663 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.490705 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.542672 (+ 51967us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.300837 (+758165us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:48.355822 (+ 54985us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.356060 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.356132 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.684543 (+328411us) raft_consensus.cc:1685] finished
0709 13:17:48.684594 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.684893 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59226,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":2848,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":8607,"thread_start_us":487262,"threads_started":2,"wal-append.queue_time_us":717474}
I20260709 13:17:48.859606  8364 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:48.858640  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.863981  8920 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:48.865052  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:48.865782  8920 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:48.867174 12014 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.868542  8919 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:48.871047 12568 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 2.195s	user 0.018s	sys 0.054s
I20260709 13:17:48.851649 12510 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.872900 12510 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.873557  8921 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
W20260709 13:17:48.873836 12601 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.646s	user 0.002s	sys 0.024s
I20260709 13:17:48.874642  8924 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:48.875201 12583 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:48.861394 12479 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.878173 12583 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.878708 12479 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.857995 12418 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:48.880411 12591 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:48.880820 12418 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.881445 12523 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.881891 12414 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:48.882484 12414 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.884009  8369 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:48.886674  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.888711  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:48.893548  8213 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1845) took 2633 ms (client timeout 3008 ms). Trace:
W20260709 13:17:48.894021  8213 rpcz_store.cc:269] 0709 13:17:46.259652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.260695 (+  1043us) service_pool.cc:224] Handling call
0709 13:17:48.893178 (+2632483us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b540019a854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.893373 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332947840}
I20260709 13:17:48.882496  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:47.182928  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:48.898900 12571 raft_consensus.cc:2764] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:48.895704  8211 raft_consensus.cc:1275] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:48.895560  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:48.913319  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.924772  8290 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:17:48.930029  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 47668.7us
W20260709 13:17:48.915592  8295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 631) took 2359 ms (client timeout 2141 ms). Trace:
I20260709 13:17:48.911458 12591 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:48.931457  8295 rpcz_store.cc:269] 0709 13:17:46.528384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.528922 (+   538us) service_pool.cc:224] Handling call
0709 13:17:48.887913 (+2358991us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540005da54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:48.888130 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499890560}
I20260709 13:17:48.942153  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:48.944877  8290 raft_consensus.cc:2410] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:17:48.946960  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 44231.8us
I20260709 13:17:48.939932  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:48.949482  8889 leader_election.cc:336] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 2.141s (SENT)
W20260709 13:17:48.952773  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.958217  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:48.958993  8295 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
W20260709 13:17:48.960670 12566 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 2.006s	user 0.019s	sys 0.013s
I20260709 13:17:48.966486 12521 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.967257 12521 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.969727 12521 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.979275  8361 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:48.981545  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:48.982491  8360 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:48.984402  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:48.993820  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:48.994989  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:48.988241 12591 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:48.990250 12510 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:48.997669  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:48.997133  8369 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:48.999691  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:49.000872  8291 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.997225 12630 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.015659  8361 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:49.016587  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.020937  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 117322us
I20260709 13:17:49.023072  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:49.023988  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.025137  8363 raft_consensus.cc:2410] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:17:49.026917 12523 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:49.029251  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.030849  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:48.974743 12590 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:49.033634  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.034783 12630 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.035584 12428 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:49.037515 12428 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:49.037985 12428 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.044656  8183 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.044591  8361 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:49.049137  8369 raft_consensus.cc:3055] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:49.049629  8369 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:49.049829  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.050534  8369 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.051662  8369 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.051877 12268 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:49.053365  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.056670  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.059059  8363 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
W20260709 13:17:49.052199  8892 leader_election.cc:336] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.786s (SENT)
I20260709 13:17:49.053337 12510 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:49.061326 12510 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.061713 12510 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.056071  8258 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.054322  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.052320 12417 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:49.069093  8892 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.052017 12590 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.070250  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.081256 12268 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.074712 12417 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.130985  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.119801  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.121640  8291 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:49.124718 12543 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.125087  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.119701  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.124940 12556 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:49.136240  8927 raft_consensus.cc:2410] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:17:49.075430 12523 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:49.139494  8369 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:17:49.139955  8369 pending_rounds.cc:85] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 4
W20260709 13:17:49.141716  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.132586 12268 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:49.143800  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 48585.3us
I20260709 13:17:49.138491  8363 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:49.134859 12417 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:49.141963  8369 pending_rounds.cc:107] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 9.5
W20260709 13:17:49.151156  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 200781us
I20260709 13:17:49.151659  8369 raft_consensus.cc:2889] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.142557 12523 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.154428  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.155570  8364 raft_consensus.cc:2410] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:49.157883 12556 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.162981  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:49.165390  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1875) took 2146 ms. Trace:
I20260709 13:17:49.165771  8214 rpcz_store.cc:276] 0709 13:17:47.019464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.771810 (+1752346us) service_pool.cc:224] Handling call
0709 13:17:48.800512 (+ 28702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.852464 (+ 51952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.165177 (+312713us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54001d3b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:49.165338 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61040512}
I20260709 13:17:49.166239 12523 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:49.168155 12565 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.168891 12565 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.171173 12565 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.142553 12543 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.176221 12014 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:49.179416  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:49.181309 12592 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:49.184543  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 148525us
I20260709 13:17:49.179060 12543 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:49.184803  8363 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:49.185482  8892 leader_election.cc:336] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 1.803s (SENT)
I20260709 13:17:49.186045  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:49.188268  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.189008 12354 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:49.189488  8183 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.189724 12354 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.190198 12354 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.190637 12354 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.190902 12418 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.191500  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.192194  8294 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:49.192836  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.193398  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.193568  8288 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:49.193459  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.194694  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.195068  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.195323 12258 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:49.195415  8294 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:49.195834 12258 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:49.196683  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.197036 12258 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.198204 12258 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.198207 12517 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:49.198967 12517 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.199365 12517 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.198149  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:49.202584  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:49.206485  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 56917.3us
W20260709 13:17:49.207005  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.207005  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.149804 12268 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.218570 12624 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.219967  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.218477  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.138898 12414 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.153576 12590 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.217967  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.228912 12099 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.229192  8183 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.229419 12099 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.230345  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.233223 12414 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.223539 12590 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.230836 12295 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.234160 12590 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.234318 12295 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:49.234501 12607 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 1.772s	user 0.024s	sys 0.050s
I20260709 13:17:49.234778 12295 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.232903 12428 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.236358  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:49.237437 12428 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:49.229933 12099 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.240664 12624 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.241281  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2363) took 2163 ms. Trace:
I20260709 13:17:49.242265  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.241672  8286 rpcz_store.cc:276] 0709 13:17:47.077969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.078072 (+   103us) service_pool.cc:224] Handling call
0709 13:17:47.078311 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.081008 (+  2697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.081043 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.081485 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.314216 (+232731us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:47.314259 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.314334 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.233721 (+1919387us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:49.240725 (+  7004us) raft_consensus.cc:1685] finished
0709 13:17:49.240766 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.241090 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10138,"raft.queue_time_us":6220,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":27258240,"thread_start_us":143020,"threads_started":1,"wal-append.queue_time_us":278375}
I20260709 13:17:49.243319  8365 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:49.207790 12543 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.243870  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1863) took 2910 ms. Trace:
I20260709 13:17:49.247087  8211 rpcz_store.cc:276] 0709 13:17:46.333039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.545726 (+212687us) service_pool.cc:224] Handling call
0709 13:17:48.895043 (+2349317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.901158 (+  6115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.243660 (+342502us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b540019a850. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:49.243800 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5401893120}
I20260709 13:17:49.252137  8258 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:49.250620  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.258407  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.251514  8288 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:49.262794  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.265821 12584 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:49.269026  8258 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.270933 12266 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.271322 12266 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.271353  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.271790 12266 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.273316  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.275058 12479 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:49.275556 12479 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:49.276297 12556 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:49.276559 12479 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:49.277176  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 79229.6us
I20260709 13:17:49.278131  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:49.278965 12624 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.279387 12624 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:49.279541  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:49.279844 12624 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.280766 12591 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:49.281276  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.279569  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:49.283126 12545 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.283500 12545 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.283835 12545 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.286001 12417 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.289680 12354 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.250679 12592 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.296424  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.299378  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.300287  8363 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:49.298070 12421 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:49.315136  8361 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:49.295740 12592 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.317440  8361 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:49.308185  8928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54804 (request call id 770) took 2204 ms (client timeout 2650 ms). Trace:
I20260709 13:17:49.321774  8183 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:49.320806  8928 rpcz_store.cc:269] 0709 13:17:47.091340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.094156 (+  2816us) service_pool.cc:224] Handling call
0709 13:17:49.291536 (+2197380us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400214b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:49.295870 (+  4334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3672037120}
I20260709 13:17:49.328401  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.329988  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.330832  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:49.333117  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.334371  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 54958.7us
I20260709 13:17:49.322953 12592 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.317142 12421 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:49.339740  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.342079  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.337558  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2365) took 2170 ms. Trace:
I20260709 13:17:49.350472  8292 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:17:49.350080  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:49.357818  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.361665  8362 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:49.347555 12421 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.362093  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:49.356465 12342 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:49.363157  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:49.369369  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 749a008ddc4d4f31a1bcd1a446b5916d: Illegal state: Replica 9e95b04d03d241329435b6d08dd1f236 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:49.372383  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.360595 12521 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:17:49.343694  8287 rpcz_store.cc:276] 0709 13:17:47.079000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.493520 (+414520us) service_pool.cc:224] Handling call
0709 13:17:47.493854 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.494274 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.494315 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.552171 (+ 57856us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.674077 (+1121906us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b180036bf20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:17:48.850689 (+176612us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:49.151694 (+301005us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.209125 (+ 57431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.222002 (+ 12877us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.222062 (+    60us) raft_consensus.cc:1685] finished
0709 13:17:49.228316 (+  6254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.249786 (+ 21470us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":440219,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":61960,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":13652,"spinlock_wait_cycles":7278464,"thread_start_us":406771,"threads_started":2,"wal-append.queue_time_us":1317363}
I20260709 13:17:49.390542  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.389662  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.393633  8365 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:49.388227  8361 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:49.397413  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 179380us
I20260709 13:17:49.397442  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:49.397957  8292 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:49.379779 12417 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.401285  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.386368 12354 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.387136 12342 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:49.402781 12638 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:17:49.402016  8892 leader_election.cc:336] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.141s (SENT)
I20260709 13:17:49.409581  8892 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.386169 12266 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.417364  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:49.418799  8361 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:49.423573 12649 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
W20260709 13:17:49.424255 12480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.879s	user 0.019s	sys 0.030s
I20260709 13:17:49.421238 12423 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:49.424664 12480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.937s	user 0.019s	sys 0.031s
W20260709 13:17:49.426397 12647 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.002s
I20260709 13:17:49.413744  8118 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:49.433522  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:49.434758  8118 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:49.435529  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.436563 12417 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:49.437394 12417 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:49.438577 12417 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.439141 12625 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:49.439157  8118 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 4 to 12, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:49.405418 12517 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.436602 12342 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:49.460290  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.461512  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.463683  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:49.464341  8360 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:49.472504  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:49.456331 12556 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:49.413123 12295 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.470670  8118 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 12, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 12 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:49.484611  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 86468.7us
I20260709 13:17:49.475174 12354 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:49.492893  8361 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:17:49.493295  8361 pending_rounds.cc:85] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 8
I20260709 13:17:49.493649  8361 pending_rounds.cc:107] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:17:49.493928  8361 raft_consensus.cc:2889] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.498445  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2630) took 2923 ms. Trace:
I20260709 13:17:49.489970 12521 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:17:49.499200 12266 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.491879 12354 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:49.501876  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 95799.1us
I20260709 13:17:49.492584 12510 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.498888  8367 rpcz_store.cc:276] 0709 13:17:46.570357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.570610 (+   253us) service_pool.cc:224] Handling call
0709 13:17:46.596190 (+ 25580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.858770 (+2262580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.862507 (+  3737us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.931822 (+ 69315us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.067277 (+135455us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:49.067318 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.072641 (+  5323us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.490672 (+418031us) raft_consensus.cc:1685] finished
0709 13:17:49.490690 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.490801 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2145298,"raft.queue_time_us":2172272,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":5891,"thread_start_us":187647,"threads_started":2,"wal-append.queue_time_us":316114}
I20260709 13:17:49.503690 12624 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.499815 12354 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:49.514621  8892 leader_election.cc:336] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.399s (SENT)
W20260709 13:17:49.520964  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.489809 12630 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:17:49.495079 12590 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.525045  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:49.517530 12266 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:17:49.529557 12545 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.530514  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:49.531136  8919 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:49.531701 12545 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:49.532783  8927 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:49.533315  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.533675  8923 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:49.534595  8922 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:49.536594 12624 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:49.541421 12379 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.544884  8926 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:49.545954  8928 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:49.549769 12295 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.550508  8186 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:49.555080 12550 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.556406  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.557161  8290 raft_consensus.cc:1217] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[10.6-11.7]   Dedup: 10.6->[11.7-11.7]
I20260709 13:17:49.557683 12099 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.559273  8360 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:49.579164  8290 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:17:49.560775 12268 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.579701  8364 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.568352 12510 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.560109  8261 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:49.575516  8928 pending_rounds.cc:85] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 6
I20260709 13:17:49.561645 12517 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.582211  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:49.583004  8928 pending_rounds.cc:107] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:49.584128  8928 raft_consensus.cc:2889] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.580942  8118 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 5 to 7, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 7 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.583873 12625 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:49.576872 12379 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.589182 12379 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.589357  8261 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.591684  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.593822  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:49.594624 12258 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:49.599699 12258 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:49.600170  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.600365 12258 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.606197  8261 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:49.596614 12556 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:49.598513  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 80024us
I20260709 13:17:49.606256 12630 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.595991 12550 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.607824 12421 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.608194  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:49.610330 12592 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.612742  8288 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:49.615775  8920 raft_consensus.cc:2410] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:17:49.629024  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.630786  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:49.631724  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:49.632522  8919 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.629765  8118 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 9, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:49.639549  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:49.632014  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:49.643276  8923 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:49.645896  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 95565.7us
I20260709 13:17:49.621218 12630 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.647521  8186 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.649322  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:49.629042 12480 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.637178 12543 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:49.658147  8928 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:49.667091  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.669006  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.648475 12630 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.668764  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:49.670521  8360 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.648157 12517 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:49.638931 12295 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:49.656491 12480 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.678655  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:49.679500  8926 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.657526 12266 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:49.676780  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.682858  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:49.648428 12418 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:49.689675 12491 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:49.691056  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:49.692355  8118 catalog_manager.cc:5697] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 2 to 11, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 11 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.694677  8118 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 11, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:49.696899 12550 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.656213 12521 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:49.677908 12480 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.701361 12229 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:49.704632 12379 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:49.705320  8114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46474 (request call id 261) took 31316 ms (client timeout 15000 ms). Trace:
I20260709 13:17:49.705654 12258 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.681073 12545 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.711530 12592 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.669966 12583 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:49.712633 12583 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.713392 12590 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.714628 12583 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:49.714478  8118 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.677141 12402 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:17:49.716349 12421 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:49.716578  8118 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 9, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 9 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.683840 12266 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.686807 12354 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.718259 12266 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.718220  8118 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 10, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:49.719682 12354 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:49.687126 12099 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.715155 12268 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.684427  8921 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:49.705770  8114 rpcz_store.cc:269] 0709 13:17:18.389005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.389277 (+   272us) service_pool.cc:224] Handling call
0709 13:17:49.705054 (+31315777us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:44.133218 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:44.175894 (+ 42676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:44.175949 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:17:44.175975 (+    26us) tablet.cc:662] Decoding operations
0709 13:17:44.176879 (+   904us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:44.176942 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:44.176970 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:17:44.177510 (+   540us) tablet.cc:701] Row locks acquired
0709 13:17:44.177531 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:44.177683 (+   152us) write_op.cc:270] Start()
0709 13:17:44.177797 (+   114us) write_op.cc:276] Timestamp: P: 1783603064177632 usec, L: 0
0709 13:17:44.177820 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:17:44.179853 (+  2033us) log.cc:844] Serialized 2441 byte log entry
0709 13:17:44.943755 (+763902us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:45.576451 (+632696us) op_driver.cc:464] REPLICATION: finished
0709 13:17:45.813034 (+236583us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fa3070ac 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f3200e47ef0
0709 13:17:46.036259 (+223225us) write_op.cc:301] APPLY: starting
0709 13:17:46.036352 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:46.189833 (+153481us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:46.189858 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:46.193598 (+  3740us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:46.193929 (+   331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:17:46.251194 (+ 57265us) write_op.cc:312] APPLY: finished
0709 13:17:46.256439 (+  5245us) log.cc:844] Serialized 65 byte log entry
0709 13:17:46.257270 (+   831us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.257382 (+   112us) write_op.cc:454] Released schema lock
0709 13:17:46.257429 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:46.259643 (+  2214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.259680 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25927,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":443784,"apply.run_cpu_time_us":13385,"apply.run_wall_time_us":223374,"cfile_cache_hit":22,"cfile_cache_hit_bytes":23001,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":31016,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":9,"num_ops":6,"prepare.queue_time_us":383627,"prepare.run_cpu_time_us":32278,"prepare.run_wall_time_us":515221,"raft.queue_time_us":376511,"raft.run_cpu_time_us":29816,"raft.run_wall_time_us":453332,"replication_time_us":1398448,"spinlock_wait_cycles":43350144,"thread_start_us":1317611,"threads_started":4,"wal-append.queue_time_us":637705,"wal-append.run_cpu_time_us":35314,"wal-append.run_wall_time_us":2446888}]]}
I20260709 13:17:49.726300  8923 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
W20260709 13:17:49.728273  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 136201us
I20260709 13:17:49.729964  8364 raft_consensus.cc:2410] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 12 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:17:49.730134  8928 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
W20260709 13:17:49.738178  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 91586.1us
I20260709 13:17:49.760663  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:49.761314  8920 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:49.762140  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 106954us
I20260709 13:17:49.764441  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:49.765436  8928 raft_consensus.cc:2410] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:49.676493 12517 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:49.769735  8183 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.716614 12379 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:49.786594  8186 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.782442 12414 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:49.791098 12414 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:49.806581  8921 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:49.775939 12517 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.794150 12414 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.779497 12099 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:49.814862  8360 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
W20260709 13:17:49.817176  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 142085us
I20260709 13:17:49.817924  8183 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:49.822058  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:49.822846  8928 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.786226 12591 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:49.782974 12583 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:49.832193  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.832722  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.833082  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.840766  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.826287 12417 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:49.859336  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.861709  8295 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:49.862584  8290 raft_consensus.cc:1240] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:49.868059  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 107115us
I20260709 13:17:49.869897  8186 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.871106  8186 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.826228 12099 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:49.824005 12295 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:49.889040  8288 raft_consensus.cc:2393] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:49.895975  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.896140  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:49.898103  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:49.873104 12630 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.905418  8928 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:49.887076 12417 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:49.906116  8290 raft_consensus.cc:2410] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:49.908859  8186 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:49.859197 12583 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.898240 12545 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:49.923384  8292 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:49.924922  8290 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:49.918383  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:49.926549  8288 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.876443 12591 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.896636 12379 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:49.929376  8295 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:49.931102 12295 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.931222 12672 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.927183 12014 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:49.929451 12258 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:49.940635  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51803us
I20260709 13:17:49.939597  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:49.922885 12354 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:17:49.944424  8290 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.952890  8919 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
W20260709 13:17:49.954035  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.962750 12665 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:17:49.963631 12666 log.cc:927] Time spent T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:17:49.964280 12266 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:49.966293 12583 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:49.966387 12266 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:49.967806  8289 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:49.969516 12480 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:49.977201 12671 log.cc:927] Time spent T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:17:49.977737  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:49.979188  8258 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:49.980563 12591 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:49.982546  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:49.982753  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:49.983454  8294 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:49.945816 12099 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:49.982641  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:49.987165  8293 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:49.987998  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.984678  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:49.989183  8292 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.993644  8920 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:49.995503  8926 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:49.997828  8363 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:49.998502 12510 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:49.998883  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:50.000370  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:50.001082  8361 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:50.001286 12258 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:50.001477 12417 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.002509  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.003377  8368 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:50.001937  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.008054  8361 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:50.008508  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:50.009682  8186 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.011366  8288 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:50.011626  8290 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:50.011910  8367 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:50.021667  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.012677  8261 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:50.014905 12510 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.016901 12414 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.019891 12266 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:50.024269  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.024987  8369 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:50.026460  8360 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:50.026630  8293 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:49.971900 12480 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:50.055359  8361 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:50.007367 12630 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:50.022879 12669 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:17:50.067092  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.033208 12591 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:50.091238  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 81680.5us
I20260709 13:17:50.092692  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:50.096184 12518 consensus_queue.cc:1059] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:17:50.097039 12518 raft_consensus.cc:3055] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:50.097371 12518 raft_consensus.cc:740] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:50.098186 12518 consensus_queue.cc:260] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.098796  8292 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:50.099326 12518 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:50.099522  8366 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:50.101061 12675 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:50.108191 12583 consensus_queue.cc:1048] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:50.067451 12625 consensus_queue.cc:1059] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:17:50.067364 12491 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:50.112243  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:50.061144 12678 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.121904  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 54731.5us
I20260709 13:17:50.122184  8186 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.125782  8369 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:50.027140 12517 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.131875  8183 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:50.088629 12480 raft_consensus.cc:3055] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:50.139168  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 46569us
I20260709 13:17:50.137915 12625 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:50.146699 12625 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.146987  8925 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:17:50.147708  8925 pending_rounds.cc:85] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 8
I20260709 13:17:50.147378 12521 consensus_queue.cc:1059] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:50.148454  8925 pending_rounds.cc:107] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:17:50.148785  8925 raft_consensus.cc:2889] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:50.148885  8183 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:50.147094 12625 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.133766 12678 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.148420 12418 raft_consensus.cc:3055] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:50.150403 12418 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:50.150624 12099 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:50.121192 12545 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:50.129410 12591 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:50.174803  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.185112  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.136307 12480 raft_consensus.cc:740] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:50.133064 12402 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:50.143549 12229 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:50.185760  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:50.229064  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.127550 12266 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:50.154573 12678 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:50.135421 12379 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:50.138404 12491 consensus_queue.cc:1059] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:17:50.235834  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 50145.2us
I20260709 13:17:50.243916  8183 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:50.229781 12592 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:50.252818  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 111201us
I20260709 13:17:50.234879 12229 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.132910  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:50.151338 12418 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.206414 12545 consensus_queue.cc:1243] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:50.206883 12258 consensus_queue.cc:1059] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:50.235543 12354 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.279124  8215 raft_consensus.cc:606] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:50.284493  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 99595.9us
W20260709 13:17:50.251206  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 185241us
I20260709 13:17:50.286784  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:50.287345  8258 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.278944 12229 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.289830 12354 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.293576 12354 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:50.281880 12521 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.296260  8186 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.297982  8186 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.301321  8367 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:50.301764 12414 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:50.302189 12402 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:50.303294 12624 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:50.304183 12354 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:50.285306 12342 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:50.310406  8362 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
W20260709 13:17:50.332993  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 43519.9us
I20260709 13:17:50.334832  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:50.311040 12418 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:50.337563 12688 log.cc:927] Time spent T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:17:50.339279 12342 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:50.340103 12354 raft_consensus.cc:697] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:50.319118 12402 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.319295 12624 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:50.340821 12685 log.cc:927] Time spent T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:50.342011 12672 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:50.349138  8925 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:50.336625  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 92787us
I20260709 13:17:50.350374  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:50.320637 12099 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:50.332921 12379 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.349905 12402 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.353832 12517 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:50.305317 12591 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.359074  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:50.359387  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:50.337558 12690 log.cc:927] Time spent T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:50.360395  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:50.383419  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53535408ea514f8db7292852927e7743"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:50.393399  8215 raft_consensus.cc:606] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.393831  8215 raft_consensus.cc:614] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:50.360179  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:50.394863  8923 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:50.361217  8924 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:50.397480  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:50.398324  8919 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:50.398386  8921 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:50.402854  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 104937us
W20260709 13:17:50.407152  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.407886  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 262467us
I20260709 13:17:50.417133  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:50.417299  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:50.379801 12379 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:50.420644  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:50.425693  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.380688 12696 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:50.428414  8286 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:50.355119 12695 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:50.430136  8920 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.399528 12678 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.457681 12397 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:50.458503 12354 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.375865 12229 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.466007  8261 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:50.469677 12703 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:50.471978 12703 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:50.472956 12703 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.476150 12693 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:50.477571 12402 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.478147  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:50.478395 12691 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.478927 12691 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.481006  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8942278c55614601a1290e32997fe007"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:50.481024 12697 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.380568 12099 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.480031  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:50.481797 12266 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:50.482559 12697 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:50.484115  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:50.484148 12342 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.485436 12697 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.485844 12697 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:50.486207 12697 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.487313 12414 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.487782 12414 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.467485 12672 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:50.488387 12625 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.463171 12696 raft_consensus.cc:697] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:50.490000 12696 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.481231 12229 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:50.490501 12625 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:50.494170 12697 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.490463 12414 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:50.479738 12402 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:50.466306 12678 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.496774  8332 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:50.497529 12414 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:50.498131 12678 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:50.451719 12630 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:17:50.383338 12624 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.498988 12479 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:50.499680 12624 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.500727  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:50.478027 12683 log.cc:927] Time spent T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.227s	user 0.003s	sys 0.000s
I20260709 13:17:50.501995  8261 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:50.481649  8215 raft_consensus.cc:606] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:50.462071 12421 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:50.504980  8215 raft_consensus.cc:614] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:50.506217 12697 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:50.506291  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.507035  8362 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.509236  8921 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:50.510514  8258 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.511251 12266 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:50.511718 12266 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:50.512674 12266 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.514070 12705 raft_consensus.cc:2764] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:17:50.515236  8925 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:50.516935  8923 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:50.517210 12480 consensus_queue.cc:260] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.518276 12480 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:50.521706  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.524068  8920 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:50.525216  8258 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.531256  8362 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:50.534694  8366 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:50.505092  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:50.535801  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:50.489069 12672 raft_consensus.cc:3055] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:50.502310 12630 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:50.536695  8286 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:17:50.481128 12691 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:50.548923  8367 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:50.522329 12421 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:50.553817  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 54934.2us
I20260709 13:17:50.560073  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:50.547693 12697 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:50.562273  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:50.543267 12672 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:50.577214  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:50.585750  8288 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:50.587015  8215 raft_consensus.cc:606] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.589632  8215 raft_consensus.cc:614] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:50.552585 12421 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:50.591847 12698 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:50.596210 12268 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:50.596727 12268 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:50.597801 12268 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.599320 12268 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.591887  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:50.605506  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 48432us
W20260709 13:17:50.607394  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.565320 12705 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:50.620067  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:50.586298 12697 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:50.624635  8215 raft_consensus.cc:606] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:50.625172  8215 raft_consensus.cc:614] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:50.625771  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.624534 12705 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:50.627713  8183 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:50.643802  8183 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:50.627036 12697 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:50.662667  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 235511us
I20260709 13:17:50.644788 12545 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:50.673337  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 48201.6us
I20260709 13:17:50.635721 12705 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.652673 12695 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:50.689742  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 164585us
I20260709 13:17:50.694005  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:50.718848  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.719636  8362 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.721045  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.722198  8360 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:50.722743  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.723639  8368 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:50.726471  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.730069  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:50.730135  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.731047  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:50.693537 12545 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:50.737851  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 48498.9us
I20260709 13:17:50.741118  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:50.741698  8361 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:50.742509  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.743013  8361 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.743566 12266 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:50.744118  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:50.745960  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:50.716948 12695 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:50.757448 12545 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.758554 12695 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.763643 12698 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:50.764708  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:50.764829 12624 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:50.765517 12698 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:50.766017  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:50.766724 12698 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:50.767163  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:50.767851 12698 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:50.768225 12698 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:50.768565 12698 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:50.755403 12421 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:50.796315  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 57713.1us
I20260709 13:17:50.800156  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:50.801873  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:50.800097  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:50.801945  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 102856us
I20260709 13:17:50.805814  8363 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:50.786439  8361 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 15.
I20260709 13:17:50.788693  8362 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:50.809809  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.817869  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:50.820299  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:50.824501  8362 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:50.825711  8365 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:50.819533  8211 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:50.834712  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:50.797861 12630 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:50.806051 12573 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.837021  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.838229  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:50.853348  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:50.841115  8362 raft_consensus.cc:3055] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:50.843917  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.855502  8362 raft_consensus.cc:740] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:50.866421  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:50.864289  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 269620us
I20260709 13:17:50.870918  8212 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:50.856554  8362 consensus_queue.cc:260] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:50.852618 12414 raft_consensus.cc:2764] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 13:17:50.876288  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 269495us
I20260709 13:17:50.877681  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:50.885644  8919 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:50.873206 12625 raft_consensus.cc:2764] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:17:50.923194  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 229236us
I20260709 13:17:50.925423  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:50.926193  8214 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:50.930135  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:50.930984  8214 raft_consensus.cc:2410] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:17:50.920384 12491 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.004s	sys 0.017s
I20260709 13:17:50.936529  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:50.930433 12665 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:50.936623  8288 pending_rounds.cc:85] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 7
I20260709 13:17:50.941629  8288 pending_rounds.cc:107] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:50.867026 12573 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:50.941949  8288 raft_consensus.cc:2889] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:50.944357  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:50.945138  8286 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:50.938016 12491 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.004s	sys 0.017s
I20260709 13:17:50.936866 12697 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:50.950640 12715 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:50.957263  8928 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:50.954011 12697 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:50.959654  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:50.959853  8921 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:50.930300 12699 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:50.967460  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:50.969877  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.967733  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:50.968417  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:50.971561  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:50.971827  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:50.970376  8214 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:50.973526  8218 raft_consensus.cc:2410] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:17:50.974123  8219 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:50.982532  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:50.983325  8213 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:50.984984  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:50.985976  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 61374.8us
I20260709 13:17:50.933209 12591 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:17:51.011349  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.012382  8361 raft_consensus.cc:2368] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11.
I20260709 13:17:51.008224  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.019289  8927 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:50.989813  8289 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 2 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:51.001554 12421 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:51.026262  8361 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:51.027442  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.035211  8212 raft_consensus.cc:1240] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:51.036144  8215 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:51.004094 12099 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:50.975066 12699 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.043471  8361 raft_consensus.cc:1275] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:51.058787  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:51.045336 12721 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:17:51.042192  8286 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 15.
I20260709 13:17:50.968734 12630 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.064586  8361 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:51.068321  8361 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:51.069733  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.070556  8361 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:51.072490  8215 raft_consensus.cc:1240] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:17:51.073421  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 46752.9us
I20260709 13:17:51.074162  8361 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:51.078828  8215 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:51.083652  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.039940 12735 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:51.091243  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.093804  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.094614  8293 raft_consensus.cc:2410] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:51.094218 12672 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.095218 12672 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:51.098506 12737 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:17:51.100059 12726 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:17:51.063248 12698 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.112895 12573 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.113031  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.113775  8365 raft_consensus.cc:2368] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12.
I20260709 13:17:51.114679 12698 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:51.119844 12732 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:17:51.124823  8293 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:17:51.133049  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 82139.5us
I20260709 13:17:51.134475  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.135382  8369 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:17:51.136189  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.136395  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.136816  8369 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:51.138161  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.140625 12699 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:51.141764  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.150290 12733 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.172351 12733 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.178859 12733 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.185860 12740 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:51.186254 12692 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:51.186728 12740 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.187651  8369 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:51.188746  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.189534  8369 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:51.186726 12692 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:51.194063 12697 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:51.194607 12697 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.194873 12692 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.196758 12697 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:51.195860 12692 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.202757 12510 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:51.205881  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.206881  8365 raft_consensus.cc:2393] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:51.197634 12740 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:51.190496  8332 connection.cc:256] RPC call timeout handler was delayed by -3.2011204110001472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:17:51.221380  8332 connection.cc:256] RPC call timeout handler was delayed by -3.095820410999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:17:51.222015  8332 connection.cc:256] RPC call timeout handler was delayed by -3.0688204110001607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 13:17:51.222494  8332 connection.cc:256] RPC call timeout handler was delayed by -3.0067204110000603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:17:51.222957  8332 connection.cc:256] RPC call timeout handler was delayed by -2.8960204110001087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 13:17:51.223850  8332 connection.cc:256] RPC call timeout handler was delayed by -2.7862204110001585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:17:51.224373  8332 connection.cc:256] RPC call timeout handler was delayed by -2.6548204110001734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:17:51.224840  8332 connection.cc:256] RPC call timeout handler was delayed by -2.5603204110000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 13:17:51.204787  8361 raft_consensus.cc:3055] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:51.205469 12510 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:51.214404  8362 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.218274  8258 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:51.225276  8332 connection.cc:256] RPC call timeout handler was delayed by -2.4055204109999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2404s for a response
I20260709 13:17:51.225742  8361 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:51.228842  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.229974  8361 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.231191  8361 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:51.235498  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.236678  8290 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:51.237035  8293 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:51.237653  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:51.238071  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:51.239157  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:51.240375  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.240996  8295 raft_consensus.cc:2368] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15.
I20260709 13:17:51.228629 12728 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:51.241808  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:51.240469  8294 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:51.242808  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:51.245067 12703 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.245570 12703 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.245894 12703 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.247944  8217 raft_consensus.cc:1240] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:51.249055  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.249804  8215 raft_consensus.cc:2368] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15.
I20260709 13:17:51.249256 12379 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Committing config change with OpId 8.7: config changed from index 2 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:51.251451  8286 raft_consensus.cc:2393] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 14: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:51.243249  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.252123  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.245929  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:51.243012  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.254945  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.256034  8217 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:51.257676  8294 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:51.257699  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.259603  8261 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:51.261097  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.261194  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:51.265105  8362 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:51.265456  8362 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:51.266120  8362 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.266647  8290 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:51.267113  8220 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:51.280294  8258 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:51.304013  8362 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.305356 12740 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.305699  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.305929 12740 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.307173  8220 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:51.308504  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.308712  8212 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:51.308786  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.309484  8216 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:51.305392 12630 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.310336 12630 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:51.310812 12630 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.267879 12699 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:17:51.311698  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.312974  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.314960  8365 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:51.315327  8365 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:51.268385 12733 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.318365  8218 raft_consensus.cc:1240] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:51.319761  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.321987 12521 raft_consensus.cc:3055] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:51.322392 12521 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:51.323264 12740 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.299789 12672 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.325614 12672 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.326030 12672 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.270190 12718 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:51.244282 12669 consensus_queue.cc:1059] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:17:51.336942 12669 raft_consensus.cc:3055] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:51.336741  8365 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.338115  8365 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.323331 12521 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.353997  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:51.354336 12521 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.337460 12669 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:51.365818 12669 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:51.374256  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.378155  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.419368  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.381887  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:51.434603  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 154426us
I20260709 13:17:51.435770  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:51.447162  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 142526us
I20260709 13:17:51.449411  8361 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:51.451459  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:51.465704  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.467095  8362 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:17:51.467424  8362 pending_rounds.cc:85] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 9
I20260709 13:17:51.467631  8362 pending_rounds.cc:107] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:51.467836  8362 raft_consensus.cc:2889] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:51.468160  8258 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:51.470145  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:51.471850  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:51.473043  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.473605  8220 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.451421 12718 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.451574 12669 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.455049 12740 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:51.455369 12583 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.486464  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.475632  8286 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:51.471354 12268 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.479079 12722 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:51.463367 12699 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:17:51.468804 12741 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:51.468523 12728 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:51.532687  8287 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:51.534277  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70391.5us
I20260709 13:17:51.541646 12731 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:51.542232 12731 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:51.544646  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 68721.7us
I20260709 13:17:51.534097 12583 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.527318 12740 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.479267 12697 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.550230  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:51.551759  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.547628 12722 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:51.588898  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.551487 12583 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:51.577137  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:51.575773  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.590256  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 43588.7us
I20260709 13:17:51.590369  8186 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:51.590798  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.584636  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 112871us
W20260709 13:17:51.591286  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.592077  8258 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:51.545020 12728 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.554623 12731 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:51.586664  8220 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:51.530707 12718 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:17:51.592662  8186 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:51.594519  8258 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:51.600422  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:51.603053  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:51.589594 12697 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:51.606904  8186 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:51.592782 12491 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:51.591252 12583 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.596329 12698 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.596107 12733 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.592936 12710 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.609933 12417 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:51.612643 12295 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:51.599134 12691 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.574720 12741 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.623242 12745 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:51.627010 12745 consensus_queue.cc:1243] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:51.605144 12550 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:51.612618 12491 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.610293 12697 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.624034  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:51.624514 12749 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:17:51.624783 12698 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.631656 12740 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
W20260709 13:17:51.633188 12742 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.626s	user 0.025s	sys 0.009s
I20260709 13:17:51.608224 12696 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.616940 12699 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.593335 12722 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.623442  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.605772 12630 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.660306  8364 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:51.664022 12722 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:51.666747  8367 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:51.671070  8295 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
W20260709 13:17:51.681166  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.681594 12741 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:51.684403  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 81436.9us
I20260709 13:17:51.686293 12696 consensus_queue.cc:1059] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:51.687500 12722 raft_consensus.cc:3055] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:51.687955 12722 raft_consensus.cc:740] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:51.689013 12698 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:51.688970 12722 consensus_queue.cc:260] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.691525  8258 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:51.693560  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.643569 12491 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.694659  8365 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
W20260709 13:17:51.701354  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.706456  8360 raft_consensus.cc:3055] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:51.706960  8360 raft_consensus.cc:740] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:51.645884 12550 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:51.707652  8365 pending_rounds.cc:85] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 9
W20260709 13:17:51.708786  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 92124.8us
W20260709 13:17:51.708937  8892 leader_election.cc:336] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.004s (SENT)
I20260709 13:17:51.710434  8365 pending_rounds.cc:107] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:17:51.710784  8365 raft_consensus.cc:2889] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:51.698045 12699 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:51.714874  8892 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:51.710613  8360 consensus_queue.cc:260] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:51.713862  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 58393.2us
W20260709 13:17:51.719249  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 95371.8us
I20260709 13:17:51.720755  8360 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.705884 12521 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.724953  8186 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:51.722857  8369 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 2 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:51.727905  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:51.703814 12692 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:17:51.725795 12741 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:51.757062  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:51.758005 12583 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.760233 12550 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.738662 12735 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.764412 12583 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.729872 12521 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.766772 12521 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:51.763571  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 60101.1us
I20260709 13:17:51.729236 12703 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.726027 12695 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.769050 12695 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.770215 12703 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.771123 12695 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:51.720875 12699 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:51.772212 12699 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.775447  8286 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:51.776867 12630 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.725708 12428 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.780846 12428 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:51.741932 12698 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.782405 12698 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:51.768530  8892 leader_election.cc:336] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Timed out: RequestConsensusVote RPC to 127.6.233.3:43697 timed out after 2.073s (SENT)
I20260709 13:17:51.782802 12698 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.784528 12740 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.785005 12740 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.786947 12672 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.787583  8924 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:51.733434 12733 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:17:51.789655  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:51.790009  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:51.795310  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:51.796109  8921 raft_consensus.cc:2410] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:17:51.796614 12491 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.796916  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:51.797641  8928 raft_consensus.cc:2393] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:51.740096  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:51.807171  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 67171.7us
W20260709 13:17:51.808658  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.799466 12698 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.820474  8360 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:17:51.821003  8360 pending_rounds.cc:85] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 8
I20260709 13:17:51.821312  8360 pending_rounds.cc:107] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:17:51.821610  8360 raft_consensus.cc:2889] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:51.822481  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.822957  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.829735  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 97965.3us
I20260709 13:17:51.831655 12731 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.832103  8361 pending_rounds.cc:85] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 6
I20260709 13:17:51.832463  8361 pending_rounds.cc:107] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:17:51.832842  8361 raft_consensus.cc:2889] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:51.833235  8927 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:17:51.835004  8927 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:51.835356  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.836090  8365 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:51.836369  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.839025  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:51.842885  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:51.843484  8919 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:51.844491  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:51.788949 12672 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.851408  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:51.851737  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:51.786960 12740 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.820122 12630 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.848095  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:51.789259 12741 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:51.854386  8360 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:51.859005  8360 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:51.847646  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:51.859830  8211 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:51.857472  8927 raft_consensus.cc:3060] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.861630  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.862635  8220 raft_consensus.cc:2368] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14.
I20260709 13:17:51.863610  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:51.865247  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 105887us
I20260709 13:17:51.866151  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:51.865270  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.866845  8218 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.865710  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:51.870102  8219 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.870600  8360 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.871868  8360 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:51.873169  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 145914us
I20260709 13:17:51.877580  8332 leader_election.cc:400] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15.
I20260709 13:17:51.878038  8332 leader_election.cc:403] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:51.868302 12672 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.846284 12731 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.866850 12697 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.898744 12698 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:51.882656 12759 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15.
I20260709 13:17:51.901641 12731 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:51.902089 12740 consensus_queue.cc:1048] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:17:51.866185 12741 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.905367 12741 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.906590 12728 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.887306 12672 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.908562 12672 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.910362 12697 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:51.911502  8362 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:51.930510  8218 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
W20260709 13:17:51.923017  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.932195  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.849545  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:51.940361  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.876226 12491 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:51.942840  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.943015  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.948710  8332 leader_election.cc:400] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15.
I20260709 13:17:51.944154  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:51.948004  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.950233  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.920771  8927 raft_consensus.cc:2468] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:51.952147  8922 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:51.951673  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.959122  8286 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:51.947512 12624 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.959946  8219 raft_consensus.cc:2468] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:51.959911 12624 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.953441 12697 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:51.941147  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:51.953994 12728 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:51.907984  8360 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:17:51.963554  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 644) took 1036 ms. Trace:
I20260709 13:17:51.966038  8360 pending_rounds.cc:85] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:51.966399  8360 pending_rounds.cc:107] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:51.966802  8360 raft_consensus.cc:2889] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:51.966156  8292 rpcz_store.cc:276] 0709 13:17:50.926660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.926810 (+   150us) service_pool.cc:224] Handling call
0709 13:17:50.936613 (+  9803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.074216 (+137603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.074246 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.074287 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:51.074319 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.963368 (+889049us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002e77d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:51.963411 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.963507 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316045568}
I20260709 13:17:51.965152  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:51.969669  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:51.969997  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:51.970475  8294 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:51.922804 12510 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:51.974001 12759 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.978500 12759 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.978866 12759 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.980523  8332 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:51.981254 12767 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:51.981644 12697 raft_consensus.cc:2804] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:51.982467 12510 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:51.987448  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 119793us
I20260709 13:17:51.971057 12741 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:51.986816 12591 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:17:51.988505  8892 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:51.975966 12669 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:17:51.993556 12728 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.993088 12733 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:17:51.993659  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:51.992902  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:51.999863  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:52.000638  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:52.001605  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.003276 12624 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:51.991003 12705 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.008150 12757 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.008036 12705 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:51.990398 12741 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:52.010167 12705 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:52.010556 12741 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:52.018959 12705 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:52.021898 12757 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.024377 12705 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:52.025411  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 172455us
W20260709 13:17:52.028256  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 154474us
I20260709 13:17:52.027850  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:52.031338  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:52.032397 12772 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:52.033008 12772 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:52.033249  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:52.033815  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:52.034674  8294 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.037415  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:51.990612 12697 raft_consensus.cc:697] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:52.041532 12697 consensus_queue.cc:237] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:52.042477 12731 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:52.043442 12731 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.046105  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:52.047603  8290 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:52.003810 12669 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:52.003940  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:52.057659  8360 raft_consensus.cc:2393] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:52.045182  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:52.065630  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:52.066376  8295 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:52.067274  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:52.033764 12722 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.068382  8293 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:52.069190  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:52.069456  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:52.070359  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:52.071586  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:52.073662  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47646.1us
I20260709 13:17:52.074337  8186 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:52.038448 12728 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:52.075695 12573 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.075842 12728 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:52.076364 12728 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.077423 12573 consensus_queue.cc:1059] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:52.079012  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.079422 12417 raft_consensus.cc:3055] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:52.079617  8219 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:52.079824 12417 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:52.080399  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:52.080648 12417 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:52.081586  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:52.082574  8220 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:52.082805  8362 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:52.083635  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:52.092944  8361 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.101811  8363 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:52.109606  8211 raft_consensus.cc:1240] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 11. Current term is 12. Ops: [10.5-11.6]
I20260709 13:17:52.099647  8186 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:52.114017  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 85120.5us
I20260709 13:17:52.097674 12428 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:52.094223 12624 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:52.129323  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:52.113070 12698 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:52.101150 12691 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.113606 12699 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.144402  8258 leader_election.cc:400] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14.
I20260709 13:17:52.169855  8258 leader_election.cc:403] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:52.118147 12731 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:52.163278  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.087203 12669 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.131832 12417 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:52.168339  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.152338  8361 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:52.179867  8294 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
W20260709 13:17:52.180768  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 147567us
I20260709 13:17:52.181497  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:52.170385  8118 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 191) took 7991 ms. Trace:
I20260709 13:17:52.142354 12735 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:52.131975 12767 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:52.124935 12295 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:17:52.146492 12354 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:17:52.218540  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.219225  8365 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:52.219796  8367 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:52.197671  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.225829  8220 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:52.124219 12764 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:17:52.169070 12592 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:52.215045  8261 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:52.178026 12731 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.190075  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:52.180491 12699 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.246443  8288 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.248643  8367 pending_rounds.cc:85] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 7
I20260709 13:17:52.272250  8367 pending_rounds.cc:107] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:17:52.184350 12698 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:52.250664  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:52.251603  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 70178.9us
I20260709 13:17:52.284479  8362 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.285131  8258 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:52.246306  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:52.286847  8363 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
W20260709 13:17:52.287634  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 72659.2us
I20260709 13:17:52.185729 12705 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.213017 12735 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.207741  8294 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:52.190481 12718 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:17:52.189164  8118 rpcz_store.cc:276] 0709 13:17:44.151085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.151456 (+   371us) service_pool.cc:224] Handling call
0709 13:17:44.642911 (+491455us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37b090 00007f31fd419f3a 00007f32031d01cc 00007f32032ce37e 00007f320178f2a4 00007f320178f232 00007f320178f161 00007f320178f0dc 00007f320178e392 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:52.142100 (+7499189us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:50.252355 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:50.291766 (+ 39411us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:50.291904 (+   138us) write_op.cc:435] Acquired schema lock
0709 13:17:50.291926 (+    22us) tablet.cc:662] Decoding operations
0709 13:17:50.293101 (+  1175us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:50.293185 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:50.293209 (+    24us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:17:50.294335 (+  1126us) tablet.cc:701] Row locks acquired
0709 13:17:50.294388 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:17:50.294545 (+   157us) write_op.cc:270] Start()
0709 13:17:50.294696 (+   151us) write_op.cc:276] Timestamp: P: 1783603070294478 usec, L: 0
0709 13:17:50.294730 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:17:50.295441 (+   711us) log.cc:844] Serialized 4362 byte log entry
0709 13:17:50.973499 (+678058us) op_driver.cc:464] REPLICATION: finished
0709 13:17:51.143427 (+169928us) write_op.cc:301] APPLY: starting
0709 13:17:51.143557 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:51.216961 (+ 73404us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:51.217050 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:51.605359 (+388309us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:51.615464 (+ 10105us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:17:51.615550 (+    86us) write_op.cc:312] APPLY: finished
0709 13:17:51.619490 (+  3940us) log.cc:844] Serialized 105 byte log entry
0709 13:17:51.623352 (+  3862us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:51.623493 (+   141us) write_op.cc:454] Released schema lock
0709 13:17:51.623564 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:51.623956 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:51.623983 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":145775,"reported_tablets":19,"spinlock_wait_cycles":981025152,"child_traces":[["op",{"apply.queue_time_us":133595,"apply.run_cpu_time_us":18169,"apply.run_wall_time_us":480515,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":168469,"prepare.run_cpu_time_us":45683,"prepare.run_wall_time_us":241838,"raft.queue_time_us":252237,"raft.run_cpu_time_us":7221,"raft.run_wall_time_us":196423,"replication_time_us":639965,"thread_start_us":476058,"threads_started":4,"wal-append.queue_time_us":263127}]]}
I20260709 13:17:52.169600 12702 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:17:52.320575  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:52.283371  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 93354.8us
I20260709 13:17:52.321614  8294 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:52.294054  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.207082 12672 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:52.324110  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.248148 12428 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:52.272852  8367 raft_consensus.cc:2889] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:52.303422  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.262100 12731 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.312757  8288 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:52.296193 12268 raft_consensus.cc:2804] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:52.314549  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:52.321470  8295 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:52.294654 12771 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:52.328486  8362 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
W20260709 13:17:52.337551  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51086.3us
I20260709 13:17:52.285862 12707 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:52.206549 12728 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:52.354305  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:52.306960 12735 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.320648 12702 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:52.222081 12767 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.357533  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.379364  8220 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:52.355552  8294 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:52.358734  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.324811 12696 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:52.362021  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:52.388080  8922 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:52.386889 12354 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:52.398741 12759 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.365895 12268 raft_consensus.cc:697] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:52.400530 12777 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:17:52.400868 12268 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.402758 12480 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:52.403252 12480 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.405365 12480 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:52.357951 12545 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:17:52.366636 12772 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:52.357949 12521 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:17:52.408713  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.409992  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:52.410791 12699 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:52.411113  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.412696 12669 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:52.414093  8261 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:52.414455 12672 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:52.416500 12728 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:52.416949 12591 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:52.417418 12591 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.417809 12591 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.418035  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2424) took 1489 ms. Trace:
I20260709 13:17:52.417968  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:52.418919  8220 raft_consensus.cc:2393] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:52.419948  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.420768  8290 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:52.432531  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:52.438022  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 366447us
I20260709 13:17:52.418557  8289 rpcz_store.cc:276] 0709 13:17:50.928660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.929653 (+   993us) service_pool.cc:224] Handling call
0709 13:17:50.938708 (+  9055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.938943 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:51.122868 (+183925us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.013765 (+890897us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b180043a020. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa321455 00007f3200e093c7 00007f31fd41b9a7 00007f31fd42b0bf 00007f31fd42b038
0709 13:17:52.246472 (+232707us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.417406 (+170934us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.417620 (+   214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.417678 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:52.417729 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.417803 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.417984 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151350,"prepare.queue_time_us":433387,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2009,"raft.queue_time_us":77460,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":4613,"spinlock_wait_cycles":12775296,"thread_start_us":330007,"threads_started":2}
I20260709 13:17:52.341044 12428 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.439997  8362 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:52.363996 12702 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:52.440824  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:52.419715 12779 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:52.468387 12775 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:17:52.469049 12767 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:52.469154 12428 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:52.474006  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:52.474792  8925 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
W20260709 13:17:52.479344  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 362327us
I20260709 13:17:52.482939 12778 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.483518 12778 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:52.436729 12354 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:52.439502 12741 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:52.490579  8925 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:52.461282 12099 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:52.494655  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:52.502691 12510 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.520s	user 0.003s	sys 0.007s
I20260709 13:17:52.504076 12702 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.506947 12759 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:52.485888 12778 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:52.461287 12728 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:52.554481  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 59894.3us
I20260709 13:17:52.508890  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:52.442313 12698 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.507509 12099 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:52.587543  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:52.618932  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:52.620348  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:52.621610  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:52.622867  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:17:52.625227  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 184457us
W20260709 13:17:52.626617  8928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.003s	sys 0.021s
W20260709 13:17:52.627020  8928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.003s	sys 0.021s
I20260709 13:17:52.507735 12521 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:17:52.593910 12342 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:52.672600  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.669883 12697 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
W20260709 13:17:52.718647  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.612346 12705 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14.
I20260709 13:17:52.845845 12518 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:52.846475 12791 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:52.846567 12518 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:52.848169 12793 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:52.853284  8287 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
W20260709 13:17:52.794672  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 286199us
I20260709 13:17:52.587632 12728 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:52.681257 12783 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:52.803572  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 247897us
I20260709 13:17:52.798369 12295 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:52.495251 12545 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:17:52.830891 12772 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:52.677807 12765 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.193s
I20260709 13:17:52.763320 12354 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.487416 12779 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:52.840235  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.999027  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:52.870216  8367 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:52.835271 12691 consensus_queue.cc:1059] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:17:52.786562  8925 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 2 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:52.783095 12735 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:52.803493 12695 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:52.840608 12342 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:52.969420  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.973654  8286 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:52.825016  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 193207us
I20260709 13:17:52.521580 12786 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:52.942986 12521 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:17:53.004590  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 381734us
I20260709 13:17:52.880762 12782 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:53.034576  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:53.037570  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:53.072012  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:53.072396  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:53.073068  8363 raft_consensus.cc:2393] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:52.999882 12518 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:52.896497 12295 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.006915 12778 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:53.076655  8211 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:53.037575 12342 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:53.106217  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 71762us
I20260709 13:17:53.114704  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:53.046993 12772 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:17:53.140405 12785 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.353s	user 0.001s	sys 0.009s
W20260709 13:17:53.142308 12798 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:17:53.144266 12808 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:17:53.145859 12797 log.cc:927] Time spent T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
W20260709 13:17:53.146953 12789 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:17:53.147039 12733 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:53.147651 12733 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:53.148301  8926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 821) took 1059 ms. Trace:
I20260709 13:17:53.148557 12733 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:53.149564 12762 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:53.149986  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2157) took 1076 ms. Trace:
I20260709 13:17:53.150260 12733 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.152885 12697 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:53.154181 12697 raft_consensus.cc:3055] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:53.153890 12099 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.154654 12697 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:53.155020 12099 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.887821 12783 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.157728 12783 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.158347 12783 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.158901 12783 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.159865  8919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 820) took 1071 ms. Trace:
I20260709 13:17:53.160243  8919 rpcz_store.cc:276] 0709 13:17:52.088904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.089018 (+   114us) service_pool.cc:224] Handling call
0709 13:17:52.089300 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.109664 (+ 20364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.109707 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.114027 (+  4320us) log.cc:844] Serialized 26 byte log entry
0709 13:17:52.438766 (+324739us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:52.438818 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.438909 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.159655 (+720746us) raft_consensus.cc:1685] finished
0709 13:17:53.159678 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.159808 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8079,"raft.queue_time_us":52417,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":24690,"thread_start_us":321865,"threads_started":1,"wal-append.queue_time_us":477024}
I20260709 13:17:53.161267 12779 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.164127 12735 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.079447 12695 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:53.167742 12417 consensus_meta.cc:287] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.958s	user 0.007s	sys 0.000s
I20260709 13:17:53.169060 12695 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.169432 12295 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.171695 12784 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:53.172449 12784 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:53.173553 12784 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.149247  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:53.150466  8368 rpcz_store.cc:276] 0709 13:17:52.073152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.083995 (+ 10843us) service_pool.cc:224] Handling call
0709 13:17:52.100560 (+ 16565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.392829 (+292269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.392858 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.393275 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:17:52.753924 (+360649us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:52.753984 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.754072 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.149690 (+395618us) raft_consensus.cc:1685] finished
0709 13:17:53.149717 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.149887 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79220,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":896,"thread_start_us":602967,"threads_started":2,"wal-append.queue_time_us":410176}
I20260709 13:17:53.076292 12786 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:53.078516 12691 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.105623 12518 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:53.148721  8926 rpcz_store.cc:276] 0709 13:17:52.089169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.089560 (+   391us) service_pool.cc:224] Handling call
0709 13:17:52.089967 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.181215 (+ 91248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.181244 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.183692 (+  2448us) log.cc:844] Serialized 26 byte log entry
0709 13:17:52.480232 (+296540us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:52.784585 (+304353us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.843862 (+ 59277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.843953 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.148095 (+304142us) raft_consensus.cc:1685] finished
0709 13:17:53.148119 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.148243 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26343,"prepare.queue_time_us":692324,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":93703,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":24591,"thread_start_us":593726,"threads_started":4,"wal-append.queue_time_us":331572}
I20260709 13:17:53.198304  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:53.199057  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:53.200184  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:53.205421  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:53.206115  8215 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.198943  8213 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
W20260709 13:17:53.208359  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.216187  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 732332us
I20260709 13:17:53.075783 12521 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.223583  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 822) took 1134 ms. Trace:
I20260709 13:17:53.208356 12624 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.224640 12702 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.225140 12624 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.225539 12624 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.189833 12718 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.228168 12718 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.224058  8921 rpcz_store.cc:276] 0709 13:17:52.089434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.089560 (+   126us) service_pool.cc:224] Handling call
0709 13:17:52.112564 (+ 23004us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:52.478018 (+365454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.478058 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:52.478771 (+   713us) log.cc:844] Serialized 52 byte log entry
0709 13:17:52.640910 (+162139us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:53.197411 (+556501us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.223273 (+ 25862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.223349 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.223388 (+    39us) raft_consensus.cc:1685] finished
0709 13:17:53.223400 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.223532 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25008,"prepare.queue_time_us":532005,"prepare.run_cpu_time_us":175,"prepare.run_wall_time_us":175,"raft.queue_time_us":108921,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":14109,"thread_start_us":928701,"threads_started":3,"wal-append.queue_time_us":545832}
I20260709 13:17:53.229945 12783 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:53.230265 12718 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:53.231309  8920 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:53.228609 12759 raft_consensus.cc:3055] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:53.235158  8920 raft_consensus.cc:1240] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:53.070115 12780 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 13:17:53.236001  8926 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:53.239916  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 818) took 1151 ms. Trace:
I20260709 13:17:53.240425  8922 rpcz_store.cc:276] 0709 13:17:52.088161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.092243 (+  4082us) service_pool.cc:224] Handling call
0709 13:17:52.114461 (+ 22218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.391845 (+277384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.239644 (+847799us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540059f6d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:53.239849 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628603264}
I20260709 13:17:53.184706 12696 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:53.193929 12295 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.194836 12707 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.266983  8211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1918) took 1068 ms. Trace:
I20260709 13:17:53.267189 12707 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.223466 12800 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.197355 12757 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.267573  8116 catalog_manager.cc:5697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 9 to 10, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 10 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.255865 12705 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.267462  8211 rpcz_store.cc:276] 0709 13:17:52.187003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.187780 (+   777us) service_pool.cc:224] Handling call
0709 13:17:52.204459 (+ 16679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.128075 (+923616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.245997 (+117922us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54000370d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:53.254980 (+  8983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005227904}
I20260709 13:17:53.196965 12691 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.363284  8116 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.208220 12518 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.268723 12295 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.378010 12757 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.370947 12795 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:53.239081 12759 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:53.381774  8220 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
W20260709 13:17:53.382572  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.379794 12800 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.386822  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:53.390405  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.402223  8286 raft_consensus.cc:2393] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:53.406046  8927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.006s	sys 0.028s
I20260709 13:17:53.405887  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:53.268791 12591 consensus_meta.cc:287] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.832s	user 0.005s	sys 0.005s
I20260709 13:17:53.273240 12811 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:53.364097 12801 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:17:53.409250  8892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.034s
I20260709 13:17:53.281914 12794 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.413909  8186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.009s	sys 0.029s
I20260709 13:17:53.275653 12728 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:53.415941  8892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.034s
W20260709 13:17:53.408252  8927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.006s	sys 0.028s
I20260709 13:17:53.280771 12792 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.421550  8186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.009s	sys 0.029s
I20260709 13:17:53.379608 12696 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.408480 12268 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.399080 12480 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.425539  8890 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.020s	sys 0.017s
W20260709 13:17:53.435963  8890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.020s	sys 0.017s
W20260709 13:17:53.436986  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.430083 12792 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:53.439079 12796 log.cc:927] Time spent T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:17:53.416244 12672 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.441895  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:53.408684 12718 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.408900 12510 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.443995  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:53.445442  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:53.446107  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:53.460186  8363 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:53.387472 12705 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:53.464601  8183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.018s
W20260709 13:17:53.475472  8183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.000s	sys 0.019s
W20260709 13:17:53.475788  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 594874us
I20260709 13:17:53.365162 12697 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.372265  8116 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 7 to 9, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 9 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.466355  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:53.467608  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:53.468273 12728 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:53.470808  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:53.471459  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:53.493868  8927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 819) took 1405 ms. Trace:
I20260709 13:17:53.415589 12591 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.363138 12772 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.481977  8923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 949) took 1013 ms. Trace:
W20260709 13:17:53.498245  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.499238 12669 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.484414  8215 raft_consensus.cc:2468] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:53.458524 12722 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.513700  8217 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:53.512357  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 474799us
I20260709 13:17:53.516206  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:53.465214  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:53.471105 12718 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.523167  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:53.522439  8218 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:53.499828  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:53.516834  8290 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:53.513898  8927 rpcz_store.cc:276] 0709 13:17:52.088554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.088684 (+   130us) service_pool.cc:224] Handling call
0709 13:17:52.088979 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:52.096996 (+  8017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.097025 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:52.114100 (+ 17075us) log.cc:844] Serialized 52 byte log entry
0709 13:17:52.393500 (+279400us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:52.591718 (+198218us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.231437 (+639719us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b18002930e0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa3243f3 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:17:53.424367 (+192930us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.460455 (+ 36088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.460541 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.493638 (+ 33097us) raft_consensus.cc:1685] finished
0709 13:17:53.493658 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.493807 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215078,"prepare.queue_time_us":677160,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":632484,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":24779,"spinlock_wait_cycles":36581632,"thread_start_us":1081715,"threads_started":3,"wal-append.queue_time_us":377796}
I20260709 13:17:53.575981  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:53.577469  8287 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:53.522480  8923 rpcz_store.cc:276] 0709 13:17:52.468219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.472389 (+  4170us) service_pool.cc:224] Handling call
0709 13:17:52.503116 (+ 30727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.503317 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:52.806028 (+302711us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.481569 (+675541us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.481634 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:53.481693 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.481777 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.481911 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103954,"prepare.queue_time_us":669474,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":190794,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":12094,"spinlock_wait_cycles":46541568,"thread_start_us":874914,"threads_started":3,"wal-append.queue_time_us":471140}
I20260709 13:17:53.460217 12592 consensus_queue.cc:1059] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:17:53.509330 12782 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:53.458832 12480 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:53.606257  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 81909.4us
I20260709 13:17:53.458127 12268 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.614143  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 954) took 1144 ms. Trace:
I20260709 13:17:53.614591  8925 rpcz_store.cc:276] 0709 13:17:52.469711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.785745 (+316034us) service_pool.cc:224] Handling call
0709 13:17:52.786143 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.786415 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:53.115367 (+328952us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.608597 (+493230us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.613639 (+  5042us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.613814 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.613866 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:53.613913 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.613979 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.614090 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85358,"raft.queue_time_us":129,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6720,"thread_start_us":407220,"threads_started":1}
I20260709 13:17:53.617894  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:53.598694 12731 consensus_meta.cc:287] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 1.242s	user 0.013s	sys 0.008s
I20260709 13:17:53.363453 12786 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.463490 12672 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.567001 12518 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.517963 12810 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.425658 12794 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.471354 12510 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.633073  8116 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 8 to 9, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 9 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.642536  8286 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:53.650082  8928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54804 (request call id 823) took 1555 ms. Trace:
I20260709 13:17:53.663411  8928 rpcz_store.cc:276] 0709 13:17:52.095147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.095578 (+   431us) service_pool.cc:224] Handling call
0709 13:17:52.114220 (+ 18642us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:52.675681 (+561461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.675739 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:52.828329 (+152590us) log.cc:844] Serialized 52 byte log entry
0709 13:17:53.018410 (+190081us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:53.018470 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.018639 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.649809 (+631170us) raft_consensus.cc:1685] finished
0709 13:17:53.649837 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.650011 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11750,"raft.queue_time_us":142260,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":24917,"thread_start_us":611077,"threads_started":2,"wal-append.queue_time_us":524377}
I20260709 13:17:53.567137 12669 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.463304 12759 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.652328 12757 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:53.519824 12764 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:17:53.525331 12728 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.640915 12592 consensus_queue.cc:1243] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:53.574717 12722 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.644627 12699 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.638701 12824 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:53.645187 12521 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:53.666750 12295 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.731498  8925 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:53.638459 12731 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:53.697093 12698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.020s	sys 0.027s
I20260709 13:17:53.693248 12518 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:53.790912 12843 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:53.810209  8921 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:53.793956 12807 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.281s
W20260709 13:17:53.796823 12823 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:17:53.797740 12815 log.cc:927] Time spent T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:17:53.832935  8924 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 948) took 1372 ms. Trace:
I20260709 13:17:53.833039 12728 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.798111 12722 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:53.799865 12669 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.731396 12699 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:53.813905 12624 consensus_meta.cc:287] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.000s
I20260709 13:17:53.747077 12759 raft_consensus.cc:3060] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.667299 12810 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:53.763844 12698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.020s	sys 0.027s
I20260709 13:17:53.821007 12510 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.821410 12843 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.822551 12846 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.828667 12731 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:53.830127 12794 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:53.757867 12691 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:53.833315  8924 rpcz_store.cc:276] 0709 13:17:52.460814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.461398 (+   584us) service_pool.cc:224] Handling call
0709 13:17:52.494401 (+ 33003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.494720 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.494747 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.507016 (+ 12269us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.003150 (+496134us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:53.003276 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.003481 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.832719 (+829238us) raft_consensus.cc:1685] finished
0709 13:17:53.832740 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.832877 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9090,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":495584,"threads_started":1,"wal-append.queue_time_us":954982}
W20260709 13:17:53.840866  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 187093us
I20260709 13:17:53.810444  8116 catalog_manager.cc:5697] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 4 to 10, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 10 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.764670 12836 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:53.840521 12428 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:53.918303  8261 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:53.813568 12518 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:53.925482  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.850751 12268 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:53.931195  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.932124  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.747505 12824 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:53.934281  8116 catalog_manager.cc:5697] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:53.936743  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.938371  8116 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 11 to 12, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:53.941418  8116 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.850292 12624 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:53.910125 12705 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:53.916013 12800 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:53.912493 12573 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:53.958701  8261 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:53.985731  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.994506  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:54.055998  8215 raft_consensus.cc:606] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:54.019006 12591 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.020964 12718 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.029899 12839 raft_consensus.cc:3055] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:54.039563 12782 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:54.059768  8361 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.015s	sys 0.011s
I20260709 13:17:54.067276  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.067772  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:53.926857 12845 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:53.955760 12794 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:54.100539  8361 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.016s	sys 0.011s
I20260709 13:17:54.070195  8116 catalog_manager.cc:5697] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 8 to 9, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 9 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.100193  8332 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:54.072551  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.098999  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2444) took 1734 ms. Trace:
I20260709 13:17:53.936473 12428 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.102983  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.104104  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:54.108731  8217 consensus_meta.cc:287] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.000s
I20260709 13:17:53.958406 12784 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.113387  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.054400 12480 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.068456 12698 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.103994 12268 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:54.117105 12847 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:17:54.119345 12831 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:54.075956 12672 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:54.075834  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 117221us
I20260709 13:17:54.126935 12669 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.102843 12782 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.077034 12800 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.129284  8217 raft_consensus.cc:2468] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
W20260709 13:17:54.130095  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 56451.5us
I20260709 13:17:54.102533 12491 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.101917 12521 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.928720 12836 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.210023  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:53.919792 12846 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.103113 12705 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.100710 12839 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:54.104758 12718 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.070750 12573 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.172207  8116 catalog_manager.cc:5697] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 7 to 10, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 10 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.175290  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:54.177042  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:54.178078  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.210088  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.212595  8295 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:54.213860  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:54.253861  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.142539 12784 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.152324 12698 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:54.358543  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.362847  8289 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:54.254247 12691 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.251497 12510 consensus_queue.cc:1059] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:17:54.254973 12709 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.364157 12691 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.364645  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.265669  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.260763  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.372457  8287 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:54.332669  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 81536.1us
W20260709 13:17:54.333930  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 233850us
I20260709 13:17:54.262923 12836 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:54.365860 12698 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.272375  8368 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:54.384477  8368 pending_rounds.cc:85] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 5
I20260709 13:17:54.265233  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.363232  8217 raft_consensus.cc:606] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:54.172924 12669 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.369783  8364 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:17:54.263062  8365 raft_consensus.cc:1240] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:54.210412 12800 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:54.394589 12099 consensus_meta.cc:287] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.239s	user 0.012s	sys 0.011s
I20260709 13:17:54.395244  8213 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:54.395905 12824 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.399313 12669 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.372716  8289 raft_consensus.cc:2410] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:54.400947 12710 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:54.401465 12710 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:54.402613  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.263785 12844 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.112794 12845 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.384821  8368 pending_rounds.cc:107] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:54.386741  8360 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:54.407196  8368 raft_consensus.cc:2889] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.387198  8293 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 14: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:17:54.388216  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 215050us
I20260709 13:17:54.325449 12862 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.391553 12698 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.438069  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.261132 12521 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.384560 12839 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.387871 12836 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:54.373410  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:54.457525  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:54.457844  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 84513.7us
I20260709 13:17:54.458148  8215 raft_consensus.cc:3060] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.458628  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:54.459270  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.332201 12699 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.434916  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.435130  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.436537  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.236224 12491 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.383237 12759 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:54.453337  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 65799.9us
W20260709 13:17:54.262153 12861 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:17:54.466507  8220 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:54.484493  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.485281  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:54.485913  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.466475  8216 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:54.396217 12800 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.470268  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.370466 12705 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.471477  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.491695  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.432377 12592 raft_consensus.cc:3055] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:54.438560 12853 log.cc:927] Time spent T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:17:54.474335  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.470041  8116 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:54.478314  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:54.487002  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.438252 12550 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.499047  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.499897  8220 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:54.502490  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:54.440137 12518 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.443665 12862 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.513320  8369 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:54.513603  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.453382 12698 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.480011 12624 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:54.492094  8212 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:54.391065 12718 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.495976 12592 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:54.443643 12872 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.506646  8258 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:54.390341 12709 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.526954  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.533136  8289 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:54.490460  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.534551  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.556257  8366 raft_consensus.cc:2410] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:54.556239  8183 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:54.535504 12696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.014s	sys 0.046s
I20260709 13:17:54.484297 12699 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.562971  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.499727 12839 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:54.500072 12843 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:54.500861 12836 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:54.545941  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.543036  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2720) took 1100 ms. Trace:
I20260709 13:17:54.543802  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.536140  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.512109 12800 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:54.527489 12342 consensus_meta.cc:287] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 1.391s	user 0.020s	sys 0.008s
I20260709 13:17:54.555672 12807 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.512405 12550 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.493816  8116 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 6 to 7, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:54.503979  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:54.559062  8215 raft_consensus.cc:2468] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:54.560968  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:54.520514 12784 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:54.563644  8214 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:54.430011 12844 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.598307 12784 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:54.598471  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.502272 12759 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.599320  8214 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:54.600330 12759 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:54.601354 12695 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:54.579177  8361 rpcz_store.cc:276] 0709 13:17:53.442897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.444486 (+  1589us) service_pool.cc:224] Handling call
0709 13:17:53.444741 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.444929 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:54.111273 (+666344us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.542615 (+431342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.542693 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:54.542749 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.542830 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.542969 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107274,"prepare.queue_time_us":346268,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":201870,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7158,"thread_start_us":989659,"threads_started":3,"wal-append.queue_time_us":361142}
I20260709 13:17:54.605340  8361 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:54.553164  8287 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:54.587391 12870 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:54.455951 12710 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.608753 12521 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.608867 12710 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.609057 12873 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:54.610504 12871 log.cc:927] Time spent T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:17:54.611410 12813 log.cc:927] Time spent T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.040s	user 0.003s	sys 0.003s
I20260709 13:17:54.612102  8290 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:17:54.612298 12858 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 13:17:54.613443 12868 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:17:54.560655 12872 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.124787  8291 rpcz_store.cc:276] 0709 13:17:52.365003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.365193 (+   190us) service_pool.cc:224] Handling call
0709 13:17:52.365510 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.365733 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:52.416863 (+ 51130us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.068798 (+1651935us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.098615 (+ 29817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.098665 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:54.098757 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.098834 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.098947 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":708661,"prepare.queue_time_us":294251,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":763559,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":12541,"thread_start_us":971862,"threads_started":3,"wal-append.queue_time_us":379189}
I20260709 13:17:54.617861 12845 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:54.618768  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.619350 12510 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.619542 12705 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.588063 12852 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:17:54.619866 12510 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.620766 12846 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.561124 12624 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:54.621024 12707 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.562706 12669 raft_consensus.cc:2804] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:54.621793 12669 raft_consensus.cc:697] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:54.592577 12869 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:17:54.527741 12480 consensus_queue.cc:1059] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:17:54.622766 12669 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.623503 12480 raft_consensus.cc:3055] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:54.534179 12099 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:54.623890 12480 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:17:54.568174 12696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.015s	sys 0.047s
I20260709 13:17:54.566442 12702 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.624917 12480 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.625349 12702 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.625777 12702 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.626026 12480 raft_consensus.cc:3060] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.626374  8213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1923) took 1180 ms. Trace:
I20260709 13:17:54.533977 12745 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:17:54.626773  8213 rpcz_store.cc:276] 0709 13:17:53.445794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.445897 (+   103us) service_pool.cc:224] Handling call
0709 13:17:54.626221 (+1180324us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b5400199454. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:54.626320 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146873600}
I20260709 13:17:54.630882  8360 raft_consensus.cc:2468] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:54.596273 12699 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.633335 12807 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.637192  8921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 961) took 2165 ms. Trace:
I20260709 13:17:54.637545  8921 rpcz_store.cc:276] 0709 13:17:52.471457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.229148 (+757691us) service_pool.cc:224] Handling call
0709 13:17:53.229442 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.810651 (+581209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.636991 (+826340us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400619254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:54.637139 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335137664}
I20260709 13:17:54.611248 12859 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.612993 12592 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.640296  8212 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:54.588399 12491 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.567674 12810 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:54.554003  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 47452.6us
W20260709 13:17:54.672878  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.673372  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:54.675158  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:54.590546 12733 consensus_meta.cc:287] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 1.440s	user 0.011s	sys 0.011s
I20260709 13:17:54.649082  8286 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1768) took 1149 ms. Trace:
I20260709 13:17:54.676620  8286 rpcz_store.cc:276] 0709 13:17:53.499470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.499595 (+   125us) service_pool.cc:224] Handling call
0709 13:17:54.648907 (+1149312us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b54001289d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:54.649017 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169653120}
I20260709 13:17:54.677480  8215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:54.678084  8215 raft_consensus.cc:606] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:54.666891  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 163001us
I20260709 13:17:54.679123  8261 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:54.679616  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:54.592877 12342 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.670466  8287 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:54.620245 12705 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.669763  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 108900us
I20260709 13:17:54.690512  8261 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:54.683107  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.693523  8293 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:54.698263  8183 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:54.705468  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.710098  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.684319 12268 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:54.688634 12592 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:54.718462  8218 raft_consensus.cc:2368] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14.
I20260709 13:17:54.683188 12573 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.695958 12691 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.696084 12672 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.695727 12854 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:54.667634 12859 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.718899 12268 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:54.733438 12782 consensus_meta.cc:287] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:17:54.704733 12705 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.696255 12846 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.728371 12550 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.713852 12733 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.751250  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.730988  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:54.709513 12479 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:54.752450 12268 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:54.732862 12099 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.735718 12342 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.740407 12672 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.743117 12854 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.792470 12854 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.792495 12718 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.794852 12705 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.762938  8362 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:54.796125 12876 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:54.796950  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.798430  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:54.695087 12826 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:17:54.743022 12428 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.755458 12699 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.787530  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:54.803247 12702 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.803656  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:54.754215 12709 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.797179 12844 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.805284 12876 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:54.806147 12876 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.806564 12876 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.806955 12876 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.767306 12807 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.808429 12695 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:54.808979 12702 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.812471 12691 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:54.816854  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:54.817445  8213 raft_consensus.cc:606] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:54.817754  8213 raft_consensus.cc:614] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:54.818346 12854 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.799654  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:54.820574 12880 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:54.821027  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:54.821704  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.790481  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 59611.4us
I20260709 13:17:54.834539  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:54.834750  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.837138  8365 raft_consensus.cc:2393] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:54.845563  8362 raft_consensus.cc:2393] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 14: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:54.822564  8332 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:54.846704  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.853036  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.768069 12479 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.857599  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:54.859615  8258 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:54.860255  8365 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:54.860966  8258 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:54.770659 12872 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.833245 12672 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.863111  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:17:54.863854  8213 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:54.857226 12691 raft_consensus.cc:2804] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:54.845834 12379 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.871302  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.871928  8214 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:54.872887  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.873863  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.874493  8214 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:54.875123  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.877116 12792 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:54.878866  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:54.865476 12878 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:17:54.880417  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.881002  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:54.881681  8216 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:54.882388  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.882895  8216 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:54.884141  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.833456 12843 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.766158 12733 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.760663 12782 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.835719 12862 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:54.880003  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.764338 12846 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.870723  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.870874  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.870925 12691 raft_consensus.cc:697] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:54.881498  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.884933  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:54.861346  8332 connection.cc:256] RPC call timeout handler was delayed by -1.2142626109998673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:17:54.859905 12479 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.886502  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.868815  8217 raft_consensus.cc:606] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:54.861387 12757 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:54.862464 12696 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:54.907418  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.907629  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.913276  8215 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: [11.6-12.7]
I20260709 13:17:54.913728  8289 raft_consensus.cc:2368] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 14. Current term is 15.
I20260709 13:17:54.911137  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.911461  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.865149 12480 raft_consensus.cc:2764] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:54.916814  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:54.865042 12707 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:54.917815  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:54.918277 12859 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:54.920447  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.921110  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:54.922376  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.923781  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.886806 12705 raft_consensus.cc:2804] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:54.926877  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.938067  8290 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:54.928946  8286 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:54.939780  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:54.932534  8360 raft_consensus.cc:2393] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:54.934731  8365 raft_consensus.cc:2393] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:54.935436  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.935050  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:54.946488  8288 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:17:54.936143  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:54.947667  8293 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.912958 12696 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.951768  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:54.912267 12757 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.957026  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.957926  8295 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:54.959311  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.961177  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:54.961701  8924 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.964330 12767 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:54.964751 12767 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.965117 12767 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:54.965514  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:54.966113  8292 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:54.966843 12844 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:54.904836 12843 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:54.968346 12740 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.968750 12772 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.969055 12740 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.970106 12829 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.970633 12829 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.953326 12872 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.973095  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:54.973876  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:54.974319  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:54.974869  8928 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:17:54.975665  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:54.976183 12824 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.976231  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:54.976884 12824 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.963752  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.981832  8921 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.982398  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:54.969343 12772 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.987485  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:54.988793 12828 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.990293  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:54.995957  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:54.990360  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:54.996989  8360 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:54.936992 12854 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:54.945724 12859 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:54.990785  8217 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:54.992522  8215 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:54.989530 12728 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:54.948632 12862 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.950172 12814 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:54.999866  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:54.957890 12696 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:54.987278  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:54.927299 12099 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:17:55.012632  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:54.958534 12757 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.020345  8926 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:55.013403  8923 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 7.
I20260709 13:17:55.014740  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.013626  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:54.991294 12705 raft_consensus.cc:697] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:55.021853  8921 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:55.026264  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:55.027964  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.035002  8293 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:54.993755 12740 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.014206 12728 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:54.957774 12428 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:17:55.048398  8924 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:55.050655  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.051290  8921 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:17:55.052912  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.024721 12779 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.057081  8926 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:17:55.042035 12861 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.536s	user 0.000s	sys 0.004s
I20260709 13:17:55.030694 12872 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:55.049991 12765 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:55.051681 12740 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.064512  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.066771  8261 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.078668  8261 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.031646 12859 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:55.083904  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.039994 12731 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:17:55.042769 12733 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.068810 12827 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:55.017369 12862 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.064157  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.098984  8924 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:55.029577 12814 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:55.067564  8332 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.724s (SENT) [suppressed 5 similar messages]
I20260709 13:17:55.079934  8261 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.011430 12691 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.086956  8921 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:55.060341 12779 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.088932 12705 consensus_queue.cc:237] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.065876 12872 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.070837 12786 consensus_queue.cc:1059] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:55.091225 12728 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.091171 12859 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.056522 12877 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:17:55.014401 12828 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.073959 12765 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.072496 12428 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.072885 12824 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.036764 12518 consensus_queue.cc:1059] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:17:55.105171  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 92172.6us
I20260709 13:17:55.086205 12854 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.096571 12889 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.110170  8261 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.038182  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:55.120769  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:17:55.113137 12882 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.202s	user 0.001s	sys 0.001s
I20260709 13:17:55.106549 12733 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.110781 12782 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.108585 12779 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.114073 12872 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.138198  8924 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:55.156540  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:55.128386 12765 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.159197  8288 raft_consensus.cc:2393] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
W20260709 13:17:55.139732  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 101631us
I20260709 13:17:55.121166 12778 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:55.144361  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 64912.1us
I20260709 13:17:55.149528  8217 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:55.141326 12583 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.151839  8293 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:55.152500  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:55.153198 12890 log.cc:927] Time spent T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:55.153154  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.137019 12829 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.157246  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.138551  8261 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:55.166833  8924 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:55.129110 12846 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.160668  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.161124  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.108362 12827 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.152643  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.164417  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.164788  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.143947 12824 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:55.155411 12772 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.165719  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.155639 12379 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.172178  8213 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:17:55.144261 12672 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.194021  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.130749 12428 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:55.186779 12894 log.cc:927] Time spent T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:17:55.165856 12891 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:17:55.195906  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.196597  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.204973  8928 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:55.173943 12733 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:55.208091  8892 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.199339  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.208815  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.203500  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.201437  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.198287  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:55.210894  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:55.194941 12892 log.cc:927] Time spent T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:17:55.211252  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.205919  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.212141  8291 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:55.212711  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.212982  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.195787  8919 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:17:55.210307  8920 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:55.215935  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.216321  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.191957 12772 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:55.215134  8183 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:17:55.217248  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 71038us
W20260709 13:17:55.215391  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 147852us
I20260709 13:17:55.215935  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.220067  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.221136  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:55.216878  8919 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:55.222965  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.221654  8889 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:55.224733  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:55.225260  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.224144  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.226722  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.226037  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:55.207980 12733 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.228140  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.232441  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.234519  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.228250  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:55.229427  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.216245 12824 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.222385 12728 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.230736 12731 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:55.218729 12829 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.224779 12379 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:55.242482  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.239701  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.250133  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.240397 12845 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.252213 12728 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.237275 12844 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.225878 12781 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.248652 12854 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.243690 12889 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:55.269182 12889 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.231042 12877 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.231245 12846 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:55.237107 12583 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:55.221648 12782 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:17:55.266481  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.238157 12733 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.265995 12854 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.259277 12845 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:55.243562 12731 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.263954 12379 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:55.249507 12767 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.269608 12889 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.270282 12811 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.237666 12896 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:17:55.261569 12844 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:55.289456  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.272697  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.259141 12814 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.273885  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.271842 12877 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.256964 12268 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.292375 12876 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.296777 12379 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.301435  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.279064 12583 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.290328 12845 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.274766 12846 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:55.284173 12854 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.292439 12731 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:55.304077  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.316741  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.316972  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.305523 12844 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.318827  8286 raft_consensus.cc:2368] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12.
I20260709 13:17:55.319248  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.310168 12877 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.321461  8366 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:55.321516  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.313235 12583 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:55.323995 12905 log.cc:927] Time spent T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:17:55.325182  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.326745 12786 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.327430 12786 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.334028 12827 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.336570 12672 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.337103  8920 raft_consensus.cc:1275] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:55.337213 12428 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.339985  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.341943 12696 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.343012  8295 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:55.343552 12827 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:55.344103 12827 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:55.346640 12867 log.cc:927] Time spent T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.794s	user 0.004s	sys 0.001s
I20260709 13:17:55.354064  8889 leader_election.cc:400] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 14. Current term is 15.
I20260709 13:17:55.354477  8889 leader_election.cc:403] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.314972 12846 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.357115  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.357946  8220 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:55.359697  8369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 2180) took 1069 ms. Trace:
I20260709 13:17:55.355583  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.360255  8369 rpcz_store.cc:276] 0709 13:17:54.263456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.265417 (+  1961us) service_pool.cc:224] Handling call
0709 13:17:55.332589 (+1067172us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400355054. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:55.332723 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324307840}
I20260709 13:17:55.368870  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.369493  8214 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:55.377240  8889 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:55.382360  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.383471  8365 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 8: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:55.385848  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.386621  8214 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.377560 12827 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.382022 12814 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.392829 12814 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:55.393226 12814 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:55.393589 12814 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.393754  8889 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.307648 12811 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.395442  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.397878  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.312371 12479 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.370175 12896 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.405413  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.406052  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.400403 12772 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:55.408931  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 83809.2us
I20260709 13:17:55.411360  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.412798  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.413901  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.414244 12912 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:55.414666 12912 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:55.414722 12428 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.415129 12912 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.418658  8287 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:55.416007  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.419680  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:55.409207 12839 consensus_meta.cc:287] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.827s	user 0.006s	sys 0.014s
I20260709 13:17:55.421586  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.423264 12428 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.423600 12268 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.424365  8294 raft_consensus.cc:2410] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:55.423177 12728 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.428787  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.431133  8213 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:55.432588  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.433557  8289 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:55.436159  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.436389 12510 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.441787 12845 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.418134 12859 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.400537 12827 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:17:55.446736  8292 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:55.421917 12786 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:55.450178  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.407083 12872 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.456092  8219 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:55.455506  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.458304  8213 raft_consensus.cc:2393] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:17:55.459316  8186 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:55.461005 12876 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.462940 12479 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.463559 12767 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.464550 12740 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:55.464967 12740 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:17:55.466563  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 72871.6us
I20260709 13:17:55.468632  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.469460  8362 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:55.471000  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.465760 12740 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.472899  8218 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37896 (request call id 599) took 1406 ms. Trace:
I20260709 13:17:55.473119 12740 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.473316  8218 rpcz_store.cc:276] 0709 13:17:54.066461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.066578 (+   117us) service_pool.cc:224] Handling call
0709 13:17:55.472715 (+1406137us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54000361d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:55.472842 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355214208}
I20260709 13:17:55.429235 12428 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.411137 12854 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.479087  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.508339  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.508690  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.508853  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.479602  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:55.479540  8214 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:55.510557  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.511227  8362 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 8.
I20260709 13:17:55.514343  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.514753  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.443985 12845 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.514802  8362 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:55.520328  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.521040  8362 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:55.521867  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:55.522395  8362 raft_consensus.cc:2368] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12.
I20260709 13:17:55.477965 12786 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.454790 12583 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.523648  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.448768 12757 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.477852 12518 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.476542 12862 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.457716 12914 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.517755 12491 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.513214 12767 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.533340 12872 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.536827 12733 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.476016 12731 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.528761 12786 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.522755 12921 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.588680 12779 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.539429 12846 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.594142 12846 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.541023 12844 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.597996 12877 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.598999 12844 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.599375  8369 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:55.541556 12583 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.476804 12765 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.541852  8186 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:17:55.600927  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 59167.7us
I20260709 13:17:55.601727 12896 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 14. Current term is 15.
I20260709 13:17:55.602409  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:55.602559 12765 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.603250  8186 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:55.546399  8920 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:55.560288 12696 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.604434  8217 raft_consensus.cc:2368] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12.
I20260709 13:17:55.605160 12573 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.605582 12573 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:55.605862  8294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46272 (request call id 2450) took 1447 ms (client timeout 1866 ms). Trace:
I20260709 13:17:55.572870  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.606487 12825 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:55.606417  8294 rpcz_store.cc:269] 0709 13:17:54.158110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.158241 (+   131us) service_pool.cc:224] Handling call
0709 13:17:55.591920 (+1433679us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002e86d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:55.605794 (+ 13874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2407215872}
I20260709 13:17:55.607097 12825 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.607501 12825 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.602625 12786 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.569728 12767 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.578805 12912 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.581413 12697 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.610539  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2738) took 1029 ms. Trace:
I20260709 13:17:55.611560 12767 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.568775 12814 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.626047 12814 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.628309 12912 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:55.633630 12898 log.cc:927] Time spent T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.426s	user 0.000s	sys 0.002s
I20260709 13:17:55.634172  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.584020 12731 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.603655 12757 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.569012 12491 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.638970 12491 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.584679 12872 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.586416 12733 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.601002 12877 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.605957 12573 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.639642 12872 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.641557  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.555846 12859 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.603518 12765 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:55.609002  8186 leader_election.cc:400] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12.
I20260709 13:17:55.483204 12876 consensus_queue.cc:1048] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:55.572026 12889 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.619412  8923 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:17:55.590838 12779 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.642540 12718 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.636834  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.643541  8186 leader_election.cc:403] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.610946  8361 rpcz_store.cc:276] 0709 13:17:54.583394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.692243 (+108849us) service_pool.cc:224] Handling call
0709 13:17:54.698299 (+  6056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.762506 (+ 64207us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:54.821760 (+ 59254us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.911909 (+ 90149us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.912113 (+   204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.912167 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:54.912218 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.609393 (+697175us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18003ce560. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa2f22a6 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419
0709 13:17:55.610319 (+   926us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b540010ed54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:55.610366 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.610485 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7146,"prepare.queue_time_us":84305,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":87,"raft.queue_time_us":137,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7583,"spinlock_wait_cycles":180895488,"thread_start_us":89643,"threads_started":1,"wal-append.queue_time_us":193382}
W20260709 13:17:55.660593  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 51196us
I20260709 13:17:55.675036  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.649684 12765 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.680730  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.683013  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.672447 12491 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:55.691373  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 182055us
I20260709 13:17:55.693264  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.680568 12765 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:55.683846 12379 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.707518  8368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2174) took 1446 ms. Trace:
I20260709 13:17:55.708076  8368 rpcz_store.cc:276] 0709 13:17:54.261576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.263667 (+  2091us) service_pool.cc:224] Handling call
0709 13:17:54.264068 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.425126 (+161058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.707234 (+1282108us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b540018fe54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:55.707451 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17955584}
I20260709 13:17:55.716131 12765 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.717537  8213 raft_consensus.cc:2368] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:55.717592 12889 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.719431 12765 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.721508  8363 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:55.723140  8363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55886 (request call id 2727) took 1210 ms. Trace:
I20260709 13:17:55.723440  8363 rpcz_store.cc:276] 0709 13:17:54.512873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.513120 (+   247us) service_pool.cc:224] Handling call
0709 13:17:55.723006 (+1209886us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400355f54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:55.723094 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2682841344}
I20260709 13:17:55.724121 12800 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.709690 12872 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.724582 12800 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.730166 12698 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.731184 12573 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.733282  8289 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:55.715744 12825 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:55.740888 12910 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.407s	user 0.002s	sys 0.000s
I20260709 13:17:55.709233 12691 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:55.748219 12099 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:55.750653 12854 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.752722  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.766316  8364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55886 (request call id 2740) took 1169 ms. Trace:
I20260709 13:17:55.748844 12825 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.752873  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58422 (request call id 1941) took 1257 ms. Trace:
I20260709 13:17:55.777951  8212 rpcz_store.cc:276] 0709 13:17:54.495293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.543566 (+ 48273us) service_pool.cc:224] Handling call
0709 13:17:55.752670 (+1209104us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54004425d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:55.752800 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138065664}
I20260709 13:17:55.743974 12491 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12.
I20260709 13:17:55.776613  8364 rpcz_store.cc:276] 0709 13:17:54.597001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.861099 (+264098us) service_pool.cc:224] Handling call
0709 13:17:54.861381 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.934339 (+ 72958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.934372 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.934401 (+    29us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:54.934425 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.766084 (+831659us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b5400356954. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:55.766128 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.766254 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167249152}
I20260709 13:17:55.781860  8889 leader_election.cc:400] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:55.779481  8924 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:55.782212  8889 leader_election.cc:403] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.782330  8923 raft_consensus.cc:1240] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:55.776779 12099 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:55.780429  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:55.783345  8361 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:55.783771  8186 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:55.787876  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.788614  8923 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.791548 12896 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:55.799072  8923 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:55.784776 12800 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:55.801785 12745 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.784986 12779 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.805480  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.811542  8361 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:55.812407  8367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2177) took 1549 ms. Trace:
I20260709 13:17:55.813071  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:55.812753  8367 rpcz_store.cc:276] 0709 13:17:54.262546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.263228 (+   682us) service_pool.cc:224] Handling call
0709 13:17:54.263536 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.599486 (+335950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.599515 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.599554 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:54.599584 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.812191 (+1212607us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400366fd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:55.812247 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.812357 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772161280}
I20260709 13:17:55.814497  8365 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.814405  8892 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:55.809484 12906 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.019s
W20260709 13:17:55.816020 12906 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.009s	sys 0.019s
I20260709 13:17:55.823800  8365 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:55.823865 12896 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:55.825621 12740 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.825222  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:55.825930 12856 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.548s	user 0.004s	sys 0.000s
I20260709 13:17:55.828153  8186 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:55.830060  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.829331  8186 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:55.831115  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:55.832684 12573 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.833585 12099 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.834633 12099 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.835237 12811 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:55.830760 12779 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.836089  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:55.836658  8367 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.838225  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.842888 12809 consensus_queue.cc:1059] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:55.842906  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:55.843881 12809 raft_consensus.cc:3055] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:55.844301 12809 raft_consensus.cc:740] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:55.845377 12573 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:55.845131 12809 consensus_queue.cc:260] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.846314 12809 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.836566 12772 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.839517 12918 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.839419 12826 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.850982 12826 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:55.851608  8923 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 9.
I20260709 13:17:55.851701 12826 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.861069  8367 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:55.830978 12825 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:55.869029  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.870079 12881 log.cc:927] Time spent T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.107s	user 0.001s	sys 0.007s
I20260709 13:17:55.871878  8360 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:17:55.876494  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 504764us
I20260709 13:17:55.877259  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:55.878211  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:55.879859  8258 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:55.871783 12745 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.892920 12510 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:55.893570 12510 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.894014 12510 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.896122 12268 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:55.896673 12268 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.897083 12268 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.901363 12583 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:55.901399 12696 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.906947  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.908288  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.916388  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.907351  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.908586  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.920542  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.922394  8213 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:17:55.922585  8258 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:55.923480  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.924065  8216 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.925943  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.924412  8217 raft_consensus.cc:2393] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:55.924840  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.926542  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.919548  8892 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:55.927251  8928 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:55.916919  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 71948us
I20260709 13:17:55.925472  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.929054  8927 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.873155 12825 raft_consensus.cc:697] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:55.940186  8889 leader_election.cc:400] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12.
I20260709 13:17:55.940007  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.944407  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.945338  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.944459  8889 leader_election.cc:403] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.946396  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.947072  8214 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:55.948305  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.948591  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.951570  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:17:55.940977  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.943277  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.952338  8919 raft_consensus.cc:2393] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:55.954620  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:55.949782  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.958457  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:55.962098  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.963503  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:55.962531  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.964267  8892 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:55.942780 12918 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:55.969750  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.970016  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.974025  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:55.974578  8362 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.974720  8927 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:55.975978 12480 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.976495 12480 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.961061 12672 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:55.977504 12672 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.977906 12672 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.978319 12480 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:55.982169 12921 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:55.983688 12591 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.954597 12772 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:55.987294  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:55.986183  8258 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:55.957561 12573 raft_consensus.cc:697] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:55.909256 12696 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:55.979359 12268 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.970988 12624 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.984325 12591 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:55.961331 12889 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:55.988940  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:55.991797  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:55.992863  8286 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:55.962579 12827 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 11. Current term is 12.
I20260709 13:17:55.993086  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:55.985181 12811 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.013463  8368 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:55.995366  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:55.989347 12921 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:55.999583  8928 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:17:56.014627  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.003185  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:55.985553 12839 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.003456  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.017132  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:56.017777  8360 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:56.019003  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.020480  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.004081  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.972599 12918 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:55.993688  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.025583  8291 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:56.007593  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:56.017699  8258 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:56.026567  8927 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:56.027206  8292 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:56.012033 12707 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:55.991382 12583 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.988276 12800 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:55.986869 12592 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.021826  8183 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:56.035208  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:56.043032  8258 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.046559  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.047235  8361 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:56.022733  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:55.992733 12428 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:56.024546  8362 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:17:56.020105 12872 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:56.028599  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.009388  8364 raft_consensus.cc:1240] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.024431  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.064561  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.068874  8362 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:56.070111  8286 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:56.070900  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:56.071597  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:56.072340  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.072628  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.025507 12889 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:56.070006  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.073975  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:56.075179  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:17:56.075311  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 52684.4us
I20260709 13:17:56.029048 12918 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.070391 12583 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:56.078697  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.079145 12710 raft_consensus.cc:993] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
W20260709 13:17:56.079864 12931 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:17:56.079758  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:56.080746 12934 log.cc:927] Time spent T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:56.082252 12699 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.082813  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:56.086850  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.103091  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.089413  8364 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:56.089057  8216 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:56.096287  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.025216 12624 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.099371  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:56.111220  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.112077  8362 raft_consensus.cc:2393] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:56.046078 12745 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:56.045743 12765 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:56.020752 12854 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:56.119292  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 68964.3us
I20260709 13:17:56.119928  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.120800  8362 raft_consensus.cc:2368] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:56.068084 12839 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:56.106711  8892 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:56.089211 12735 raft_consensus.cc:993] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:17:56.107700  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:56.125869  8261 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.071367 12872 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:56.068158 12428 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:56.130105  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 81218.3us
I20260709 13:17:56.089632 12800 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:56.035820 12933 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:17:56.123780  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:56.048251 12592 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.020864 12825 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.109405 12710 raft_consensus.cc:1081] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:17:56.150748  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:56.129758 12872 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.129594  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:17:56.117969  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 75060.6us
I20260709 13:17:56.155292  8292 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.156284  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.108596 12859 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.129719  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:56.118181 12745 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.120661 12733 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.117666 12765 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.138808  8212 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:56.114305 12696 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:56.168802  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:56.169840  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:56.142472 12939 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.149433 12731 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.107537 12877 consensus_queue.cc:1059] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:56.145704  8261 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.147363  8892 leader_election.cc:400] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 8. Current term is 9.
I20260709 13:17:56.125903 12827 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.163477 12772 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:56.083475 12573 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.134372 12402 raft_consensus.cc:1081] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:17:56.127817 12707 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:56.126901 12839 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:56.135636 12428 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.158849  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:56.158968  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.162744 12836 raft_consensus.cc:3055] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.124178 12854 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.165745  8366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55878 (request call id 2184) took 1291 ms. Trace:
I20260709 13:17:56.144560  8364 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:17:56.171520  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:56.169320 12765 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.230197  8366 rpcz_store.cc:276] 0709 13:17:54.874564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.922141 (+ 47577us) service_pool.cc:224] Handling call
0709 13:17:56.165568 (+1243427us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400370854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:56.165690 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914547456}
W20260709 13:17:56.231858  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 73011.3us
I20260709 13:17:56.153589 12268 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.184186  8211 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:56.185334  8261 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.187103  8295 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:56.127365  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:56.203131 12859 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:56.200933 12935 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:56.165521 12745 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.203769  8292 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:17:56.182767 12591 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.174712  8215 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58438 (request call id 1692) took 1129 ms. Trace:
I20260709 13:17:56.156090 12889 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.150981 12480 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:56.236022  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.260973  8292 raft_consensus.cc:2410] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:56.260924 12480 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.261540 12480 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:56.261988  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:56.188861 12696 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.239823  8366 raft_consensus.cc:1240] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.262362 12480 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.238319  8215 rpcz_store.cc:276] 0709 13:17:55.045793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.045978 (+   185us) service_pool.cc:224] Handling call
0709 13:17:55.046430 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:55.046874 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.046915 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:55.055376 (+  8461us) log.cc:844] Serialized 52 byte log entry
0709 13:17:55.754932 (+699556us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18001ee320. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:17:55.814067 (+ 59135us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:55.814106 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.814166 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.168310 (+354144us) raft_consensus.cc:1685] finished
0709 13:17:56.168333 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.174653 (+  6320us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":899,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":8329,"spinlock_wait_cycles":4495104,"thread_start_us":58958,"threads_started":1,"wal-append.queue_time_us":824180}
I20260709 13:17:56.263763  8366 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 12. Current term is 14. Ops: []
I20260709 13:17:56.255788 12672 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.264402  8215 raft_consensus.cc:1240] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: [11.6-12.7]
I20260709 13:17:56.264854  8294 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:56.266688 12940 log.cc:927] Time spent T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:17:56.233409  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48155.4us
I20260709 13:17:56.244002  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:56.268913  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:56.270411  8293 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:56.272949 12888 consensus_queue.cc:1059] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:56.274106 12888 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.274478 12888 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:56.270175 12672 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.237239 12669 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.248034 12839 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.248957 12592 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.251608  8367 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:56.254335  8186 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:56.279261 12379 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:56.278719 12707 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.279775 12379 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:56.244387  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.280691 12379 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.284703  8294 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:56.289973  8287 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:56.291455  8889 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:56.294306  8292 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:56.169365 12733 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.299787  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:56.275358 12888 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.302076  8219 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:56.305660  8213 raft_consensus.cc:1275] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:56.233281 12772 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.263814 12480 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.229847 12836 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:56.325207  8293 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 13:17:56.325644  8293 pending_rounds.cc:85] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 4
I20260709 13:17:56.325924  8293 pending_rounds.cc:107] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 13:17:56.326198  8293 raft_consensus.cc:2889] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:56.326568  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 168527us
I20260709 13:17:56.327667  8183 leader_election.cc:400] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12.
I20260709 13:17:56.236541 12859 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:56.306504 12811 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:56.322053  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:56.340472  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:56.344589  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:56.341977 12888 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.341292 12811 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:56.351358 12825 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:56.381023  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.382797 12946 log.cc:927] Time spent T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:17:56.383770 12809 consensus_meta.cc:287] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.006s
W20260709 13:17:56.385140 12941 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:17:56.387311 12702 raft_consensus.cc:993] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:17:56.359936 12859 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.388754 12811 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.357914 12836 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.390539 12836 raft_consensus.cc:3060] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:56.392989 12099 consensus_meta.cc:287] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.002s
I20260709 13:17:56.394229 12854 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.396793  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:56.398124 12510 consensus_meta.cc:287] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:17:56.398675 12510 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.400292  8286 raft_consensus.cc:2393] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:56.405827  8216 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:56.415328  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:56.407425 12624 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:56.439714 12733 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.462623  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:56.463528  8219 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.442109 12624 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.465770 12624 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:56.462386 12872 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.455556 12877 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.466874 12765 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.470947  8212 raft_consensus.cc:1240] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.471639 12872 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:56.477375  8219 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:56.482195 12510 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.483844 12918 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.484910 12428 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.486223  8369 raft_consensus.cc:1240] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.487258 12918 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.631102  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1794) took 1181 ms. Trace:
I20260709 13:17:56.631489  8289 rpcz_store.cc:276] 0709 13:17:55.449976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.450149 (+   173us) service_pool.cc:224] Handling call
0709 13:17:55.455297 (+  5148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.733838 (+278541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.630880 (+897042us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400002dd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:56.631053 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":638497024}
I20260709 13:17:56.480427 12765 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.473796 12877 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.650305  8289 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.624367 12912 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:56.592401 12510 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:56.654157  8289 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:56.672920  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:56.673542  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.674307  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.674598  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:56.675716  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:56.678136  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:56.678136  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.679560  8219 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:56.681378  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:56.675861 12872 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:56.682639 12872 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.684291 12872 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:56.678321 12811 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.689447 12745 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.690711  8217 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:56.671254 12912 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.694135 12428 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:56.694993  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.695245 12912 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:56.695726 12877 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:56.697724  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:56.698892 12702 raft_consensus.cc:1081] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
W20260709 13:17:56.699942  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c96431d125f4d169be8f25647f9371e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:56.673568 12510 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.701614 12745 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.704180  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.708966  8258 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.710407  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.712463  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:17:56.714381  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.722934  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:56.723546  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:56.723484  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:56.699783 12828 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.719053  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.731746  8367 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.730135  8258 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:56.743067  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.743836  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:56.769423  8261 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.703261 12943 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.728710 12705 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.735396 12939 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.742400  8369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:17:56.738404 12889 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:56.740636  8367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:17:56.786011  8367 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.786409  8367 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.788229 12826 consensus_queue.cc:1059] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:56.789229 12826 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.789569 12826 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:56.790407 12826 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.791721 12826 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.792853 12696 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:56.735572 12592 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:56.783260  8369 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.793840 12510 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:56.745146 12669 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:56.732633  8368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:17:56.794507 12669 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.794667  8368 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.795061  8368 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:56.740068 12733 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:56.794883  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.797892  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:56.798866 12951 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.330s	user 0.002s	sys 0.004s
I20260709 13:17:56.794170  8369 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.800304  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:56.800915  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37896 (request call id 614) took 1439 ms. Trace:
W20260709 13:17:56.802320 12938 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.689s	user 0.007s	sys 0.003s
I20260709 13:17:56.801311  8220 rpcz_store.cc:276] 0709 13:17:55.361733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.361911 (+   178us) service_pool.cc:224] Handling call
0709 13:17:55.362310 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.362791 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.362832 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.363777 (+   945us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.247263 (+883486us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b1800376660. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa306e07 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f31fcfab20b 00007f31fcfb0d23 00007f31fcfb10d1 00007f31fd3cca0f
0709 13:17:56.407812 (+160549us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:56.407842 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.407889 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.798379 (+390490us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:56.800737 (+  2358us) raft_consensus.cc:1685] finished
0709 13:17:56.800757 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.800862 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":15730,"spinlock_wait_cycles":20091392,"thread_start_us":160277,"threads_started":1,"wal-append.queue_time_us":1088829}
I20260709 13:17:56.800922  8363 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:17:56.768049 12888 consensus_queue.cc:1048] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:17:56.809868  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.810765  8365 raft_consensus.cc:2368] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13.
I20260709 13:17:56.812152  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:56.812664  8286 raft_consensus.cc:1240] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:56.813968  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.814771  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:56.816314  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:56.818238  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:56.818778  8292 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:56.819051  8369 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.821022  8293 raft_consensus.cc:1240] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:56.820963  8363 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:56.821574  8363 pending_rounds.cc:85] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting all ops after (but not including) 6
I20260709 13:17:56.029590  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:56.822079  8363 pending_rounds.cc:107] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:56.822146  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:56.821511  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:56.823087  8366 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.817018  8368 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.809406  8367 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.737843  8258 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:56.822584  8363 raft_consensus.cc:2889] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:56.831274  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.838160  8369 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:56.794961 12669 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:56.840531  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 102774us
I20260709 13:17:56.841288  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.841684  8367 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:56.820536 12814 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.837421 12836 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.829252 12889 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.851752  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:56.829823 12521 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.855405  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.850801  8368 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:56.856760  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.861194  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.852967  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.850850 12877 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.864804  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:56.922703  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 67362.8us
I20260709 13:17:56.861850 12592 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:56.840202 12888 consensus_queue.cc:1059] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:17:56.856633 12912 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.930351  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:56.936216  8220 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:56.854214 12705 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:56.949718  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 84968.1us
I20260709 13:17:56.854286 12939 consensus_queue.cc:1059] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:17:56.929369 12696 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:56.857060 12814 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.955009  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:56.866127 12480 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:56.955704 12428 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:17:56.955765 12888 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.963322 12888 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:56.964182 12888 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:56.965487 12888 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.956169 12696 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:56.972451 12696 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.862993 12521 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.930199 12836 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:56.937676 12928 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:56.861236 12889 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:56.865985 12947 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:56.996055  8366 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:56.860149 12510 consensus_queue.cc:1059] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:17:56.955849 12705 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:57.015224  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:57.034727  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 47589.8us
I20260709 13:17:57.035656  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:56.995561 12877 raft_consensus.cc:2764] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:57.070173  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:57.071615  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:57.064743 12836 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:57.077283  8924 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:57.077028 12836 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.079109  8928 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:57.006098 12428 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:17:57.083240  8369 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:57.090093  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:57.092638  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:57.093006 12965 log.cc:927] Time spent T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:57.093649 12912 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:57.094347 12912 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.094801 12912 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.094960 12961 consensus_queue.cc:1059] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:57.095950 12961 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.096243 12844 raft_consensus.cc:3055] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:57.096796 12844 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:57.097875 12844 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:57.103006 12521 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.014250 12947 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.087162 12428 consensus_queue.cc:1243] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer 4cf23888b4fe42b594b9443ae6ee9cd2 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:17:57.107091 12947 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:57.010238 12928 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.067216 12698 consensus_queue.cc:1059] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:17:57.108790 12698 raft_consensus.cc:3055] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:57.109221 12698 raft_consensus.cc:740] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:57.110272 12859 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.113855 12705 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.103464 12669 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:57.116166  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.116680  8920 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:57.118076 12928 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:57.132160  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:57.120256  8335 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.099725 12844 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.138737  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:57.139714  8294 raft_consensus.cc:2393] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:57.080827 12697 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:57.074738 12691 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.142274  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:57.146091  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:57.146763  8216 raft_consensus.cc:3055] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:57.147106  8216 raft_consensus.cc:740] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
W20260709 13:17:57.147634  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.148262  8332 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.149281  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:57.150506  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:57.151197  8293 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.118630 12814 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.147948  8216 consensus_queue.cc:260] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.158048  8216 raft_consensus.cc:3060] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.118726 12928 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.118865 12669 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.160195  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:57.160980  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:57.166007  8920 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.136202 12828 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.143013 12811 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:57.121608 12889 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.163720 12877 raft_consensus.cc:2764] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:57.176687  8366 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:57.178676  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:57.181499  8367 raft_consensus.cc:1240] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:57.182108  8368 raft_consensus.cc:2410] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:57.186896  8293 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:57.187683  8216 raft_consensus.cc:2468] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:57.184713  8332 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:57.110255 12698 consensus_queue.cc:260] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.173959 12828 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.181035 12691 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:57.173779 12811 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.168932 12928 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.194882  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:57.229640  8920 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:57.192885  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:57.224830  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:57.266292  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:57.267129  8293 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
W20260709 13:17:57.275480  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 50784.7us
I20260709 13:17:57.280203  8287 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:17:57.285998  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 420512us
I20260709 13:17:57.287550  8261 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:17:57.326908  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47088.7us
I20260709 13:17:57.191431 12624 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.212627 12698 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.329617  8261 leader_election.cc:400] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13.
I20260709 13:17:57.334116  8261 leader_election.cc:403] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:57.330782  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:57.238629 12811 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.193444 12733 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.200271 12828 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.239117 12691 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:57.337847  8211 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:57.335628  8261 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:57.338986  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:57.359853  8213 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.331166 12591 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:17:57.279825 12918 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.281901 12877 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.361006  8258 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:57.347479 12696 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.332072 12510 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:57.398545  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.404935  8369 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:57.326771 12826 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:17:57.331429 12932 consensus_queue.cc:1059] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:17:57.415884  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 80340.9us
I20260709 13:17:57.421880  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:57.372180 12828 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.404953 12624 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.430536  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 341698us
I20260709 13:17:57.431020  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:57.435547  8366 raft_consensus.cc:3060] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.432492  8361 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:57.436911  8363 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:17:57.438604  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 77686.6us
I20260709 13:17:57.433398  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:57.445119  8369 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:57.412351 12918 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.404248 12974 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13.
I20260709 13:17:57.364001 12733 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.424444 12922 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.425047 12854 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:57.449386 12479 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:57.458741  8366 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
W20260709 13:17:57.463934  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 186832us
I20260709 13:17:57.469470  8889 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:57.434799 12710 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:57.427268 12973 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:57.480598  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:57.438215 12828 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.446415 12624 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.459072 12479 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.496585  8920 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:17:57.492586  8295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1797) took 1500 ms (client timeout 1587 ms). Trace:
W20260709 13:17:57.499513  8295 rpcz_store.cc:269] 0709 13:17:55.991741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.992320 (+   579us) service_pool.cc:224] Handling call
0709 13:17:57.492432 (+1500112us) spinlock_profiling.cc:243] Waited 97.3 ms on lock 0x7b5400024254. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:57.492525 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223815424}
W20260709 13:17:57.503787  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 311059us
I20260709 13:17:57.499004 12479 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.487092 12953 consensus_queue.cc:1059] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
W20260709 13:17:57.651765 12971 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:17:57.666709 12990 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.599298 12928 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:57.668217  8213 raft_consensus.cc:2468] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 11.
I20260709 13:17:57.668457 12696 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:57.677845 12952 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.193s	user 0.000s	sys 0.008s
W20260709 13:17:57.216425 12961 consensus_queue.cc:1175] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9e95b04d03d241329435b6d08dd1f236" responder_term: 11 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: [10.7-10.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:57.452277 12918 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.459192 12691 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.686904  8332 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:57.691475 12733 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.691815 12843 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:57.692394 13000 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:57.693889 12828 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.695102 12624 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:57.752858  8288 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:57.695413 12811 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:57.695313 12988 consensus_queue.cc:1059] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:57.753647 12811 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.753924 12988 raft_consensus.cc:3055] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:57.754314  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:57.754526 12988 raft_consensus.cc:740] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:57.755059  8362 raft_consensus.cc:1240] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:57.755330 12988 consensus_queue.cc:260] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.709856 12990 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.711755 12999 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:57.718150 12859 consensus_meta.cc:287] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.006s
I20260709 13:17:57.730000  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:57.730597  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:57.725754  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 258194us
I20260709 13:17:57.730237  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:57.734037  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:57.737704  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 255182us
I20260709 13:17:57.735620 12591 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.739910 12991 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.740036 12989 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.745683  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:57.746928  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:57.747426 12707 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.747570  8261 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:57.768666  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:57.748684  8295 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:57.747597  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:57.749563  8293 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:57.751616  8287 pending_rounds.cc:85] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 3
I20260709 13:17:57.770064  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:57.752538  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:57.753983 12733 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:57.699504 12912 consensus_meta.cc:287] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
I20260709 13:17:57.755784 12811 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.712004 12583 raft_consensus.cc:3055] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:57.756503 12988 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.760931  8361 raft_consensus.cc:2393] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:57.769068  8286 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:57.770305  8287 pending_rounds.cc:107] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:17:57.696964 12480 raft_consensus.cc:3055] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:57.770704  8288 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:57.785818  8287 raft_consensus.cc:2889] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.756796 12697 raft_consensus.cc:2804] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:57.788597 12480 raft_consensus.cc:740] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:57.773227  8261 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:57.791285 12480 consensus_queue.cc:260] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.776736 12705 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:17:57.792521 12480 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.793356 12705 raft_consensus.cc:2804] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:57.793915 12705 raft_consensus.cc:697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:57.794729 12705 consensus_queue.cc:237] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.770569 12859 raft_consensus.cc:2764] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:17:57.764787 12844 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.760320 12999 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.794559 12268 consensus_queue.cc:1059] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:57.774281 12624 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:57.784277 12969 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:57.775050 12991 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.817235  8926 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:57.817476  8364 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:57.818291 12991 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:57.787674 12811 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.807262  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:57.808109  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:57.823706  8293 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:57.796824  8291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46272 (request call id 2494) took 1440 ms. Trace:
I20260709 13:17:57.779101 12828 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.775885 12707 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.774336 12698 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:17:57.813380 12697 raft_consensus.cc:697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:57.844559 12990 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:57.776889 12733 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.779518 12583 raft_consensus.cc:740] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:57.807155  8286 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:57.813346 13000 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:57.824900  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:57.855775  8926 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:57.828486  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:57.828953  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:57.770844 12591 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.853363 12843 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.868153 12733 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.867909 12843 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.869009 12591 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.800832  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:57.824343  8291 rpcz_store.cc:276] 0709 13:17:56.356933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.437442 (+ 80509us) service_pool.cc:224] Handling call
0709 13:17:56.696159 (+258717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.696594 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.696629 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.697107 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.852521 (+155414us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:57.168694 (+316173us) log.cc:844] Serialized 14 byte log entry
0709 13:17:57.168912 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.168984 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.169024 (+    40us) raft_consensus.cc:1685] finished
0709 13:17:57.169036 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.796660 (+627624us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b540005a5d0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4108ad 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:57.796768 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":320199,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":4858,"raft.queue_time_us":4665,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":599584384,"thread_start_us":467377,"threads_started":2,"wal-append.queue_time_us":260152}
I20260709 13:17:57.870055 12843 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:57.870045  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 69330.3us
I20260709 13:17:57.832407  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:57.777757 12974 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:57.834563 12978 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:57.778128 12989 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.834503 12828 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.840431 12707 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:57.821524 12844 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.778868 12912 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.766460 12933 consensus_queue.cc:1059] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:57.977151  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:57.836665  8295 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:57.814289 12999 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.831681 12991 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.931169  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:57.872092 12735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.011s	sys 0.014s
I20260709 13:17:57.929631 13000 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.870585  8360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55878 (request call id 2218) took 1085 ms. Trace:
I20260709 13:17:57.973990  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:57.851231 12990 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.984629  8360 rpcz_store.cc:276] 0709 13:17:56.785670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.785814 (+   144us) service_pool.cc:224] Handling call
0709 13:17:56.786196 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.786587 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:57.126535 (+339948us) log.cc:844] Serialized 14 byte log entry
0709 13:17:57.422270 (+295735us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.422661 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.422788 (+   127us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:57.423010 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 13:17:57.423158 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.423247 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.870394 (+447147us) raft_consensus.cc:1685] finished
0709 13:17:57.870413 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.870528 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":967,"prepare.queue_time_us":185325,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":13380,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":4861,"spinlock_wait_cycles":21660928,"thread_start_us":634922,"threads_started":2,"wal-append.queue_time_us":652614}
I20260709 13:17:57.980413  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:57.846470 12268 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:17:57.939460 12928 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:57.833463 12811 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.985149  8361 raft_consensus.cc:2393] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:57.930508 12591 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.941869 12733 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.997433  8367 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:57.940244 12994 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:17:57.983711 12735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.013s	sys 0.014s
I20260709 13:17:57.870045 12859 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:57.976929 12696 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.978593 13002 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:57.844748 12697 consensus_queue.cc:237] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:57.974231 12702 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.978183 12969 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.983771 13003 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.936893 12839 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:57.943665 12978 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.008325 12859 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.984647 12991 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.005035 12591 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.026335 13003 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.033416 12591 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.034333 13003 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.035164 13000 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:58.036126 13001 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:58.037096 12828 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:58.037436 12989 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.019237 13002 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:57.997936 12990 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.000451 12928 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:58.048262  8333 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.025170 12702 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.050913 12702 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:58.051978 12912 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:58.052696 12979 log.cc:927] Time spent T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.385s	user 0.004s	sys 0.001s
I20260709 13:17:58.053040 13002 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.055608 12479 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.056871 12928 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.057732 12479 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.053332  8214 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:58.058902  8214 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:58.058974 12990 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.059741  8214 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.060736 12991 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:58.006043 12733 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.063097 12733 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:58.012874 12696 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.065828 12696 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:57.992331 12583 consensus_queue.cc:260] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.067170 12583 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:58.065963 12918 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.063862 12811 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.028434 12839 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.030311 12859 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.098628 12844 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:58.025501 12969 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.104303  8214 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.106613 13017 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:58.107162 13017 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.108733 12839 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.109758 13017 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.109918 12811 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:17:58.110526 12975 log.cc:927] Time spent T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.495s	user 0.002s	sys 0.005s
W20260709 13:17:58.110978  8290 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46288 (request call id 1796) took 2119 ms (client timeout 1832 ms). Trace:
I20260709 13:17:58.109865 12978 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:17:58.111415  8290 rpcz_store.cc:269] 0709 13:17:55.991391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.991526 (+   135us) service_pool.cc:224] Handling call
0709 13:17:58.110767 (+2119241us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54001289d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:58.110909 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059713280}
I20260709 13:17:58.112380  8294 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:17:58.123661  8214 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:58.124261  8214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1717) took 1032 ms. Trace:
I20260709 13:17:58.124521  8214 rpcz_store.cc:276] 0709 13:17:57.092031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.092308 (+   277us) service_pool.cc:224] Handling call
0709 13:17:58.053214 (+960906us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54001f8ea0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd388dc0 00007f31fd414e18 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:58.104072 (+ 50858us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b580042cbd0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd36d0aa 00007f31fd3ef447 00007f31fd407fe7 00007f31fd4097de 00007f31fd41527c 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c
0709 13:17:58.124216 (+ 20144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156320896}
W20260709 13:17:58.125775  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 194932us
I20260709 13:17:58.128412  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:58.128715  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.129316  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.129351  8295 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:17:58.130394  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:58.130929  8287 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.131134  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.131748  8365 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:17:58.138422  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.138993  8365 raft_consensus.cc:2393] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:58.087898 12999 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.110520 12811 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.144940 12999 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.145545 12811 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.148391  8924 raft_consensus.cc:1240] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:58.150103 12696 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.150651 12696 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.152117 12943 raft_consensus.cc:3055] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:58.152486 12943 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:58.153077 12696 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:58.153261 12943 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.154196 12696 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:58.154261  8287 raft_consensus.cc:2468] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:58.154878 12696 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.160235 12696 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:58.161929 12933 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:17:58.162191 12976 log.cc:927] Time spent T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.575s	user 0.002s	sys 0.007s
I20260709 13:17:58.162496 12933 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.164809  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.164948  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.165402  8367 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 9.
I20260709 13:17:58.166086  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.166890  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.167299  8218 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:17:58.168447  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.154505 12943 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:58.169459  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.171589  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.171842  8220 raft_consensus.cc:3055] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:58.172205  8220 raft_consensus.cc:740] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:58.172483  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.172842  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.153119 12859 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.175740 12859 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:58.177430 12709 raft_consensus.cc:3055] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:58.177834 12709 raft_consensus.cc:740] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:58.178627 12709 consensus_queue.cc:260] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.179603 12709 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.180299 12696 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:17:58.180996 12983 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.575s	user 0.000s	sys 0.013s
I20260709 13:17:58.180842 12696 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.182126  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1818) took 1035 ms. Trace:
I20260709 13:17:58.172930  8220 consensus_queue.cc:260] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.182497  8292 rpcz_store.cc:276] 0709 13:17:57.147234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.147359 (+   125us) service_pool.cc:224] Handling call
0709 13:17:57.147648 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.151057 (+  3409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.151100 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.151611 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.396326 (+244715us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:57.396377 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.396453 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.180423 (+783970us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:58.181853 (+  1430us) raft_consensus.cc:1685] finished
0709 13:17:58.181876 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.182068 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3018,"raft.queue_time_us":4081,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7939,"spinlock_wait_cycles":6479232,"thread_start_us":244372,"threads_started":1,"wal-append.queue_time_us":338357}
I20260709 13:17:58.184284  8220 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.185994  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.186260  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.183633  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.189267  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:58.189721  8360 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.192711  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.193938  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.197237  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.194515  8215 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:58.197973  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:58.202580  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.205391  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.195536 12933 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.207365  8220 raft_consensus.cc:2468] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:17:58.208174  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.209594  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.211673 12696 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:58.214841 13023 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:17:58.216142  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.219661  8366 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:58.222242  8360 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:58.225900  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.229960  8362 raft_consensus.cc:2393] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:58.230675  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.231256  8362 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 15.
I20260709 13:17:58.231506  8212 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1975) took 1294 ms. Trace:
I20260709 13:17:58.224509 12811 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.240656  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.240996  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.233103  8367 raft_consensus.cc:1240] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:58.234902  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.234602  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.243558  8361 raft_consensus.cc:2410] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:58.232023  8212 rpcz_store.cc:276] 0709 13:17:56.936654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.936872 (+   218us) service_pool.cc:224] Handling call
0709 13:17:56.937230 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:57.014334 (+ 77104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.014367 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:57.069515 (+ 55148us) log.cc:844] Serialized 52 byte log entry
0709 13:17:57.428513 (+358998us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:57.682995 (+254482us) log.cc:844] Serialized 14 byte log entry
0709 13:17:57.685136 (+  2141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.052149 (+367013us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:58.229596 (+177447us) spinlock_profiling.cc:243] Waited 919 us on lock 0x7b180039f9a0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa2f22a6 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419
0709 13:17:58.231119 (+  1523us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b5400035cd4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:17:58.231177 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.231239 (+    62us) raft_consensus.cc:1685] finished
0709 13:17:58.231256 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.231435 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25479,"prepare.queue_time_us":362526,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":2106,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":34697,"spinlock_wait_cycles":187869952,"thread_start_us":558312,"threads_started":2,"wal-append.queue_time_us":535027}
I20260709 13:17:58.233656  8369 raft_consensus.cc:1240] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:58.234231  8366 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:58.256464  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:58.261003  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:17:58.271549  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.273784  8220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58438 (request call id 1718) took 1142 ms. Trace:
I20260709 13:17:58.274302  8220 rpcz_store.cc:276] 0709 13:17:57.131671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.131852 (+   181us) service_pool.cc:224] Handling call
0709 13:17:58.273563 (+1141711us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540019ad54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:17:58.273704 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379680640}
I20260709 13:17:58.276283  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.259802 12826 consensus_queue.cc:1059] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:17:58.277256  8360 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:58.281981  8186 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:58.281105  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:58.243825 12999 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:58.270996 12969 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.288542  8261 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:58.238583 12710 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:58.239770 12099 consensus_queue.cc:1059] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:17:58.292457  8332 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:58.240255 12745 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:58.283253 12939 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:58.296759  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:58.232669 12811 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.299818  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.299134  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:58.301047  8360 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:58.296362 12765 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:58.295631 12969 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:58.302611  8332 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:17:58.297986 12953 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:58.310810  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.311434  8289 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:58.309794  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:58.313181  8892 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:58.313387  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.311609  8290 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:58.313804  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:58.291383 12877 consensus_queue.cc:1059] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:17:58.299405 12922 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:58.312233  8924 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:58.316346  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:58.317525  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.317981  8889 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:58.318311  8292 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:58.318877  8332 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:58.288419 12999 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.302157 12844 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:58.302189 12765 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:58.330084 12991 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:58.337111 12991 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:58.330078 12428 raft_consensus.cc:2804] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:58.329866 12990 consensus_queue.cc:1059] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:17:58.329147  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:58.338276 12428 raft_consensus.cc:697] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:58.338861 13002 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:58.311187 12953 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.339331 13002 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.339636 12953 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.339820 13002 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:58.324234  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.342080  8928 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:58.342284  8289 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 15: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:58.303261 12826 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:58.344218 12990 raft_consensus.cc:3055] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:58.344660 12765 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.344746 12990 raft_consensus.cc:740] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:17:58.346082 12990 consensus_queue.cc:260] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.336567 12844 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.347576 12844 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.329607  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.321511  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:58.301654 12939 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:58.351550 12939 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:58.353554 13010 log.cc:927] Time spent T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.354s	user 0.003s	sys 0.000s
I20260709 13:17:58.318624 12521 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:17:58.354985 13020 log.cc:927] Time spent T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.226s	user 0.001s	sys 0.002s
I20260709 13:17:58.349381  8292 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.337533 12991 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.332252 12933 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:17:58.324837  8293 raft_consensus.cc:1240] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:58.325760  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:58.365602 12990 raft_consensus.cc:3060] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.366511 12922 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:58.356161 12918 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:58.349548  8889 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.368158 12918 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.367771 12922 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.369982  8889 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.370602 12691 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:58.371037 12691 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.373293  8889 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.371434 12691 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.375063  8889 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.332355 12999 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.382321 12844 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.382889 12691 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.373497 12811 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.371027 12918 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:58.356431 12912 raft_consensus.cc:3055] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:58.384671 12912 raft_consensus.cc:740] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
W20260709 13:17:58.385429  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 59762.7us
I20260709 13:17:58.385517 12912 consensus_queue.cc:260] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.387205 12912 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.339200 12428 consensus_queue.cc:237] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.391245 12989 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:58.391004 12828 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.386548 13002 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.394640  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.323392  8183 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:58.304164 12969 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.396415  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:17:58.397136  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 73796.6us
I20260709 13:17:58.399663 12988 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.402331  8183 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:58.404744  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.405757  8292 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:58.407949  8368 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:17:58.408744  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.409888  8217 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:58.416530 12733 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:58.416704  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.416998  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.400315 12933 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:58.418272  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.411173  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:58.419488  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.419822  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:58.420483  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:58.425419  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.425827  8220 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.319507 12961 raft_consensus.cc:2804] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:58.421476  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.421505  8892 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:58.431761 12811 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:58.422818  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.424381  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.421172  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.445169  8216 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:58.427795  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:58.428272 12988 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:58.417016 12733 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.432778  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:58.319339 13017 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:58.443089  8220 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:58.449137  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.407294 12969 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.445153  8364 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:17:58.451074  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.431977  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:58.423835 12877 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:58.446128  8217 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:17:58.448879  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:58.454761  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.449460  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:58.450183  8927 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:58.417322 12745 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.446224  8928 raft_consensus.cc:2393] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:58.452663  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:58.453769  8293 raft_consensus.cc:1240] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:17:58.443956 12811 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:58.417989 12521 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:17:58.450397 12733 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.471679  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.444667 12809 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:58.481479  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.483650  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.498126  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.455281  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.450199 12933 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:58.501847  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.422677 12991 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.498839  8293 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:58.505213 12961 raft_consensus.cc:697] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:58.506059  8290 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 12: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:58.506592  8292 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.508733  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:58.524305  8920 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 12.
I20260709 13:17:58.512387  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:58.464443 13002 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.511905  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:58.530542  8926 raft_consensus.cc:2393] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:58.531838  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:58.511065  8889 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:58.513715  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.516995  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:58.520748  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:58.520882  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.535555  8295 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:17:58.535650  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:58.536573  8292 raft_consensus.cc:2468] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:58.536521 12099 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:58.537451 12996 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:58.470249 12811 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.537964  8332 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:58.468901 13017 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.535707 12877 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:58.541400 12877 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.536969  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:58.500756 12809 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:17:58.540269 13017 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.529515 12669 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.558761  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.548789 12518 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:58.564671  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.571643  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:58.571828  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:58.572196  8294 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:58.572371  8220 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:17:58.511687 12745 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:17:58.575125  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.576635  8926 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:58.558764 12809 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.557700 12691 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:58.555244 12996 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.582644 12828 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:58.578373 12999 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:58.574107 12669 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.593520 12491 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:58.625084 12491 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:58.626250 12491 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.626811 12765 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.627578 12491 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:58.596077 12981 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:58.628219 12981 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:58.629045 12981 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:17:58.598270 13027 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:17:58.606734 12991 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.570178 13035 raft_consensus.cc:2804] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:58.630853 12745 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:58.631168 12669 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.556747 12918 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:58.578411  8293 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:17:58.566216 13002 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:58.575083 12709 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.575680 12518 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.619890 12999 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.620126 12828 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.629081  8211 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.644549  8889 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:58.661911  8889 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.646816  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
W20260709 13:17:58.665562  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 74586.4us
I20260709 13:17:58.648674  8293 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:58.649813  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:58.548178 12961 consensus_queue.cc:237] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.656594  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.668555  8366 raft_consensus.cc:2410] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:58.658475  8290 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:58.668987  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:58.610212 12953 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.666441  8258 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:58.676003  8364 raft_consensus.cc:2393] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:58.675959  8217 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:17:58.678668 12969 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.680191  8287 raft_consensus.cc:2368] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14.
I20260709 13:17:58.657917 12518 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.654347 13035 raft_consensus.cc:697] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:58.685751  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:58.686553  8366 raft_consensus.cc:2368] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 15. Current term is 16.
I20260709 13:17:58.693313  8216 raft_consensus.cc:2368] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14.
I20260709 13:17:58.674638 12991 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:58.741466  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 50364.9us
I20260709 13:17:58.657418 13002 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.684167 12765 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.672266 12691 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.695147 12922 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:17:58.674970 12989 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:58.757223  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.766491  8211 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
I20260709 13:17:58.660799 12709 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.802062 12521 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:58.756325 12479 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:58.809954 12697 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.802654 12521 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.812952 12697 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.815034 12521 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.770640 12989 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.654289 12948 consensus_queue.cc:1059] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 13:17:58.839545  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:58.840281  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.840952  8293 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:58.816589 12912 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.846565  8293 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:17:58.847128  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.823431 12697 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:58.772816 12691 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.845311  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:58.824606 12989 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:58.850348  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 187344us
I20260709 13:17:58.744239 13034 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:17:58.859491 12697 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:58.862424 12697 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.862900 12697 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.863586  8889 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:58.857312  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 176271us
I20260709 13:17:58.851329 12912 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.851715 13002 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.874878  8360 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:58.875483  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:58.878554  8367 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.881505  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:58.884593  8291 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:58.884820  8369 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:58.887152  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:58.887881  8295 raft_consensus.cc:2393] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 15: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:17:58.859951 13032 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.843502 12811 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.895829 13042 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:58.901006  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.848101 12809 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.896445 12518 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:58.905112  8367 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:17:58.918051  8368 raft_consensus.cc:1240] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:58.865157 12922 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:17:58.905629 13029 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:17:58.922130  8924 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:58.917084 13042 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:17:58.929090  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 71505.9us
I20260709 13:17:58.747532 13035 consensus_queue.cc:237] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:58.922966 13040 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:17:58.934686  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.935110  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:58.966601  8367 raft_consensus.cc:2393] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:58.927287 12999 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:58.927476 12828 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.974447  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:58.975102  8927 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:58.929785 12978 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:58.933524 12877 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.913003 13032 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:58.936446 12709 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:59.006747  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 143229us
I20260709 13:17:58.971477 12691 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:58.980369 12978 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:58.971503 13042 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.014098 12811 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:58.983991 12999 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:59.025398 12697 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:59.028723 13045 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:59.030866 12978 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.017344 12918 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:59.032601 12809 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.032895 12844 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:59.031994 12989 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.024230 12999 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.026024 13032 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:58.994199 12877 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.051388 13017 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.054916 12996 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:59.056936 13048 log.cc:927] Time spent T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:59.016419 12912 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:58.976773  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:59.102622  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.106976 12550 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.108610 12989 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.108373 12550 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.109901 12989 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.102284 12999 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.112705  8288 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:59.110899 12989 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.114204 12697 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.126873  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.131534  8212 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:59.132102 12912 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.136595 12912 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.137138 12912 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:59.150751  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 393088us
W20260709 13:17:59.059319 12733 consensus_meta.cc:287] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.002s
I20260709 13:17:59.156388 12733 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.157964 12912 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.162070  8292 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:59.148514 12550 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.184700 12696 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:59.185673 12696 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.189353  8220 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
W20260709 13:17:59.160259  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 183458us
I20260709 13:17:59.153752 12877 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:59.201555 12989 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.203665 12696 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.159843 12733 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.229537 12765 raft_consensus.cc:3055] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:59.230087 12765 raft_consensus.cc:740] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:59.239825 12969 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:17:59.245278  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 352510us
I20260709 13:17:59.160261 12912 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.219477 12844 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:17:59.231504 12765 consensus_queue.cc:260] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:59.259400  8258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.028s	sys 0.038s
W20260709 13:17:59.264482  8258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.029s	sys 0.038s
W20260709 13:17:59.280279  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.274591  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:59.282634  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:59.283536 12939 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.284754  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:59.284523 12939 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.286242 12981 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.288004 12939 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.288470 12698 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.288935 12698 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.289351 12698 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.290215  8369 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:59.291942  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.293773 12939 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.294760 13037 log.cc:927] Time spent T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.446s	user 0.001s	sys 0.000s
I20260709 13:17:59.294579 12939 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.286423 12922 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:59.292079  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.301338 12839 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:17:59.303133  8186 leader_election.cc:400] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 15. Current term is 16.
I20260709 13:17:59.303550  8186 leader_election.cc:403] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:17:59.285079 13026 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.821s	user 0.000s	sys 0.003s
I20260709 13:17:59.304976 12947 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 15. Current term is 16.
I20260709 13:17:59.303319 12922 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:59.311017  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:59.311733  8186 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.314045  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.314998  8362 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:17:59.316413 12991 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:59.316685  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:59.317058  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.317196 12991 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.317960  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:59.318733  8369 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.315984  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:17:59.327703  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.330739  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.331001  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.331708  8216 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:59.331883  8211 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:59.313946  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.334529 12765 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:59.336318 12933 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:59.336625 13062 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:59.337096 12933 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.337520 13062 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.339927 12933 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.362447  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:59.383029  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:59.319926 12991 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:59.363481 12939 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.340014 13062 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.343607 12953 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.365223 12698 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.390748  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.400528  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:59.400815  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:59.401386 13049 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.401587 12698 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:59.402405 12698 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.402772 12698 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.403163 12698 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:59.405017  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 738536us
I20260709 13:17:59.406692  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:59.408463 12939 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:59.409368 12518 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.416174 12990 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.416694  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:59.418458 12698 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:17:59.429165  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.433611  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.435293  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.398291 12947 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:59.449419  8920 raft_consensus.cc:2393] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 14: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:17:59.434593  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.401916 13049 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.450819  8292 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:59.455392  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.459297  8294 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:17:59.459187 12990 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.462420 12990 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.457397  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.464322 12809 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.465175 12809 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.467739 12698 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:17:59.470050  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 47867.6us
I20260709 13:17:59.465727  8218 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:59.475622  8369 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:17:59.476857  8186 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:59.480767  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:59.481379 12969 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:59.483830  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:59.485631  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:59.486199  8289 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.488261  8288 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:59.489032  8295 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:59.491508  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.492380  8287 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:59.494014  8291 raft_consensus.cc:3060] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:59.494498  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:59.495508  8294 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.456171 13049 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.497169 13017 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.476763 12947 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.497169  8211 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:59.459237  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:59.499357  8290 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:59.499647  8212 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:17:59.500473  8212 pending_rounds.cc:85] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 7
I20260709 13:17:59.500815  8212 pending_rounds.cc:107] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:59.501173  8212 raft_consensus.cc:2889] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:59.502383 12922 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.478652  8220 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:17:59.508533  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:59.509442  8926 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.513455 12809 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.522246  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:59.523028  8214 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.523643  8261 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:59.524258 12969 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:59.525662 12591 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:59.526355 12591 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:59.526857  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.527660  8368 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:17:59.527828 12591 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:17:59.535657  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48743us
I20260709 13:17:59.507170  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:59.542171  8213 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.560526  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:59.561259  8211 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.561303  8291 raft_consensus.cc:1275] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:59.569768 12735 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:59.572055  8115 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 12, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.575508 12428 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:59.577539  8927 raft_consensus.cc:1275] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:17:59.577967  8927 pending_rounds.cc:85] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 8
I20260709 13:17:59.578233  8927 pending_rounds.cc:107] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:17:59.578532  8927 raft_consensus.cc:2889] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:59.578420  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 161888us
I20260709 13:17:59.594143  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:59.595036  8287 raft_consensus.cc:3060] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.603382  8289 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:59.569167 13032 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:17:59.615651  8218 raft_consensus.cc:1275] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:59.613947  8258 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:59.609321 12947 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:17:59.617915  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:59.619216  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:17:59.620486  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.620919  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.621665  8220 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:17:59.621876  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:59.622490  8288 raft_consensus.cc:3060] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.624186 12698 consensus_queue.cc:1048] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:59.626024  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.626296  8920 raft_consensus.cc:3060] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:59.627183  8924 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:59.627411  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.629689  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:17:59.630231  8365 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:59.631165 12669 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:17:59.632440  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:59.633093  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.633716  8289 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
W20260709 13:17:59.633970  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 90251us
I20260709 13:17:59.638943  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:59.639689  8292 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.596810 12877 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.640515 12877 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.642488 12877 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.644691 13041 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:59.645457 13041 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:59.645815 13041 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:59.646173 13041 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:59.646872  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.648350 12592 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:59.650204  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:59.650372  8115 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 10 to 11, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:17:59.659761  8294 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
I20260709 13:17:59.659703  8365 raft_consensus.cc:2468] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 15.
I20260709 13:17:59.664292  8214 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:17:59.669255  8926 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:59.631531 13049 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.672297  8290 raft_consensus.cc:2468] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:59.673435  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.675045  8213 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:59.677284  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:17:59.678488  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.688202  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:17:59.690733  8292 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:59.680855  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:17:59.696570  8332 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:59.699704  8217 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:17:59.706195 12428 raft_consensus.cc:2804] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:59.706663 12839 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:59.706831 12428 raft_consensus.cc:697] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:59.708897  8294 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:59.693307  8115 catalog_manager.cc:5697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 10 to 12, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.675118 13032 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:17:59.720148 13034 consensus_queue.cc:1048] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:17:59.735065  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.720188 12428 consensus_queue.cc:237] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.736771  8211 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:59.751261 12583 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:17:59.751922 12583 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.772423 12859 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:17:59.774694 13049 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:17:59.781360  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:59.782320  8926 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.781442  8368 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:17:59.787730  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.792232  8924 raft_consensus.cc:1240] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:17:59.794040  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 52901.6us
I20260709 13:17:59.796408  8332 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:59.798440  8332 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:59.799350 12844 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:59.811096  8288 raft_consensus.cc:2468] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:59.730733 12839 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:17:59.731463 12698 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:59.730491 12877 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:17:59.816008  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:17:59.798611 13035 consensus_queue.cc:1048] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:17:59.824710  8920 raft_consensus.cc:1275] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:17:59.827287 13076 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:59.736187 12697 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
W20260709 13:17:59.832939  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 133483us
I20260709 13:17:59.836881  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:17:59.837715  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.839222  8924 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.823619 12844 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:59.842047  8332 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:59.858340  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:17:59.858937  8294 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.825913 12698 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.864712  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:17:59.866343  8217 raft_consensus.cc:3060] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.857296  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:59.834275 12859 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:17:59.875950  8258 leader_election.cc:400] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14.
I20260709 13:17:59.876379  8258 leader_election.cc:403] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:59.853437 12922 raft_consensus.cc:2804] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:59.885288  8926 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
W20260709 13:17:59.887146  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.838966 12877 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.900226 12691 raft_consensus.cc:2804] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:59.900957 12691 raft_consensus.cc:697] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:59.902206 12691 consensus_queue.cc:237] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.908500 13063 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925) with higher term. Message: Invalid argument: T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14.
I20260709 13:17:59.908891 12379 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.909770 12379 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.916790  8287 raft_consensus.cc:2468] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:17:59.847507 13034 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:17:59.926596  8217 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:17:59.936760  8115 catalog_manager.cc:5697] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 12, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:17:59.954586  8892 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:17:59.955771  8294 raft_consensus.cc:2468] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
W20260709 13:17:59.963713  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 51106.1us
I20260709 13:17:59.966647 12988 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.967254 12988 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.967406  8217 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:59.967159 13041 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:17:59.967849 12988 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:59.966567  8183 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:59.943156 12844 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.970536  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:17:59.930867 12859 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.971469 12928 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:59.972149 12928 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:59.972173 12697 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.972738 12859 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.972947 12697 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.974345  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:59.975009 12697 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.976082  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:17:59.976900 12928 raft_consensus.cc:2764] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:59.978992  8183 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:17:59.980324 12928 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:59.972762 12698 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:17:59.981115 12928 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:17:59.982360 12928 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.975083 12518 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:59.929370 12912 consensus_queue.cc:1048] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:17:59.984176  8183 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:17:59.984824  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 219930us
W20260709 13:17:59.987321  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 141519us
I20260709 13:17:59.987789  8332 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:17:59.991058  8924 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
I20260709 13:17:59.953222 12953 consensus_queue.cc:1059] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:59.962393 12922 raft_consensus.cc:697] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:17:59.986877 13063 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:18:00.008270  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:00.025573  8291 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:18:00.008848  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:00.026840  8217 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:18:00.027122  8889 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:00.007725  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:17:59.937704 12839 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:17:59.994751 12735 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.000293 13035 raft_consensus.cc:2804] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:00.021212 13017 raft_consensus.cc:2804] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:00.037755 13063 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:00.039819 13075 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:00.053323  8217 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:00.020812 12939 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:18:00.022828 12859 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:18:00.063228  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:00.057610 13035 raft_consensus.cc:697] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:00.068653 13035 consensus_queue.cc:237] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:18:00.064198  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 56809.1us
I20260709 13:18:00.057961 13017 raft_consensus.cc:697] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
W20260709 13:18:00.062743 13078 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:18:00.081991  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 90451.6us
I20260709 13:18:00.080669  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:00.083184  8183 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:00.085757  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:00.086380  8924 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:00.089530  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:00.094313  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:00.095148  8927 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:18:00.097848  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:00.079258 12939 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:00.099715  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:00.102396  8212 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:18:00.105332 12877 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.106097 13042 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:00.091951 12428 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:00.098662 12697 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:00.113766  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 58723.8us
I20260709 13:18:00.112315 12978 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:00.116443 12978 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:00.117419 12978 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:00.119817  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 78146.6us
I20260709 13:18:00.121266  8920 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:18:00.130048 13063 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.135767 13042 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:00.135978  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:00.112741 12428 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:00.119220 12697 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.113154 12922 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:00.142671  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:18:00.151273  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 57979.6us
I20260709 13:18:00.153820 13035 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:00.144666 12428 raft_consensus.cc:3060] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:00.154718  8292 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:00.157269  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:00.144397 12697 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.182703  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:00.183780  8920 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:00.184837  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:00.185259  8889 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:00.185603  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:00.178144 13095 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:00.178253 12839 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:00.187094 13042 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:00.187609 12939 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:00.196853 12698 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:00.213634 12698 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:00.214066 12698 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.186895 13035 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:00.217411 12583 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.217865 13035 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:00.211156 13089 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.220671 13089 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:00.221107 13089 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.148916 13017 consensus_queue.cc:237] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.205076 13095 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:00.187371 13097 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:00.226046  8115 catalog_manager.cc:5697] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 13, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.204512 12669 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.222005 13042 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:00.240564 13042 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:00.233287 13095 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.211385 12591 consensus_queue.cc:1059] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:18:00.228225 12839 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.264993 12518 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:00.265704 12518 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:00.265563 12988 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.266832  8360 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:00.268904 13106 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.270159  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:18:00.270900  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.266835 12518 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:00.272737 12839 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.276875 12518 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.277783 12988 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.273900 13095 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.282112 12697 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.283166 13089 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:00.285921  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 100767us
I20260709 13:18:00.231685 13097 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.289184  8889 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:18:00.301079  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 102009us
I20260709 13:18:00.232234 12939 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.364313  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:00.365091  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
W20260709 13:18:00.353770  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 64661.5us
I20260709 13:18:00.380328  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:00.381363  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:00.288690 12428 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.385862 12428 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.354426 12969 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.391129  8115 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 10, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.402137  8216 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
W20260709 13:18:00.402697  8116 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46486 (request call id 269) took 28740 ms (client timeout 15000 ms). Trace:
I20260709 13:18:00.405074 12939 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.315832 13097 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.407056  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:00.407629  8218 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.393113  8115 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 10, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.409482  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:00.410683  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:00.423990  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:00.423893  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:00.425879  8920 raft_consensus.cc:2393] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 10: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:00.394629 13041 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:00.435132  8115 catalog_manager.cc:5697] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 10 to 11, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 11 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.351874 13107 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:18:00.438139  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:00.440758  8288 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 12.
I20260709 13:18:00.450877  8115 catalog_manager.cc:5697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 9, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.420657 13095 raft_consensus.cc:2804] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:00.468225  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 115676us
I20260709 13:18:00.469270  8183 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:00.425153 13096 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:00.423679 13034 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:00.473694  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:00.482338  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:00.482009  8115 catalog_manager.cc:5697] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 8 to 9, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.498343  8115 catalog_manager.cc:5697] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 10, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:00.488095  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 217990us
I20260709 13:18:00.452095 13017 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 13:18:00.512285  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 130168us
I20260709 13:18:00.481769 12981 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:00.482318 12947 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.489041 13095 raft_consensus.cc:697] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:00.514763  8115 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 10, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:00.592254  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 58021.7us
W20260709 13:18:00.403162  8116 rpcz_store.cc:269] 0709 13:17:31.662122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.662444 (+   322us) service_pool.cc:224] Handling call
0709 13:18:00.402418 (+28739974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:54.869516 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:54.895139 (+ 25623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:54.895201 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:17:54.895228 (+    27us) tablet.cc:662] Decoding operations
0709 13:17:54.896760 (+  1532us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:54.896841 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:54.896881 (+    40us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:17:54.898352 (+  1471us) tablet.cc:701] Row locks acquired
0709 13:17:54.898378 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:17:54.898556 (+   178us) write_op.cc:270] Start()
0709 13:17:54.898698 (+   142us) write_op.cc:276] Timestamp: P: 1783603074898491 usec, L: 0
0709 13:17:54.898727 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:17:54.899588 (+   861us) log.cc:844] Serialized 4719 byte log entry
0709 13:17:55.239744 (+340156us) op_driver.cc:464] REPLICATION: finished
0709 13:17:55.739358 (+499614us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fa3070ac 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa323c02 00007f3200e47ef0
0709 13:17:55.815643 (+ 76285us) write_op.cc:301] APPLY: starting
0709 13:17:55.815724 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:55.821598 (+  5874us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:55.821624 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:55.846623 (+ 24999us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:55.846861 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:17:55.846907 (+    46us) write_op.cc:312] APPLY: finished
0709 13:17:55.847222 (+   315us) log.cc:844] Serialized 113 byte log entry
0709 13:17:55.847397 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:55.847535 (+   138us) write_op.cc:454] Released schema lock
0709 13:17:55.847580 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:55.847954 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:55.847983 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1061,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":575659,"apply.run_cpu_time_us":14366,"apply.run_wall_time_us":32282,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54311,"num_ops":12,"prepare.queue_time_us":225557,"prepare.run_cpu_time_us":91976,"prepare.run_wall_time_us":162541,"raft.queue_time_us":99455,"raft.run_cpu_time_us":28063,"raft.run_wall_time_us":577032,"replication_time_us":340851,"spinlock_wait_cycles":22080256,"thread_start_us":862273,"threads_started":4,"wal-append.queue_time_us":202793,"wal-append.run_cpu_time_us":12044,"wal-append.run_wall_time_us":1743524}]]}
I20260709 13:18:00.594018 13120 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:00.595053 13112 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:00.595655 13112 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.595866  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:00.596728  8217 raft_consensus.cc:606] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:00.598003 13112 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:00.600569  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53535408ea514f8db7292852927e7743"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:00.600716 12669 raft_consensus.cc:3055] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:00.601177  8217 raft_consensus.cc:606] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:00.601244 12669 raft_consensus.cc:740] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:00.601656  8217 raft_consensus.cc:614] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:00.602605 12669 consensus_queue.cc:260] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.605863  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:00.620018  8217 raft_consensus.cc:606] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:18:00.606475  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.608422  8115 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.620400  8217 raft_consensus.cc:614] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:00.529613  8889 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.233.2:40391 timed out after 1.504s (SENT) [suppressed 6 similar messages]
I20260709 13:18:00.530717 12933 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:00.515380 12550 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:00.659539  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.662717  8115 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 11, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 11 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.526315 13096 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.515311 13034 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.668131  8115 catalog_manager.cc:5697] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:00.678236  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.618034 13042 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.672088 12809 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.710968  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:00.670141 12669 raft_consensus.cc:3060] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.721050  8360 raft_consensus.cc:2368] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12.
I20260709 13:18:00.725338  8115 catalog_manager.cc:5697] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.734345  8115 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 12 to 13, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.742933  8115 catalog_manager.cc:5697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 5 to 7, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 7 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.744336 13122 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:00.744987 13122 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:00.670420 12583 consensus_queue.cc:1059] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:18:00.751988  8261 leader_election.cc:400] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12.
I20260709 13:18:00.755435  8261 leader_election.cc:403] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:00.756489 13121 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.746479  8115 catalog_manager.cc:5697] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 7 to 9, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.762166 13042 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:00.761559  8115 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 6 to 10, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.762838 12809 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:00.766197  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:00.765982 12809 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:00.771416  8115 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 8 to 10, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.748510  8360 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:00.787251 12697 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.788678 13121 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12.
I20260709 13:18:00.789554 13121 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:00.795512 13101 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:00.796159 13101 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.798382 13101 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.802181  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:00.802731 13089 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.807058 13034 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.806986 13032 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:00.808279 13032 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.813027  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:00.813385  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:00.815550 13032 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.815927  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:00.817631  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:00.736259 13095 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:00.834543  8218 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:00.759948  8216 raft_consensus.cc:2468] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:18:00.847949  8924 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:00.856292  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:18:00.860829  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 420039us
I20260709 13:18:00.870214  8212 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:00.871173  8212 raft_consensus.cc:606] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:00.871675  8212 raft_consensus.cc:614] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:00.861639  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:00.747242 13122 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:00.874323  8332 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:00.753361 12379 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:00.748605 13096 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:00.841455 12765 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:00.884768  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:00.667138 12933 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:18:00.895604  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 49199.1us
I20260709 13:18:00.891940  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:00.891170  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:00.899822  8927 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
W20260709 13:18:00.917524  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 387918us
I20260709 13:18:00.881481 13107 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:00.930500  8217 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:00.889075 12765 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.901037 12844 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:00.895323 12691 raft_consensus.cc:2804] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:00.938156  8295 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:00.950485  8290 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:18:00.961920  8295 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:00.966337  8217 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:00.937752 12765 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.930100 13107 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:00.975564  8216 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:00.970567  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:00.917246 13106 consensus_queue.cc:1059] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:18:00.964718 12698 consensus_meta.cc:287] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.750s	user 0.012s	sys 0.000s
I20260709 13:18:00.981806  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:18:00.980657  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 102353us
I20260709 13:18:00.989059  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:00.989349  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
W20260709 13:18:00.989321  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.990080  8217 raft_consensus.cc:606] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:00.990487  8217 raft_consensus.cc:614] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:00.963933 12691 raft_consensus.cc:697] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:00.991182  8922 raft_consensus.cc:2393] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:00.994043  8186 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:00.992877  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:00.993841  8218 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:18:00.970953 12844 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:00.977779 13107 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.006125  8186 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:01.007491  8332 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:01.014497  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.015648  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:01.018349  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:01.018626 13089 consensus_queue.cc:1059] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:01.019497  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:01.019666 13089 raft_consensus.cc:3055] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:01.020012  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:01.020071 13089 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:01.022528 13089 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:01.028671  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:18:01.029145 13097 consensus_meta.cc:287] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.609s	user 0.001s	sys 0.009s
I20260709 13:18:01.029479  8922 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:18:01.029587 13097 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.035399  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.036128  8295 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:01.035599 12844 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.037113  8925 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:18:01.041149  8920 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:01.011952 13096 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:01.045492 13096 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:01.046617 13096 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.048324  8928 raft_consensus.cc:3060] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.048552 12691 consensus_queue.cc:237] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.051756 13096 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.053755 12933 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:01.029979  8292 raft_consensus.cc:1275] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:01.062076  8927 raft_consensus.cc:2368] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13.
W20260709 13:18:01.062583 13078 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:01.016224 12379 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.988611 12698 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.063730 12765 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.064304 13063 raft_consensus.cc:3055] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:01.064747 13063 raft_consensus.cc:740] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:01.065395 12698 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.065800 12765 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.065550 13063 consensus_queue.cc:260] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.017213 13034 raft_consensus.cc:2804] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:01.066852 13063 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.066967 13034 raft_consensus.cc:697] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:01.068032 13034 consensus_queue.cc:237] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.031775 13097 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:01.073626 13096 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.074183 13096 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.018247  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:01.075757  8919 raft_consensus.cc:3060] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.076267  8928 raft_consensus.cc:1275] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:18:01.080611  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c96431d125f4d169be8f25647f9371e. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:01.089869  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 72230.9us
I20260709 13:18:01.090560  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:01.091200  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:01.093448 13113 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:01.104212  8288 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:01.106159  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.109028  8287 raft_consensus.cc:1275] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:01.115550  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:01.116183  8926 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:01.094580 12698 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:01.119462  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 122219us
I20260709 13:18:01.108592 13104 raft_consensus.cc:993] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:01.102528 13113 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:01.093945 13032 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:18:01.135746  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:01.118153 12698 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:01.137187 12698 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.139269  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:01.101943 12988 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:18:01.108278 12922 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:18:01.142186  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 68140.8us
I20260709 13:18:01.147248  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.185811  8919 raft_consensus.cc:2468] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:18:01.134327 12933 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.149181  8213 raft_consensus.cc:1275] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:01.117789 13035 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:01.151506  8212 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:01.119866 13137 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:18:01.151568  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:01.127453 13113 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:01.153205 13104 raft_consensus.cc:1081] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:01.156395  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:01.156978  8926 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
I20260709 13:18:01.199257  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.139899  8369 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.186520  8214 raft_consensus.cc:2393] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:01.185595  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:18:01.188242  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 51739.4us
I20260709 13:18:01.201471  8288 raft_consensus.cc:2368] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14.
W20260709 13:18:01.202018  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.208164  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.209050  8220 raft_consensus.cc:2410] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:01.187661 12697 raft_consensus.cc:3060] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.187677 13115 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.216583  8332 leader_election.cc:400] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13.
I20260709 13:18:01.216897  8332 leader_election.cc:403] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.208896 13107 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:01.220368  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.221038  8332 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:01.223752  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.184655 12859 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:18:01.227305  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.229818  8286 raft_consensus.cc:3060] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.206770 12912 consensus_queue.cc:1048] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:18:01.232007  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.232898  8292 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:18:01.233477  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.233697  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.234975 13128 consensus_queue.cc:1048] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:01.238149  8367 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:01.222066 13096 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:01.239331  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.246691  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 54038.4us
W20260709 13:18:01.247385 13152 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:18:01.215675 13132 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:18:01.252401 12379 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:01.261713  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.264371  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.264364 13146 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.264606  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.265159 13146 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.265556  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.266201  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.267277 13146 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.268198  8289 raft_consensus.cc:3055] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:01.268553  8289 raft_consensus.cc:740] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:01.269306  8289 consensus_queue.cc:260] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.270051  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:01.216336 12428 consensus_queue.cc:1048] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:18:01.239985 13116 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.230458 12877 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:01.231379 13115 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.265709  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.267868  8295 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:01.270690  8919 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.281159  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.279475  8293 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.270242  8289 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:01.284343  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.285974  8220 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:18:01.273993 13116 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.274930 12877 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:01.288511  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.367478  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:01.367849  8919 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:18:01.371249  8186 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:01.289113  8217 raft_consensus.cc:1240] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:18:01.373402  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.374584  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.291980  8287 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:18:01.377045  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.287233  8369 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:01.292299  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.380343 13111 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 12. Current term is 13.
I20260709 13:18:01.380707  8361 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:01.294939  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.382076  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.298702  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:01.384711  8211 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:18:01.385605  8216 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:01.300834  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.305094  8366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:18:01.388224  8366 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:01.388563  8366 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.390343  8926 raft_consensus.cc:1240] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:18:01.390676  8922 raft_consensus.cc:1240] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:01.307719  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.312269  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.325327  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:18:01.392714  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 165412us
I20260709 13:18:01.392956  8213 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 15: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:18:01.393235  8214 raft_consensus.cc:2393] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:01.329512  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.387283  8294 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:18:01.353754  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.292299  8924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.396488  8924 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:18:01.333374 13116 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.397210  8923 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:01.361523 12697 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:01.325800 13107 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:01.318158 12698 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.293063  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:01.401918  8369 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:01.402786  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.345387  8288 raft_consensus.cc:2468] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:18:01.355557  8258 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.380741  8920 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:01.294037  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.293707  8928 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:01.316146  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:01.405745  8220 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.397066  8212 raft_consensus.cc:2393] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 13: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:18:01.361652  8286 raft_consensus.cc:2468] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:18:01.395602  8291 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:18:01.408262  8922 raft_consensus.cc:1240] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:01.380071  8919 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 10.
I20260709 13:18:01.347601  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.363205  8293 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:18:01.351305  8889 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:01.355696 13063 consensus_queue.cc:1048] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:18:01.345305 12988 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:18:01.413545  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 62378.8us
I20260709 13:18:01.413625 12988 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:01.414480  8889 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:01.416235 13096 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.417831 12698 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.394308  8289 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:18:01.418610  8289 pending_rounds.cc:85] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 11
I20260709 13:18:01.418823  8289 pending_rounds.cc:107] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:18:01.419059  8289 raft_consensus.cc:2889] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:01.412838  8925 raft_consensus.cc:2368] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12.
I20260709 13:18:01.357612 13146 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:18:01.421176 13095 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:01.343084 12379 raft_consensus.cc:493] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
W20260709 13:18:01.423903  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.423103  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:01.410665  8366 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:01.288247 13089 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.291679 13115 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.293776  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.410593 13150 consensus_queue.cc:1059] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:18:01.291874 12877 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.431200  8926 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.360219 13113 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.434521  8220 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:01.440737  8183 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:01.441583 12928 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:01.445125  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:01.415912 12988 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:01.444860  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:01.452189  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:01.478861  8361 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:01.473693  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.470839  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.466737  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:01.480767  8290 raft_consensus.cc:2410] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:18:01.481107  8218 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:01.466300  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:01.483296  8366 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:01.470527  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.435118 12583 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:01.488703  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 48049.6us
I20260709 13:18:01.495391  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.498716  8294 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 14: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:18:01.440652 12981 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.457854  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:01.507613 13169 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:01.513326  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 157843us
I20260709 13:18:01.607856  8258 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.447402 12928 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.552286  8214 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:01.609105  8214 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:01.555095  8926 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:01.453871 13138 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:01.555815  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 57576us
W20260709 13:18:01.556605  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 45174.4us
I20260709 13:18:01.556912  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:01.470166 13150 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:01.555703  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.477551 13113 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.433144 12379 raft_consensus.cc:515] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.641104  8258 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.516127 13104 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:01.436923 13063 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:18:01.575474 12735 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:18:01.442420 13106 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
W20260709 13:18:01.643118  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 176951us
I20260709 13:18:01.642108  8214 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:01.665269  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.657024  8258 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.620647 12928 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.634393 13150 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:01.669737  8367 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:01.669862  8214 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.652240 12839 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.651286 13138 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:01.634618 12583 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:01.681485  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.665485 12669 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:01.691038  8258 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.680742 13097 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.692413  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.697765  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:01.698870  8294 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.691552 13121 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:18:01.718545 13165 log.cc:927] Time spent T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:18:01.724502 13177 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:01.701480 13169 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.761222 13121 consensus_queue.cc:1243] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:01.725046 12379 leader_election.cc:290] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.706475 13150 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:18:01.729327  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 55142.2us
I20260709 13:18:01.716719  8214 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:01.774169  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:01.779088  8294 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:01.782618  8212 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:18:01.786226  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 139943us
W20260709 13:18:01.797983  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 88052.9us
W20260709 13:18:01.812237  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 46133.7us
I20260709 13:18:01.813444  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.798030 12550 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:01.831359 13151 raft_consensus.cc:2749] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.833467 13179 ts_tablet_manager.cc:933] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:01.836447 13170 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:18:01.837798 13150 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:01.850344  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48696.3us
W20260709 13:18:01.851368  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.857239 13176 consensus_queue.cc:1059] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:01.859097 13176 raft_consensus.cc:3055] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:01.860982  8922 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:18:01.861500  8922 pending_rounds.cc:85] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 9
I20260709 13:18:01.861775  8922 pending_rounds.cc:107] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:18:01.862087  8922 raft_consensus.cc:2889] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:01.864323  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:01.865161 12961 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.865558 12961 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:01.865957 12961 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.868665  8921 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:18:01.864459  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 90415.2us
I20260709 13:18:01.825611 13106 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:01.873049  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.877563 12859 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.877748  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
W20260709 13:18:01.884859  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 298192us
I20260709 13:18:01.859737 13176 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
W20260709 13:18:01.885466  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 49565.4us
W20260709 13:18:01.901196  8892 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.903055  8889 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:01.903357  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:01.902132 13176 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.905756  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.906698  8291 raft_consensus.cc:2368] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 12. Current term is 13.
I20260709 13:18:01.907119  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.907251  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.907917  8288 raft_consensus.cc:2393] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:18:01.906452 13106 raft_consensus.cc:2804] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:01.910017  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.912334  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.920316  8889 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:18:01.921253  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.922349  8293 raft_consensus.cc:1275] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:18:01.923597  8293 pending_rounds.cc:85] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 11
I20260709 13:18:01.923874  8293 pending_rounds.cc:107] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:18:01.924386  8293 raft_consensus.cc:2889] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:01.924255 13163 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:01.925424  8925 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:01.922804  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.912099 13106 raft_consensus.cc:697] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:01.928356 13096 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:01.930198  8889 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:01.927397 13106 consensus_queue.cc:237] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.928402  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:01.933132 13096 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:01.934653  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:01.930794 12928 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.937181 13190 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:01.937781 13190 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:01.937860 12928 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:01.938853 13190 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.849328 13138 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:01.909698 13176 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:01.939942  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:18:01.948153  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48134.9us
W20260709 13:18:01.948873  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.949075  8889 leader_election.cc:400] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 12. Current term is 13.
I20260709 13:18:01.949450  8889 leader_election.cc:403] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:01.956223  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea6012070404ef6b810517d977625da" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:01.895099 13104 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:01.958927  8258 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:01.943408 13049 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:01.923905 12859 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:18:01.952739 13089 consensus_meta.cc:287] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:18:01.995605  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:02.004246  8295 raft_consensus.cc:1275] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:02.003674  8332 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:18:02.006156  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 61558.4us
I20260709 13:18:02.011857  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:02.012692  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:01.976902 13097 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 12. Current term is 13.
I20260709 13:18:01.975921 13121 raft_consensus.cc:493] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.975608 13132 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.000882 12583 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.005750 13049 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:02.009512 13120 raft_consensus.cc:493] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:02.019652 12988 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:18:02.017465 13111 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.975260 13063 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:18:02.021695 13089 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:18:02.066035 13171 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:02.081440 13120 raft_consensus.cc:515] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.082444 12583 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:02.083062 12669 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:02.083276  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 76287.7us
I20260709 13:18:02.083554 12669 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:02.060873 13121 raft_consensus.cc:515] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:02.084632  8889 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:18:02.085407 13180 log.cc:927] Time spent T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:18:02.085958 13121 leader_election.cc:290] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:18:02.086629  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.065104 13096 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:02.061520 12961 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.080132 13063 consensus_queue.cc:1243] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:02.097474 12961 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:02.102763  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.048620 13179 tablet_copy_client.cc:323] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
W20260709 13:18:02.116731  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 104132us
I20260709 13:18:02.112653 13096 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.114686 12839 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:18:02.129549  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 180211us
I20260709 13:18:02.133543  8219 pending_rounds.cc:85] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 4
I20260709 13:18:02.133854  8219 pending_rounds.cc:107] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:18:02.134074  8219 raft_consensus.cc:2889] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:02.129065  8220 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:02.140753  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:02.141505  8286 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:02.136929 12839 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:02.145758  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:02.145996  8288 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:18:02.157923  8212 raft_consensus.cc:1275] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:02.157999  8286 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:18:02.159099  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:02.159907  8294 raft_consensus.cc:2393] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 14: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:18:02.180642  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:02.193112  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:02.121066 12961 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:18:02.125149 12698 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:18:02.116909 13104 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:02.192559 12928 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.134732 12669 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:02.257521  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.186084 13049 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.324973 13163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33854 (request call id 0) took 7255 ms. Trace:
W20260709 13:18:02.326924  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 66198.9us
W20260709 13:18:02.327322  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 142387us
I20260709 13:18:02.227593 12928 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:02.392264  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 233301us
I20260709 13:18:02.393242  8186 leader_election.cc:304] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:02.394506  8367 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: []
W20260709 13:18:02.395138  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 399611us
I20260709 13:18:02.399048  8218 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:18:02.400295  8259 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.400342  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 70327.9us
I20260709 13:18:02.402694  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:02.403648  8214 raft_consensus.cc:2410] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:02.431020  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:02.432808  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
W20260709 13:18:02.435379 13182 log.cc:927] Time spent T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:18:02.436743 13198 raft_consensus.cc:2749] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.437884 13201 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.325739 13163 rpcz_store.cc:276] 0709 13:17:55.069183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.073897 (+  4714us) service_pool.cc:224] Handling call
0709 13:17:55.870484 (+796587us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b5400293220. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd38e520 00007f31fd417b42 00007f31fd416800 00007f32023d7d29 00007f31fb9561d4 00007f31fb956162 00007f31fb956091 00007f31fb95600c 00007f31fb9552c2 00007f31fb74c48c
0709 13:17:55.883182 (+ 12698us) log.cc:844] Serialized 492 byte log entry
0709 13:17:56.258295 (+375113us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5400293220. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd391b26 00007f31fd38b49a 00007f31fd38a714 00007f31fd36aeaa 00007f31fd371d53 00007f31fd371cd9 00007f31fd371c69 00007f31fd371c31 00007f31fd370dfd 000000000038f354
0709 13:17:56.260688 (+  2393us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b5400293220. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd38a142 00007f31fd36aeaa 00007f31fd371d53 00007f31fd371cd9 00007f31fd371c69 00007f31fd371c31 00007f31fd370dfd 000000000038f354 000000000038f199 00007f31fa324475
0709 13:17:56.277782 (+ 17094us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5400293220. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd38a142 00007f31fd36aeaa 00007f31fd371d53 00007f31fd371cd9 00007f31fd371c69 00007f31fd371c31 00007f31fd370dfd 000000000038f354 000000000038f199 00007f31fa324475
0709 13:17:56.685472 (+407690us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b4c00227780. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fb6dda20 00007f31fb6eea29 00007f31fb6ef13f 00007f31fb6b32ab 00007f31fb6e0f3c 00007f31fb6e13fe 00007f31fb96e50b 00007f31fd36d381 00007f31fd36b26b 00007f31fd371d53 00007f31fd371cd9
0709 13:17:56.801707 (+116235us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:17:56.941098 (+139391us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b4c00227780. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fb6dda20 00007f31fb6eea29 00007f31fb6ef13f 00007f31fb6b32ab 00007f31fb6e0f3c 00007f31fb6e13fe 00007f31fb96e50b 00007f31fd36d381 00007f31fd36b26b 00007f31fd371d53 00007f31fd371cd9
0709 13:17:56.964453 (+ 23355us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4c00227780. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fb6dda20 00007f31fb6eea29 00007f31fb6ef13f 00007f31fb6b32ab 00007f31fb6e0f3c 00007f31fb6e13fe 00007f31fb96e50b 00007f31fd36d381 00007f31fd36b26b 00007f31fd371d53 00007f31fd371cd9
0709 13:18:02.324829 (+5360376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33289,"raft.queue_time_us":4247,"raft.run_cpu_time_us":32506,"raft.run_wall_time_us":2590706,"spinlock_wait_cycles":437848320,"thread_start_us":113260,"threads_started":1,"wal-append.queue_time_us":187931,"wal-append.run_cpu_time_us":11823,"wal-append.run_wall_time_us":1737971}
I20260709 13:18:02.447232 13063 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:02.447734 13063 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:18:02.448190 13063 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:02.465793  8183 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:02.478434  8364 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:02.482496  8258 leader_election.cc:400] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 11. Current term is 12.
I20260709 13:18:02.455919 13107 consensus_queue.cc:1048] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:02.494978  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:18:02.482339 13181 log.cc:927] Time spent T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:18:02.513742  8261 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.464704 13150 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:18:02.559903  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 83117.3us
W20260709 13:18:02.559516 13164 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:02.502722 13121 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:02.552168 12583 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:02.577394  8287 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:02.601572  8291 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:02.582160  8889 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:02.609845  8364 raft_consensus.cc:1275] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:02.560321 13213 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:02.621325  8212 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:02.624841  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet 4c96431d125f4d169be8f25647f9371e from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:18:02.625344 13213 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:02.625506  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet 4c96431d125f4d169be8f25647f9371e from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-4c96431d125f4d169be8f25647f9371e
I20260709 13:18:02.625751 13208 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.626296 13208 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:02.626474 13213 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:02.632737  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.600234 13169 consensus_queue.cc:1048] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 13:18:02.641278 13207 log.cc:927] Time spent T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:02.641671  8366 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:02.615228 13096 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:02.647468 13192 log.cc:927] Time spent T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.493s	user 0.000s	sys 0.008s
I20260709 13:18:02.650226 12928 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:02.652980  8292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1891) took 1203 ms. Trace:
I20260709 13:18:02.653378  8292 rpcz_store.cc:276] 0709 13:18:01.449652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.450990 (+  1338us) service_pool.cc:224] Handling call
0709 13:18:01.451251 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.766366 (+315115us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:01.766395 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.794466 (+ 28071us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.009230 (+214764us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:02.009279 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.009368 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.646785 (+637417us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:18:02.652698 (+  5913us) raft_consensus.cc:1685] finished
0709 13:18:02.652718 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.652907 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45937,"raft.queue_time_us":61389,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":17557,"spinlock_wait_cycles":11460352,"thread_start_us":444358,"threads_started":2,"wal-append.queue_time_us":320577}
W20260709 13:18:02.661836  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 79754.5us
I20260709 13:18:02.662870  8889 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:02.667637 13224 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.685346  8923 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:02.689304  8919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282a740dc06c41f0b77f4880423e4395" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:18:02.729954  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 46326.8us
W20260709 13:18:02.732424  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 148187us
I20260709 13:18:02.744578  8889 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:02.761986  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:18:02.764401  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 62931.4us
I20260709 13:18:02.686931 13169 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:18:02.689651 13190 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:18:02.778293  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:02.779196  8927 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 15.
I20260709 13:18:02.735970 13208 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:18:02.802678  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 58209.5us
I20260709 13:18:02.747671 13233 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:02.735956 13211 consensus_queue.cc:1048] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:18:02.779975 13150 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:02.818514  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:02.815435 13233 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.825184 13203 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:02.778697 13224 consensus_queue.cc:1048] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:02.825623 13227 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.801433 13229 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
W20260709 13:18:02.836624  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 130516us
I20260709 13:18:02.817276 13150 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.900842 13150 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:02.909318  8378 tablet_copy_source_session.cc:215] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:02.860261 13223 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:02.912974 13223 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.863447 13236 consensus_queue.cc:1059] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:18:02.838007 13203 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.919991 13203 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:02.843116 13233 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:02.923388 13223 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:02.890364 13240 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:02.891752 13211 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.945363 13211 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.825224 13245 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 13:18:02.947878 13233 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:02.897783 13217 log.cc:927] Time spent T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.418s	user 0.003s	sys 0.000s
I20260709 13:18:02.948639 13233 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:02.951202 13233 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:02.952343 13096 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:02.840570 13227 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:02.955475 13227 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:18:02.969921  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 151408us
I20260709 13:18:02.978523  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:02.999898 13254 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:02.999933 13150 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.000634 13254 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.001744 13150 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.003996 13254 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.005578 13254 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.006172 13254 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.010792 13254 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.010670  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.019932 13251 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.020687 13251 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.022253  8332 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:03.023343 13251 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.024067 13116 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:03.024816 13116 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:03.026109 13116 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:02.866734 13063 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.032291  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.060887  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.085613  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.086645  8212 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:03.090695  8287 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 15.
I20260709 13:18:03.091109  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.091822  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.085186 13236 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.111254 13262 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.111982 13262 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.115280 13262 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.085597 13254 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.118137  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.118984  8212 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:18:03.099650 13211 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:03.126833 13199 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.124776 13254 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:03.122507 13236 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.140312 13268 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.141203 13268 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.142496  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.143172  8366 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:18:03.144364 13268 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:03.144726  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.145299  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.146096  8363 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:03.146579  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.147157  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.147781  8364 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:18:03.149159  8186 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:03.137943 13150 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.153378  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:03.158987 13255 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:03.159572 13255 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.154203 13233 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:03.161437 13233 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.161861 13233 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.159978 13255 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.189082 13233 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.192710  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:03.192713 13255 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.202111  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:03.202853  8364 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.202904  8363 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:18:03.207854  8186 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:03.208820 13063 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.210608 13251 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:03.210989 13255 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.211169 13251 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:03.214233  8261 leader_election.cc:304] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.215045 13233 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.159062 13242 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:03.239620 13251 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.255489  8364 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 14.
W20260709 13:18:03.268383 13196 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.116s	user 0.004s	sys 0.006s
W20260709 13:18:03.276976 13206 log.cc:927] Time spent T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.882s	user 0.007s	sys 0.001s
I20260709 13:18:03.285389  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.286202  8295 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:18:03.288014  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:18:03.305064  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 214019us
I20260709 13:18:03.305490  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.312502  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:03.289717 13268 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.289929 13237 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.322754  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:03.323635  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:03.334482  8218 raft_consensus.cc:2393] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 15: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:18:03.326797  8293 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:03.327016  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.329273  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.293962 13190 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:03.334895  8293 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:03.308413 13163 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.341419  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.327271 13203 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:03.307984 13211 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:18:03.364755 13272 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:03.365567 13272 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.337564 13177 raft_consensus.cc:2749] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.370488  8926 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:03.372550  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.353406 13203 raft_consensus.cc:493] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.337541 13268 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.382606 12669 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.339190 13237 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.394001 13237 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.344012 13190 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.377138 13203 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.399808 13236 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.401796 13120 leader_election.cc:290] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.410377 13190 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.391592 13208 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:03.424764 13208 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:03.425737 13208 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.427719 13213 raft_consensus.cc:493] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.427832  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.428369 13213 raft_consensus.cc:515] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.430471 13213 leader_election.cc:290] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.413445 13096 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.432300 13096 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.434388 13096 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:03.421376 13268 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.436084 13107 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.439677  8926 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:03.441792 13229 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.436691 13107 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.444762 13229 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.468161 13176 raft_consensus.cc:493] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.468832 13176 raft_consensus.cc:515] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.469391 13107 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.470963 13176 leader_election.cc:290] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.450834 13106 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.473510 13203 raft_consensus.cc:515] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.473199 13106 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.475695 13203 leader_election.cc:290] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:03.475816 12839 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:18:03.477739 13216 log.cc:927] Time spent T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 1.047s	user 0.007s	sys 0.000s
I20260709 13:18:03.475826 13106 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.480365  8217 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 2018) took 1356 ms. Trace:
I20260709 13:18:03.480711  8217 rpcz_store.cc:276] 0709 13:18:02.124099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.124230 (+   131us) service_pool.cc:224] Handling call
0709 13:18:02.132886 (+  8656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.137446 (+  4560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.137476 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.182836 (+ 45360us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.330320 (+147484us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:02.480167 (+149847us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.623896 (+143729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.623978 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.476982 (+853004us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:18:03.480021 (+  3039us) raft_consensus.cc:1685] finished
0709 13:18:03.480144 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.480289 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81429,"prepare.queue_time_us":222961,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":154685,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":23200,"spinlock_wait_cycles":47353088,"thread_start_us":346041,"threads_started":3,"wal-append.queue_time_us":129759}
I20260709 13:18:03.483377 12839 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.483649 13201 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.484102 12839 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.484200 13201 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.486482 13201 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.486559 12839 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.451146 13096 raft_consensus.cc:493] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.491299  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:03.458797 13229 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:18:03.493305  8218 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:03.493780 13184 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:03.494330 13184 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.494720 13184 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.494792  8215 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:03.496616  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.508880  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.513134  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.514712  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:18:03.521934  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 150730us
I20260709 13:18:03.456311 13190 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.524253  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:03.525516  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:18:03.529506  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 8942278c55614601a1290e32997fe007: Illegal state: Replica 9e95b04d03d241329435b6d08dd1f236 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
W20260709 13:18:03.525513  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 153086us
I20260709 13:18:03.535415 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c96431d125f4d169be8f25647f9371e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:03.537580  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.540838  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.527218 13190 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.547411 13190 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:03.548295 13194 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 1.434s	user 0.000s	sys 0.012s
W20260709 13:18:03.548628 13204 log.cc:927] Time spent T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.152s	user 0.002s	sys 0.005s
I20260709 13:18:03.549733  8361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 644) took 1628 ms. Trace:
I20260709 13:18:03.550092  8361 rpcz_store.cc:276] 0709 13:18:01.920833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.920968 (+   135us) service_pool.cc:224] Handling call
0709 13:18:01.921362 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.928240 (+  6878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.928276 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.928755 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.014299 (+ 85544us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:02.014358 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.014420 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.547606 (+1533186us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:18:03.549405 (+  1799us) raft_consensus.cc:1685] finished
0709 13:18:03.549433 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.549649 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6458,"raft.queue_time_us":7590,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":4071168,"thread_start_us":85100,"threads_started":1,"wal-append.queue_time_us":171677}
I20260709 13:18:03.553673 13208 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.557387  8369 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:03.566339  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e8a922b99844e085b2b1e126cfb02e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.533869  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.568517  8928 raft_consensus.cc:3055] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:03.570304  8928 raft_consensus.cc:740] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:03.554219 13208 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.521124 13096 raft_consensus.cc:515] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.564924 13272 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:03.571518  8925 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 1062) took 1612 ms. Trace:
I20260709 13:18:03.588107  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.588907  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.589480  8294 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:03.590528  8183 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.594707  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.595820  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.596463  8215 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:18:03.598140  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.599552  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.600473  8215 raft_consensus.cc:2410] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:03.578181  8928 consensus_queue.cc:260] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.602156  8183 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.602834  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.605399  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.606078 12379 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:03.597653  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.604511 13213 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.612900  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.604993  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:18:03.614408  8288 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 708) took 1695 ms (client timeout 2177 ms). Trace:
I20260709 13:18:03.614548  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.587828  8925 rpcz_store.cc:276] 0709 13:18:01.956242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.977286 (+ 21044us) service_pool.cc:224] Handling call
0709 13:18:02.003460 (+ 26174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.014465 (+ 11005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.014532 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.019083 (+  4551us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.129168 (+110085us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:02.129205 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.129268 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.488364 (+1359096us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b4400022b4c. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fa1acdb1 00007f31fa24ac85 00007f31fa24b6a2 00007f31fcfbd1db 00007f31fcfb8aaf 00007f31fcfac86e 00007f31fcfabbb6 00007f31fcfab7d8 00007f31fcfb5221 00007f31fcfb51d9 00007f31fcfb5169
0709 13:18:03.555120 (+ 66756us) raft_consensus.cc:1685] finished
0709 13:18:03.555148 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.568141 (+ 12993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8838,"raft.queue_time_us":6608,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":29941,"spinlock_wait_cycles":66297728,"thread_start_us":109691,"threads_started":1,"wal-append.queue_time_us":271585}
I20260709 13:18:03.616295  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.616636  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3caa82d776714435898936cb4c6041c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.617198  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.617367  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.618310  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.571015 13287 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:03.614833  8288 rpcz_store.cc:269] 0709 13:18:01.911926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.912084 (+   158us) service_pool.cc:224] Handling call
0709 13:18:03.606998 (+1694914us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400426b54. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd4152fa 00007f32023d6b17 00007f31fb9516d4 00007f31fb951662 00007f31fb951591 00007f31fb95150c 00007f31fb9507c2 00007f31fb74c48c 00007f31fb74b8c6 00007f31fb74b26f
0709 13:18:03.607112 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535074176}
I20260709 13:18:03.621057  8292 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:18:03.622663  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.615185  8287 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:03.583740 13208 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.623704  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.573648 12953 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.631990 12953 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.633065  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.634673 12953 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.636233  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.606475 13242 consensus_queue.cc:1059] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:18:03.638774 13242 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:03.639127 13242 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:03.620375  8258 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:03.639953 13242 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.641043 13283 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:03.641451 13283 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.641862 13283 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.642719  8289 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1885) took 2195 ms. Trace:
I20260709 13:18:03.641584 13242 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.644335 13199 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.644863 13199 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.646976 13199 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.598004 13184 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:03.647753 13205 log.cc:927] Time spent T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 1.218s	user 0.008s	sys 0.010s
I20260709 13:18:03.625918 13096 leader_election.cc:290] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.650029 13184 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:03.654367 13169 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.654964 13169 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.657326 13169 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.660691  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.661072 13122 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:03.661334  8923 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 9.
I20260709 13:18:03.661612 13122 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.662283 13254 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.663669 13122 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.631034 13287 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.665208  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.665758 13287 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.666847  8926 raft_consensus.cc:1240] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:03.669273 13286 consensus_queue.cc:1059] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:18:03.670033 13286 consensus_queue.cc:1243] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Peer 9e95b04d03d241329435b6d08dd1f236 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:03.673846  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.678700  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.681525  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.649807  8293 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:03.684758  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 64414.4us
I20260709 13:18:03.687016  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.643118  8289 rpcz_store.cc:276] 0709 13:18:01.447771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.453369 (+  5598us) service_pool.cc:224] Handling call
0709 13:18:01.504188 (+ 50819us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:01.576636 (+ 72448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.576668 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:01.917747 (+341079us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b2c00010988. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fbd0aa11 00007f31fbd1a372 00007f31fd44ca01 00007f31fd41143a 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2
0709 13:18:01.953918 (+ 36171us) log.cc:844] Serialized 544 byte log entry
0709 13:18:02.183449 (+229531us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:02.335167 (+151718us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.335666 (+   499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.641493 (+1305827us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b1800392320. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa2f22a6 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419
0709 13:18:03.642388 (+   895us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b5400389854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:18:03.642435 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.642480 (+    45us) raft_consensus.cc:1685] finished
0709 13:18:03.642495 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.642637 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2100,"prepare.queue_time_us":301340,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":71,"raft.queue_time_us":1379,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":10818,"spinlock_wait_cycles":182866944,"thread_start_us":305727,"threads_started":2,"wal-append.queue_time_us":228282,"wal-append.run_cpu_time_us":2832,"wal-append.run_wall_time_us":1233464}
I20260709 13:18:03.692152  8293 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:03.692509  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 65436.5us
I20260709 13:18:03.699368  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:03.700686  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.334862  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:03.704764  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.707175  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.707763  8288 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:18:03.710080  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:03.712157  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.715756  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.716502  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.716626  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:03.718776  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.720729  8288 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:18:03.718791  8925 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.721673  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.724893  8186 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.725842  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.706233 12922 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.730089 12379 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:03.733239 13252 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:03.737208 12379 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.733717 13132 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:03.741559  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:03.734661  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.734866  8293 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:03.731540 13169 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:03.734977 13213 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:03.750204 13187 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.746201 13169 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:18:03.750909 13151 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:18:03.750829 13187 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.735824  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.711228 12859 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:03.751801 12859 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.752949 13187 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.753758 12859 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:03.734539 13088 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.735571 13183 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:03.754746 13183 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.740285 13287 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.717259 12669 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.758455  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:03.759421  8286 raft_consensus.cc:2393] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 13: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:18:03.719199 12839 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.759616  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:03.773326  8295 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.746222 13252 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.750845 13169 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:03.711297 13177 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.759610  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:03.774556  8889 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:03.785285  8364 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:18:03.785332  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.787110  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.789347  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee0be2dae2824fd89d658f949f717dfc" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.773128 13197 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:03.791241  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.791927  8922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54790 (request call id 1065) took 1657 ms. Trace:
I20260709 13:18:03.778411 13287 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:03.793399  8367 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:03.794641  8361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7feffaf779354992809fb6a460399626" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.797806  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.785017 13127 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:03.804029  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.748376 12922 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.806826  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.792310  8922 rpcz_store.cc:276] 0709 13:18:02.134839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.135000 (+   161us) service_pool.cc:224] Handling call
0709 13:18:02.135307 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.135533 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:02.341926 (+206393us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.397740 (+ 55814us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.195522 (+797782us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b180033fe20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fa324522 00007f31fa3267c1 00007f31fa326779 00007f31fa326709 00007f31fa3266d1 00007f31fa3259cd 000000000038f354 000000000038f199 00007f31fa30783a
0709 13:18:03.678094 (+482572us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b180033fe20. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fcfb94bc 00007f31fa30748b 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa321455 00007f31fd409060 00007f31fd41b716 00007f31fd42c287
0709 13:18:03.678373 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.791213 (+112840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.791274 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:03.791316 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.791601 (+   285us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.791818 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53896,"prepare.queue_time_us":422768,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":1803,"raft.queue_time_us":77744,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":15563,"spinlock_wait_cycles":113585536,"thread_start_us":392393,"threads_started":3}
I20260709 13:18:03.806494  8293 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:03.791421 13096 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.795339 13286 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:03.816147  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.816653  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.814616  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.795941 13287 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.801213 13197 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:03.821677  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.816766  8367 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 13.
I20260709 13:18:03.804462 13280 raft_consensus.cc:493] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:18:03.808320 13127 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:03.789001 13177 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:03.827776  8332 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:03.821065 13287 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.817929 13286 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:03.878340  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:03.827723 13127 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:03.900965  8892 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.850386 13286 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:03.819730 13096 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:03.882385 13294 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:18:03.939631  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:18:03.895798 13289 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.145s	user 0.002s	sys 0.008s
W20260709 13:18:03.938721 13292 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:18:03.946943 13285 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:18:03.947335 13250 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:03.948891 13295 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:18:03.949602 13291 log.cc:927] Time spent T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:18:03.959038  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.961814  8183 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:03.966538  8366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.967876  8365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.835877 13280 raft_consensus.cc:515] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:03.937698 12877 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.973480  8925 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 16.
I20260709 13:18:03.979943  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:18:03.986853  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 85993.4us
I20260709 13:18:03.978823  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:03.996074  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.998234  8183 leader_election.cc:304] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:03.998907 13190 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:03.975528 13132 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:03.999739  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:03.975951 13268 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.000000 13188 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:03.994279 13194 log.cc:927] Time spent T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:04.002460  8183 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.007723 12550 raft_consensus.cc:2749] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:04.037901 13268 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.038698 12550 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:04.003011  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:03.999390 13177 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:03.982460 13197 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.009784  8295 raft_consensus.cc:2468] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:04.001943 12877 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.015367 12922 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:04.021278 13252 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:03.981106 13250 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:04.033604  8186 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:03.994246 13263 raft_consensus.cc:2749] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:04.040113 13268 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:18:04.067024  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 64179.3us
I20260709 13:18:04.068152  8892 leader_election.cc:304] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.039881 13146 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:04.046133  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.059522  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:18:04.073423  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.079205  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.036907 13188 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:04.071367 13235 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.071942 13250 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.083678  8332 leader_election.cc:304] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:04.098023  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.074504 13199 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.077693 13242 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:04.090938 13188 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.088330 13229 raft_consensus.cc:2749] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:04.109468  8286 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:04.119823  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.122781  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.096460 13235 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:04.101801 13287 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.106386 12922 raft_consensus.cc:2804] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:04.131072  8293 raft_consensus.cc:1240] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:04.137019  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.137669  8293 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:18:04.115594 13203 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.094944 13116 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:18:04.134342 13235 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.150530 12099 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:04.111357 13199 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.158061 13199 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:04.155872  8217 raft_consensus.cc:1240] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:04.151062 12099 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.162420  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:04.165248  8928 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:04.144199 12922 raft_consensus.cc:697] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:04.145180 13203 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.175361  8292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
W20260709 13:18:04.164502 13283 consensus_meta.cc:287] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 13:18:04.176764  8292 raft_consensus.cc:606] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
W20260709 13:18:04.191218  8260 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.206125  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:18:04.206853  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 138828us
I20260709 13:18:04.207747  8892 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.208189  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.209153  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:04.217118  8928 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:18:04.217657  8928 pending_rounds.cc:85] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 9
I20260709 13:18:04.217980  8928 pending_rounds.cc:107] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:18:04.218626  8928 raft_consensus.cc:2889] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:04.228502  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d3403855d4147a9b056dc8678880fdf" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:04.231808  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:18:04.232582 13299 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:18:04.204710 13245 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:04.205415 13283 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.233613 13245 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.234058  8287 raft_consensus.cc:1240] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:04.235045 13283 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.235637 13245 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.227823 13303 raft_consensus.cc:493] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:04.236418 13303 raft_consensus.cc:515] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.238385 13303 leader_election.cc:290] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.239697  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:04.241598  8332 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:04.242458  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53535408ea514f8db7292852927e7743" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.243379  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
W20260709 13:18:04.240298 13296 log.cc:927] Time spent T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:04.253113  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:04.253835 13245 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:04.246023 12859 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:04.228096 13237 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:04.254412 13245 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.230191 13089 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.230367 13187 consensus_queue.cc:1059] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:18:04.230082 13229 raft_consensus.cc:2749] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:04.270372 13237 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.292846 13237 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.266383  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:04.252678 12922 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.298607 13286 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.299779  8922 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:18:04.255811 13228 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:04.301515 13228 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:04.302657 13228 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:04.304399  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.273393 13127 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.273859 13245 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.270933 13089 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:04.281911 13293 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.391s	user 0.004s	sys 0.004s
I20260709 13:18:04.283277  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.284370  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.306800  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:04.318621  8293 raft_consensus.cc:606] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.319054  8293 raft_consensus.cc:614] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:04.250595 13303 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:04.319939 13303 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.322177  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:04.312021  8332 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:04.323746 13132 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:04.325227  8332 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:04.326066 13267 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:04.314764  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 71452us
I20260709 13:18:04.318027 13089 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.331881 13303 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:04.328896 13169 consensus_meta.cc:287] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.005s
I20260709 13:18:04.332876 13250 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.337656 13169 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.339377 13250 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:04.340704  8927 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.341506  8920 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:18:04.342051 13287 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:04.344961  8289 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:04.339766 13169 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.315055 13188 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.350879 13127 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:04.352370 13286 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.353195 13203 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:04.354830 13306 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:04.351888 13188 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.357478  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a15d60ee93c04debb4b2f6a595555fbb"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:04.358090  8293 raft_consensus.cc:606] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.358438  8293 raft_consensus.cc:614] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:04.355937  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:04.366983  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:04.367810  8363 raft_consensus.cc:2393] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 13: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:04.376883  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:04.377678  8293 raft_consensus.cc:606] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:04.378094  8293 raft_consensus.cc:614] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:04.385525 13179 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56040 (request call id 747) took 2939 ms. Trace:
I20260709 13:18:04.385901  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:04.390748  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:04.391192  8369 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:04.391569  8293 raft_consensus.cc:606] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.392076  8293 raft_consensus.cc:614] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:04.395512  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:04.399245  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:04.399951  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.401789 12518 consensus_queue.cc:1059] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:04.411800  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:04.417845  8294 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:04.419756 13278 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:04.423139  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:04.426599 13183 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.385967 13179 rpcz_store.cc:276] 0709 13:18:01.491826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.500180 (+  8354us) service_pool.cc:224] Handling call
0709 13:18:01.833928 (+333748us) ts_tablet_manager.cc:934] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
0709 13:18:03.520881 (+1686953us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:03.784496 (+263615us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:03.788893 (+  4397us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:04.327710 (+538817us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:04.349208 (+ 21498us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:04.385381 (+ 36173us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:04.385447 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":33658,"tablet-copy.queue_time_us":255205,"thread_start_us":252196,"threads_started":2}
I20260709 13:18:04.430375 13179 tablet_copy_client.cc:806] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:04.430981 13179 tablet_copy_client.cc:670] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:04.436764 12379 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.437053 13235 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.438333  8213 raft_consensus.cc:1240] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:04.439476 13235 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.440649  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:04.456720  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0d0091520f4d6ea7668120e21a6aa0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.473794  8294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81beec7fc64c498918eb3ea356d2c7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.456998  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.454401 12099 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.475736  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.476265  8288 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:18:04.458141  8290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:04.466759  8928 raft_consensus.cc:1240] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:04.458804  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:18:04.472961  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 64091.4us
I20260709 13:18:04.472543  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:04.457852  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:04.456122  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:04.481197  8292 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.478077  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:04.482564  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:04.459709  8258 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:04.484182  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:04.484364  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:04.485102  8363 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 10: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:04.454556 13281 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:04.487951 13281 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.454180 13089 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.489508 13251 raft_consensus.cc:3055] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:04.489965 13251 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:04.490257  8367 raft_consensus.cc:2368] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14.
I20260709 13:18:04.494549  8292 raft_consensus.cc:2468] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:04.495556  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:04.495853  8216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.497641  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.497807  8889 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:04.444025 13280 leader_election.cc:290] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:04.490126 13281 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.457231 13096 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:04.461124 12877 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:04.510403  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.504726 13250 raft_consensus.cc:2804] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:04.514730  8295 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:18:04.515739  8889 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:04.498965 13262 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:04.519254  8892 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.523568  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.525467  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:04.527099  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
W20260709 13:18:04.528210  8258 consensus_peers.cc:597] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7dca780f49cb4f62912f333b3185e48f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.528921  8892 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:04.531164 12099 consensus_queue.cc:1059] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:04.534680  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:04.527136 13287 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:04.535504 13312 log.cc:927] Time spent T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:04.532749 13096 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.517006 13250 raft_consensus.cc:697] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:04.540274 13263 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:04.541355 13250 consensus_queue.cc:237] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.522912 13286 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:04.545639 13286 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:04.551226  8291 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:04.552618  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:04.546702 13286 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.556392 13287 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:04.520279 13151 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:04.556914 13287 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:04.557807 13287 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.560693 13232 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.561218 13232 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.563196 13232 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.556851 12099 raft_consensus.cc:3055] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:04.564293 13089 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:04.564517 12099 raft_consensus.cc:740] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:04.512331 13251 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.565239 12099 consensus_queue.cc:260] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.565721 13251 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.566365 12099 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:04.568105 12933 consensus_queue.cc:1175] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:18:04.533794 13111 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:04.569564 13111 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.569973 13111 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:04.570107 13187 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:04.570571 13187 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:04.571393 13187 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.572769 13187 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.585965  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.587121  8295 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:18:04.588718 13262 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:04.590891  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:04.594159 13151 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.594784 13151 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:04.603386  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 68748.6us
W20260709 13:18:04.614526  8258 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.628733  8892 leader_election.cc:400] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14.
I20260709 13:18:04.631477  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:04.632506  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:04.633971 13179 tablet_copy_client.cc:538] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:04.643241  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:04.649987 13179 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:04.600871 13262 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:04.611500 13233 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:04.663522 13111 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.667683 13111 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:18:04.676839  8185 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.676707  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:04.673290 13233 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.679009  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:04.704226  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:04.707717  8220 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:04.694612 13233 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:04.720208  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:04.720849  8213 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:18:04.732100  8218 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 10.
I20260709 13:18:04.706844 13107 raft_consensus.cc:2749] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:04.736375 13111 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:04.747494  8368 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:04.755743  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:04.764113  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:04.751585 13151 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.759783 13203 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:04.766620 13252 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:04.770905 13203 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.879819  8287 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46288 (request call id 1927) took 1206 ms. Trace:
I20260709 13:18:04.880508  8287 rpcz_store.cc:276] 0709 13:18:03.673713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.674797 (+  1084us) service_pool.cc:224] Handling call
0709 13:18:03.675084 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:04.234467 (+559383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.879513 (+645046us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540005c8d4. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd411e01 00007f31fd41083e 00007f32023d5419 00007f31fb94cbd4 00007f31fb94cb62 00007f31fb94ca91 00007f31fb94ca0c 00007f31fb94bcc2 00007f31fb74c48c 00007f31fb74b8c6
0709 13:18:04.879747 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285031296}
I20260709 13:18:04.868388 13203 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.885808  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:04.886620  8286 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 11: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:18:04.900307 13132 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:04.901139 13132 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:04.869151 13252 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:04.903875 13132 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:04.887394 13322 log.cc:927] Time spent T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:18:04.931457  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:04.937860  8261 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:04.919615 13151 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:04.946936 13208 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.951581  8290 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:04.954382 13252 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:04.961288  8287 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:04.977723  8261 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:04.981109  8261 leader_election.cc:304] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:04.984774 13271 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:04.998220  8261 leader_election.cc:304] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.000269  8261 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.001470  8261 leader_election.cc:304] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.002280 13121 raft_consensus.cc:2749] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.007709  8261 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.009791 13151 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:04.994264 13271 raft_consensus.cc:2749] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.013007  8261 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.007925 12839 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.008611 13208 raft_consensus.cc:2749] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.018934 13281 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:05.034621 13127 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:05.035321 13127 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.040411 13127 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:05.042354  8923 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:05.042826  8925 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:18:05.043258  8925 pending_rounds.cc:85] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 10
I20260709 13:18:05.043529  8925 pending_rounds.cc:107] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:18:05.043785  8925 raft_consensus.cc:2889] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:05.050966 13203 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.053865 13203 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:05.062099 13208 raft_consensus.cc:993] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:05.062526 13127 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:05.062857 13208 raft_consensus.cc:1081] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:05.063323 13127 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:18:05.064909 13327 log.cc:927] Time spent T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:18:05.068703  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:18:05.070713  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 73151.9us
I20260709 13:18:05.072173  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:05.073918 13223 consensus_queue.cc:1059] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:05.074206 13127 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:05.075887 12379 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:05.076499  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.087554  8216 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:05.095745 13278 consensus_queue.cc:1059] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:05.098764  8332 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.083676 13116 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:05.075526 13246 consensus_queue.cc:1059] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:18:05.123205  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.100766 13233 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:18:05.125291 13271 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:05.132083 12809 raft_consensus.cc:3055] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:05.132542 12809 raft_consensus.cc:740] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:05.132725 13111 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:05.133140 13111 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:05.133365 12809 consensus_queue.cc:260] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.133924 13111 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.134588 12809 raft_consensus.cc:3060] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.135056 13111 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:05.137240  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 124264us
I20260709 13:18:05.138298  8261 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.116233 13329 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:05.146721  8261 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.148283  8261 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.115890 12947 consensus_queue.cc:1059] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:18:05.159090  8289 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:05.159739  8289 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.178270  8289 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:05.180836  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:05.182204  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:05.183856  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:05.179325 13127 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:05.169672 13121 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:05.185343 13127 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.185775  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b32c39d3034dc0b1e48b0daa2308c0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:05.185631 13121 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.186834  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:05.187408 13127 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:05.187891  8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:05.188340 13121 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:05.188809  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:05.189059  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.189476  8288 raft_consensus.cc:2368] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14.
I20260709 13:18:05.190342  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.190421  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.191083 13329 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:05.191609 13329 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.192287  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.193749 13329 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:05.163300 13271 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:05.151304 13280 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.193801  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:05.196259  8368 raft_consensus.cc:2393] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 11: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:05.195623  8295 raft_consensus.cc:1240] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:05.151764 13187 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:05.220166 13328 log.cc:927] Time spent T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:05.188833  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:05.158732 13281 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:05.191762  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.191372  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.195267 13271 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.200024  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:18:05.211122 13332 log.cc:927] Time spent T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:18:05.179186 12947 consensus_queue.cc:1243] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer 8ff54842a32a414d8cbb4a3f32527f4a log is divergent from this leader: its last log entry 14.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:05.213603 13252 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:05.216749  8362 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:05.217212  8367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55878
I20260709 13:18:05.258893  8367 raft_consensus.cc:493] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:05.259577  8367 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.218760  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.224190  8261 leader_election.cc:304] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.261612  8261 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.169904 13151 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:05.242282  8288 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.253821  8218 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:18:05.264402  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:05.158380 12697 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:18:05.275800  8261 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:18:05.310250  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 45970.8us
I20260709 13:18:05.315136  8288 raft_consensus.cc:1240] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:05.320070 12839 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:05.308983 13281 raft_consensus.cc:2749] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.314139 13280 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.320191 13246 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:05.315217 13151 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.320206 13252 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.335506 13246 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:05.424365 13246 raft_consensus.cc:3060] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.396211 13287 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.428409 13287 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.431138 13287 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:05.333551 13121 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 13:18:05.404305 13331 log.cc:927] Time spent T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:18:05.445600 13151 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:05.454193 13252 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:05.454579 13254 raft_consensus.cc:3055] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:05.400900 13187 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:05.455159 13254 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:05.455698 13187 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.456907 13271 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:05.457834 13187 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:05.417960  8367 raft_consensus.cc:515] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.456270 13254 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.526156 13254 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.532347  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.532831  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.533731  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.544646 13271 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:05.545215 13271 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.545496 13151 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:05.547243 13271 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:05.548606  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:05.548735  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:05.549400  8294 raft_consensus.cc:1240] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:05.551644  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:05.552413  8928 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 14: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:05.553987  8258 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.557083  8367 leader_election.cc:290] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:05.558027  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.572412  8215 raft_consensus.cc:3055] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:05.572948  8215 raft_consensus.cc:740] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:05.559314 13342 raft_consensus.cc:2749] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:05.578105  8332 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:05.581175 13329 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:05.580955 13246 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.581776 13329 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:05.582721 13329 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.583585 13246 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:18:05.584288  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.588310  8363 raft_consensus.cc:2410] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:18:05.589190  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:05.590242 13259 consensus_queue.cc:1059] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:05.591163 13286 raft_consensus.cc:3055] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:05.591552 13286 raft_consensus.cc:740] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:05.592453 13286 consensus_queue.cc:260] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.593894 13286 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:05.594112  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.596882 13342 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.556629  8216 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:05.573662  8215 consensus_queue.cc:260] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.605119  8215 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.607172  8258 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.611192 13121 raft_consensus.cc:2749] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.620817 13132 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.621459 13132 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:05.622212 13333 log.cc:927] Time spent T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.226s	user 0.006s	sys 0.004s
W20260709 13:18:05.625998  8183 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.623884 13132 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:05.483902  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:05.644302  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.647468  8368 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:05.649559  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:05.653352  8261 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:18:05.655098  8184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.656152  8364 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:05.657605  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.657855  8215 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:18:05.658381  8215 pending_rounds.cc:85] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Aborting all ops after (but not including) 6
I20260709 13:18:05.658694  8215 pending_rounds.cc:107] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:18:05.659004  8215 raft_consensus.cc:2889] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:05.664111  8367 raft_consensus.cc:1240] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer d03eaa3ce81042f9b114cd00a7f41b17 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:05.664837  8183 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:05.669412  8295 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:05.710137  8292 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:05.661448 12839 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.711994  8216 raft_consensus.cc:1275] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:05.663909  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:05.713155  8368 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
W20260709 13:18:05.715389 12933 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:18:05.716317  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 45083us
W20260709 13:18:05.718111  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 53397.5us
I20260709 13:18:05.718310 12099 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:05.719995  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 77158.9us
I20260709 13:18:05.720242 12099 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:05.721284  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:05.721649  8183 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:05.710307  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.733830  8215 raft_consensus.cc:2468] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:18:05.759493  8215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.784507 12099 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
W20260709 13:18:05.784900  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 63343.4us
I20260709 13:18:05.785194 12099 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.787252  8923 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:05.787482  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 77250.2us
I20260709 13:18:05.791260  8220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e36ea2a6e04a442397de5d29398d0314" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.792759  8183 leader_election.cc:400] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14.
I20260709 13:18:05.793201  8183 leader_election.cc:403] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:05.792883 12099 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:05.794152  8183 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:05.794432 12099 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.796527  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:05.798331  8258 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:05.804399  8183 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:05.807516 12379 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.821622  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.824939  8219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:05.826377  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:05.843786  8183 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:05.797371 12735 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:05.800503 13337 raft_consensus.cc:2749] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.865517  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:05.807181 13146 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.877084 12099 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14.
I20260709 13:18:05.882148  8183 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:05.883805  8183 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:05.792832 13250 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:18:05.864260 12697 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:05.864564 13246 raft_consensus.cc:2804] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:05.862777 13184 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:05.828064 13259 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:18:05.904999  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:05.923429  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:05.896147 12735 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:05.894714 13280 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.921734 13246 raft_consensus.cc:697] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:05.962391  8923 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:05.899843 12697 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:05.898690 12839 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:18:05.975433  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:18:05.968194  8334 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.967937 12099 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.956379 13151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33912 (request call id 15) took 2246 ms. Trace:
I20260709 13:18:05.966773  8217 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
W20260709 13:18:05.984274  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 263733us
W20260709 13:18:05.986124  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 176376us
I20260709 13:18:05.986789  8261 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:05.989223  8218 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:05.996762  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:05.999931  8925 raft_consensus.cc:2393] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 14: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
W20260709 13:18:06.005056  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 116583us
I20260709 13:18:06.007612  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924d44c50904ed09f8f93dd9b4928ca" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:06.008262  8213 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.997357 13343 ts_tablet_manager.cc:933] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:05.988152 13280 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:05.979310 13250 consensus_queue.cc:1059] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:18:06.019176  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:18:06.025411  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 55635.9us
I20260709 13:18:06.028769  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:18:06.023743 13336 log.cc:927] Time spent T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:18:06.034902  8213 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:06.038281 13351 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:06.041227 13351 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:18:06.041759 13254 consensus_meta.cc:287] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260709 13:18:06.055568 12697 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:06.031210 13246 consensus_queue.cc:237] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.058055  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:06.063833 13351 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.079618  8360 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:06.087051  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.082441 13353 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.096988  8287 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:18:06.095955  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.098392  8287 pending_rounds.cc:85] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 10
I20260709 13:18:06.098677  8287 pending_rounds.cc:107] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:18:06.098907  8287 raft_consensus.cc:2889] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:06.099068  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da27e18b189452598381f95fe6f22cf" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:06.103991 13343 tablet_copy_client.cc:323] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:18:06.104303 12988 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.100966 13337 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:18:06.088536 13267 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:18:06.129711  8363 raft_consensus.cc:1240] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:06.102973 13353 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:05.985419 13151 rpcz_store.cc:276] 0709 13:18:03.702678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.709339 (+  6661us) service_pool.cc:224] Handling call
0709 13:18:04.344094 (+634755us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b58007d3cd0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd36d0aa 00007f31fd3ef447 00007f31fd40c70a 00007f31fd40d76a 00007f31fd40c91b 00007f31fd41803c 00007f31fd4176b3 00007f32023d7d29 00007f31fb9561d4 00007f31fb956162
0709 13:18:04.394394 (+ 50300us) log.cc:844] Serialized 492 byte log entry
0709 13:18:05.058876 (+664482us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b54003c6020. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd391b26 00007f31fd38b49a 00007f31fd38a714 00007f31fd36aeaa 00007f31fd371d53 00007f31fd371cd9 00007f31fd371c69 00007f31fd371c31 00007f31fd370dfd 000000000038f354
0709 13:18:05.947250 (+888374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21048,"raft.queue_time_us":28362,"raft.run_cpu_time_us":19240,"raft.run_wall_time_us":599359,"spinlock_wait_cycles":88414720,"thread_start_us":67302,"threads_started":1,"wal-append.queue_time_us":123731,"wal-append.run_cpu_time_us":1960,"wal-append.run_wall_time_us":1026869}
I20260709 13:18:06.127063 13360 consensus_queue.cc:1048] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:18:06.137893 13271 consensus_queue.cc:1059] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 13:18:06.195835  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 99955.3us
I20260709 13:18:06.197197  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:18:06.196538  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 72505.4us
W20260709 13:18:06.196508 13286 consensus_meta.cc:287] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.003s
I20260709 13:18:06.203647  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.200461  8183 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:06.199666 13335 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:06.199343  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 7dca780f49cb4f62912f333b3185e48f from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:18:06.215909 13337 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:06.216257  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:06.221359  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 7dca780f49cb4f62912f333b3185e48f from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-7dca780f49cb4f62912f333b3185e48f
I20260709 13:18:06.228609 13096 raft_consensus.cc:3055] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:06.229048 13096 raft_consensus.cc:740] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:06.229534 13353 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:06.229940 13096 consensus_queue.cc:260] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.235829  8332 leader_election.cc:304] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:06.214628 13363 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.234277 13366 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:06.241647 12988 raft_consensus.cc:2804] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:06.245770 12988 raft_consensus.cc:697] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:06.246933 12988 consensus_queue.cc:237] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:06.227700 13351 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.233726 13096 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.258162  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.240563 13337 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.272521 13335 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.277779 13233 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:06.278458 13233 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.266747 12922 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.281527 13233 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:06.285714  8295 raft_consensus.cc:3055] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:06.286108  8295 raft_consensus.cc:740] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:06.286860  8295 consensus_queue.cc:260] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:06.291363  8295 raft_consensus.cc:3060] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.291533  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:06.301242  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:06.302064  8218 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:18:06.307654 13351 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:06.308593  8925 raft_consensus.cc:1240] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:06.308874  8305 tablet_copy_source_session.cc:215] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:06.311671  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:06.313014  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:06.313285  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:06.310817  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:06.314147  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:06.316358 13351 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:06.316778 13351 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.317106 13351 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.315852 13184 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:18:06.337723 13179 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:06.344993  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:06.345800  8286 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:18:06.349573  8295 raft_consensus.cc:2468] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
W20260709 13:18:06.350133 13345 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:18:06.350324  8289 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:18:06.363041  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 160105us
W20260709 13:18:06.363804  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 64819.1us
I20260709 13:18:06.366890 13179 tablet_bootstrap.cc:492] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
W20260709 13:18:06.367928  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 54701.8us
I20260709 13:18:06.385459  8183 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:06.368433 13306 consensus_queue.cc:1059] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:06.376330  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:06.378005 13343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dca780f49cb4f62912f333b3185e48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:06.378341 13208 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.380996  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:06.396952 12099 raft_consensus.cc:2749] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.397702  8889 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.406764 13356 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.403615 13208 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.426352  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
W20260709 13:18:06.418591  8166 auto_rebalancer.cc:629] Failed to schedule move for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7: Illegal state: Replica 9e95b04d03d241329435b6d08dd1f236 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.444259 13179 ts_tablet_manager.cc:1403] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 1.787s	user 0.074s	sys 0.053s
I20260709 13:18:06.465523  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:06.467885  8258 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:06.467311 13208 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:06.490584 13179 raft_consensus.cc:359] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:06.491569 13179 raft_consensus.cc:740] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:06.504051 12809 raft_consensus.cc:3055] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:06.504496 12809 raft_consensus.cc:740] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:06.505334 12809 consensus_queue.cc:260] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.506727 12809 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.511283 13351 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.516337  8923 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:06.498757 13179 consensus_queue.cc:260] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:06.535562 13121 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.549420  8118 catalog_manager.cc:5697] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 10 to 12, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 12 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:06.556442  8115 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46484 (request call id 261) took 20520 ms (client timeout 15000 ms). Trace:
I20260709 13:18:06.551816  8118 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 12 to 13, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 13 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.574108  8118 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 14, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 14 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.576344  8118 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 9, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 9 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.581614  8118 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.572643 13351 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:06.571605 13179 ts_tablet_manager.cc:1434] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.123s	user 0.004s	sys 0.004s
W20260709 13:18:06.578001  8115 rpcz_store.cc:269] 0709 13:17:46.036104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.036367 (+   263us) service_pool.cc:224] Handling call
0709 13:18:06.556364 (+20519997us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:01.235533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:01.237756 (+  2223us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:01.237818 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:18:01.237836 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:01.243723 (+  5887us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:01.243842 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:01.243883 (+    41us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:18:01.346306 (+102423us) tablet.cc:701] Row locks acquired
0709 13:18:01.346366 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:18:01.346761 (+   395us) write_op.cc:270] Start()
0709 13:18:01.346945 (+   184us) write_op.cc:276] Timestamp: P: 1783603081346515 usec, L: 0
0709 13:18:01.346998 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 13:18:01.347759 (+   761us) log.cc:844] Serialized 8147 byte log entry
0709 13:18:01.553005 (+205246us) op_driver.cc:464] REPLICATION: finished
0709 13:18:01.734113 (+181108us) write_op.cc:301] APPLY: starting
0709 13:18:01.734241 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:02.086494 (+352253us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:02.086699 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:02.866353 (+779654us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:02.866786 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:18:02.866864 (+    78us) write_op.cc:312] APPLY: finished
0709 13:18:02.867393 (+   529us) log.cc:844] Serialized 188 byte log entry
0709 13:18:03.114179 (+246786us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.114420 (+   241us) write_op.cc:454] Released schema lock
0709 13:18:03.114528 (+   108us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:03.120394 (+  5866us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:03.123113 (+  2719us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1300208,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":180738,"apply.run_cpu_time_us":47722,"apply.run_wall_time_us":1380866,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91949,"num_ops":21,"prepare.queue_time_us":182589,"prepare.run_cpu_time_us":8297,"prepare.run_wall_time_us":144276,"raft.queue_time_us":154865,"raft.run_cpu_time_us":60722,"raft.run_wall_time_us":113624,"replication_time_us":205769,"thread_start_us":577597,"threads_started":5,"wal-append.queue_time_us":277448,"wal-append.run_cpu_time_us":36788,"wal-append.run_wall_time_us":2176362}]]}
W20260709 13:18:06.604530  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 151415us
I20260709 13:18:06.608855 13351 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:06.609619 13351 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.593333  8118 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 14, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 14 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.633143  8118 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 11, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:06.634712  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 172842us
I20260709 13:18:06.635731  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.645058  8218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:06.646579 13386 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.648145 13386 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:06.648567 13386 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.652202 13132 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:06.662170  8214 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:06.672029  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:06.673527  8118 catalog_manager.cc:5697] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.679838  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-4c96431d125f4d169be8f25647f9371e received from {username='slave'} at 127.0.0.1:59420
I20260709 13:18:06.675315 12922 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.709853 12922 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:06.710013  8118 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.685240 13267 consensus_queue.cc:1059] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:06.712201  8118 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 2 to 7, term changed from 8 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.663772 13121 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:18:06.694895 13353 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.714442 13353 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.715183 12922 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:06.698668 13343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54804 (request call id 897) took 1160 ms. Trace:
I20260709 13:18:06.712244  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-4c96431d125f4d169be8f25647f9371e on tablet 4c96431d125f4d169be8f25647f9371e with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:06.718488  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:06.720463 13353 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:06.717494 13343 rpcz_store.cc:276] 0709 13:18:05.537833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.537964 (+   131us) service_pool.cc:224] Handling call
0709 13:18:06.017152 (+479188us) ts_tablet_manager.cc:934] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
0709 13:18:06.376833 (+359681us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:06.564703 (+187870us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:06.564902 (+   199us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:06.697893 (+132991us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:06.698172 (+   279us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:06.698520 (+   348us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:06.698582 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":7633,"tablet-copy.queue_time_us":432880,"thread_start_us":386174,"threads_started":2}
I20260709 13:18:06.721165 13343 tablet_copy_client.cc:806] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:06.721760 13343 tablet_copy_client.cc:670] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:06.708346 13351 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:06.725426  8213 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:06.727815  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:06.731509  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:06.735699  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:06.736347  8293 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:18:06.714481  8118 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.742208  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:06.720844 13386 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:06.731769 13343 tablet_copy_client.cc:538] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:06.746243 13386 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:06.761234 12697 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:06.761680  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.764988  8118 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 12, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.768316  8889 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.769433  8118 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 9, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 9 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.771662  8118 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 11, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 11 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.774266  8892 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.776630  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:06.779296  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:06.779378 13259 raft_consensus.cc:2749] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:06.790246  8118 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 12, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 12 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.792035  8118 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.774778 13351 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:06.804239  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c802b19bdf2e4f69b169d31056091820" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:06.772625 12922 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:06.805881  8118 catalog_manager.cc:5697] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:06.811887  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.820360 13121 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.821096 13121 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:06.824823  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:06.824971 13353 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.825124 13121 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:06.828233  8214 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:18:06.829769  8258 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:06.831619 13343 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:06.831848 13208 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:06.832235 13208 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.832557 13208 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:06.837898  8923 raft_consensus.cc:1275] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:06.840901 13121 consensus_queue.cc:1048] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:06.844326  8360 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Rejecting Update request from peer 9e95b04d03d241329435b6d08dd1f236 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:06.846957 13306 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:06.809197 12922 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.853403 12697 raft_consensus.cc:3055] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:06.853962 12697 raft_consensus.cc:740] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:06.854915  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:06.856123 12697 consensus_queue.cc:260] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:06.857288 12697 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.854182 12922 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:06.853403 12735 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:06.864724 12735 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:06.866360  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:06.867627 13386 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:06.869030 12735 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:06.870713 12735 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.879768  8928 raft_consensus.cc:1240] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:06.951956  8290 raft_consensus.cc:1275] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:06.964808 13132 consensus_queue.cc:1048] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:18:06.988524 13391 log.cc:927] Time spent T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:07.050204 12809 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:07.067680 12922 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:07.052174 13208 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:07.073385 12809 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:07.103963 12809 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:07.105057  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:07.116842  8363 raft_consensus.cc:2368] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 15. Current term is 16.
I20260709 13:18:07.117770 12922 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:07.143756 12922 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:07.144325 12922 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:07.146368 12922 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:07.156096  8186 leader_election.cc:400] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 15. Current term is 16.
I20260709 13:18:07.156484  8186 leader_election.cc:403] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.157963  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:07.158704  8295 raft_consensus.cc:2393] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 15: Already voted for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in this term.
I20260709 13:18:07.160640  8923 raft_consensus.cc:1217] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEARNER]: Deduplicated request from leader. Original: 10.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:18:07.163245  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:07.163798  8291 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.163904  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:07.165026  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:07.165699  8295 raft_consensus.cc:2368] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15.
I20260709 13:18:07.163034  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:07.178558 13208 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:07.180112  8217 raft_consensus.cc:2393] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 14: Already voted for candidate 9e95b04d03d241329435b6d08dd1f236 in this term.
I20260709 13:18:07.180896  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:07.181595  8363 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.176285 13213 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.198547  8332 leader_election.cc:400] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15.
I20260709 13:18:07.198921  8332 leader_election.cc:403] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:07.200522  8291 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
I20260709 13:18:07.206348  8332 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:07.210665 13252 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:07.211230 13252 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:07.212090 13252 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:07.223917  8363 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:07.226390  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55586274911e4f2eb326f0741d200c17" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:07.227015  8214 raft_consensus.cc:3060] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.229606  8261 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:07.238004 13208 raft_consensus.cc:2804] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:07.238536 13208 raft_consensus.cc:697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:07.228245 13107 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391) with higher term. Message: Invalid argument: T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15.
I20260709 13:18:07.239398 13208 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:07.265053  8214 raft_consensus.cc:2468] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:07.279158 13259 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.288136 13259 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.290512 13259 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:07.292584  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:07.293256  8360 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:18:07.297155  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:07.304322 13353 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:07.299661 13213 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697) with higher term. Message: Invalid argument: T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 for earlier term 15. Current term is 16.
I20260709 13:18:07.324919 13353 raft_consensus.cc:493] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.328871 13353 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.354204  8211 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
W20260709 13:18:07.356199  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 75910.4us
I20260709 13:18:07.376801  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:07.377414  8291 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:18:07.377756 13353 raft_consensus.cc:515] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.414391  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:07.414510  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a3ff85da594e17a687e7c116983565" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:07.415033  8363 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.415105  8291 raft_consensus.cc:3060] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:07.423493  8363 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:18:07.423100  8291 raft_consensus.cc:2468] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:18:07.424871  8892 leader_election.cc:304] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:07.425526 13353 leader_election.cc:290] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:07.425735 13351 raft_consensus.cc:2804] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:07.439188 13351 raft_consensus.cc:697] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:07.442219 13351 consensus_queue.cc:237] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.463150 13127 raft_consensus.cc:1064] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:07.465857 13127 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.622978  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:07.645999  8921 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:07.646185  8211 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:07.647925  8291 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:07.656315 13203 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:07.661526 13410 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:07.694120 13343 log.cc:927] Time spent T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.135s	user 0.003s	sys 0.000s
W20260709 13:18:07.708873  8118 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 192) took 11919 ms (client timeout 15000 ms). Trace:
I20260709 13:18:07.709671  8117 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 9 to 10, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 10 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.713304  8117 catalog_manager.cc:5697] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:07.709313  8118 rpcz_store.cc:269] 0709 13:17:55.789513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.789724 (+   211us) service_pool.cc:224] Handling call
0709 13:17:56.279607 (+489883us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37b090 00007f31fd419f3a 00007f32031d01cc 00007f32032ce37e 00007f320178f2a4 00007f320178f232 00007f320178f161 00007f320178f0dc 00007f320178e392 00007f31fb74c48c 00007f31fb74b8c6
0709 13:18:07.708798 (+11429191us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:07.178646 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:07.179183 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:07.179218 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:07.179235 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:07.201955 (+ 22720us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:07.205846 (+  3891us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:07.206872 (+  1026us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:18:07.238317 (+ 31445us) tablet.cc:701] Row locks acquired
0709 13:18:07.238338 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:07.238479 (+   141us) write_op.cc:270] Start()
0709 13:18:07.238603 (+   124us) write_op.cc:276] Timestamp: P: 1783603087238435 usec, L: 0
0709 13:18:07.238628 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:07.239288 (+   660us) log.cc:844] Serialized 6620 byte log entry
0709 13:18:07.409130 (+169842us) op_driver.cc:464] REPLICATION: finished
0709 13:18:07.427041 (+ 17911us) write_op.cc:301] APPLY: starting
0709 13:18:07.427137 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:07.449151 (+ 22014us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:07.449629 (+   478us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:07.469663 (+ 20034us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:07.469952 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:18:07.470000 (+    48us) write_op.cc:312] APPLY: finished
0709 13:18:07.470358 (+   358us) log.cc:844] Serialized 156 byte log entry
0709 13:18:07.470554 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.470759 (+   205us) write_op.cc:454] Released schema lock
0709 13:18:07.470820 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:07.608317 (+137497us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.608348 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":819296,"reported_tablets":29,"spinlock_wait_cycles":61334400,"child_traces":[["op",{"apply.queue_time_us":17634,"apply.run_cpu_time_us":29907,"apply.run_wall_time_us":181232,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":195487,"prepare.run_cpu_time_us":34873,"prepare.run_wall_time_us":102320,"raft.queue_time_us":68521,"raft.run_cpu_time_us":983,"raft.run_wall_time_us":29323,"replication_time_us":170344,"thread_start_us":203164,"threads_started":4,"wal-append.queue_time_us":33893}]]}
I20260709 13:18:07.716777  8117 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.698848 13233 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.718694 13233 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.720862 13233 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:07.723285  8117 catalog_manager.cc:5697] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 7 to 10, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 10 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:07.731001  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:07.698643 13203 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:18:07.752532 13329 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.753378 13329 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.756867 13329 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:07.735190 13397 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:18:07.777213 13397 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:07.782687  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 75618.1us
I20260709 13:18:07.785554  8360 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:07.786077  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:07.786820  8363 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 14: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:07.788467 13208 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:07.790966 13343 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:07.793395  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:07.794212  8293 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:07.794579  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:07.794066  8921 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 15.
I20260709 13:18:07.796669  8292 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:18:07.796221  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:07.799330 13278 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:07.799853 13278 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.801928 13278 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:07.802814  8923 raft_consensus.cc:2410] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:18:07.805073 13414 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:07.809878  8211 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:07.811861  8212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:07.812597  8212 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:18:07.814718  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:07.815774  8923 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 15: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:07.817101  8183 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:07.817346  8332 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:07.828892 13226 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:07.834822 13226 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.835301 13226 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.837826 13343 tablet_bootstrap.cc:492] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:18:07.838967 13410 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:07.843565 13343 ts_tablet_manager.cc:1403] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 1.012s	user 0.047s	sys 0.006s
I20260709 13:18:07.847653 13343 raft_consensus.cc:359] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:07.871240 13397 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:07.871382 13343 raft_consensus.cc:740] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:07.876332 13343 consensus_queue.cc:260] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:07.892198 13343 ts_tablet_manager.cc:1434] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.005s
I20260709 13:18:07.909691 13226 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.915553  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:07.916175  8921 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.922106  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:07.923053  8363 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.927628 13353 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.928138 13353 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.933077  8213 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:07.936779 13121 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:07.946080 13353 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:07.967940  8363 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 16.
I20260709 13:18:07.969427  8186 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:07.970352 13413 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:07.970907 13413 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 16 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:07.971910 13413 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:07.927059  8921 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 16.
I20260709 13:18:07.912530 13226 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:07.979789  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:07.979636 13386 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:07.980933  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 150564us
I20260709 13:18:07.984539 13414 raft_consensus.cc:2764] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:07.995204 13410 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 7 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.008527  8214 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 7 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:08.028162  8117 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46474 (request call id 262) took 24057 ms (client timeout 15000 ms). Trace:
I20260709 13:18:08.045522  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:08.046258  8921 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:18:08.048527  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-7dca780f49cb4f62912f333b3185e48f received from {username='slave'} at 127.0.0.1:33926
I20260709 13:18:08.048669  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:08.049170  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-7dca780f49cb4f62912f333b3185e48f on tablet 7dca780f49cb4f62912f333b3185e48f with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:08.049404  8286 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:08.052641  8363 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:08.056437  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:08.057190  8364 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:18:08.063045  8921 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 7 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.080554  8114 catalog_manager.cc:5697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 12 to 13, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 13 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
W20260709 13:18:08.028642  8117 rpcz_store.cc:269] 0709 13:17:43.965982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.966120 (+   138us) service_pool.cc:224] Handling call
0709 13:18:08.022854 (+24056734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:07.745549 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:07.746213 (+   664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:07.746265 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:18:07.746285 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:07.746988 (+   703us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:07.747053 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:07.747087 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:18:07.747497 (+   410us) tablet.cc:701] Row locks acquired
0709 13:18:07.747512 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:18:07.747657 (+   145us) write_op.cc:270] Start()
0709 13:18:07.747779 (+   122us) write_op.cc:276] Timestamp: P: 1783603087747608 usec, L: 0
0709 13:18:07.747797 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:18:07.784805 (+ 37008us) log.cc:844] Serialized 1677 byte log entry
0709 13:18:07.787695 (+  2890us) op_driver.cc:464] REPLICATION: finished
0709 13:18:07.788060 (+   365us) write_op.cc:301] APPLY: starting
0709 13:18:07.788165 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:07.790318 (+  2153us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:07.790405 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:07.826008 (+ 35603us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:07.826196 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:18:07.826249 (+    53us) write_op.cc:312] APPLY: finished
0709 13:18:07.826488 (+   239us) log.cc:844] Serialized 49 byte log entry
0709 13:18:07.826682 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.826785 (+   103us) write_op.cc:454] Released schema lock
0709 13:18:07.826834 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:07.856879 (+ 30045us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd40ce28 00007f3200e47581 00007f3200e46d58 00007f3200e4b9f1 00007f3200e4b9a9 00007f3200e4b939 00007f3200e4b901 00007f3200e4ab2d 000000000038f354 000000000038f199
0709 13:18:07.857075 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.857104 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":544586,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":109,"apply.run_cpu_time_us":6396,"apply.run_wall_time_us":39119,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16728,"num_ops":4,"prepare.queue_time_us":7381,"prepare.run_cpu_time_us":9474,"prepare.run_wall_time_us":111544,"replication_time_us":39737,"spinlock_wait_cycles":31145344}]]}
I20260709 13:18:08.096289  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:08.096518  8928 raft_consensus.cc:1217] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 13:18:08.097137  8217 raft_consensus.cc:606] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:08.097564  8286 raft_consensus.cc:1275] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:08.083652  8114 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 10 to 11, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:08.104861  8286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:08.105509  8286 raft_consensus.cc:606] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:08.108310  8286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7feffaf779354992809fb6a460399626"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:08.109128  8286 raft_consensus.cc:606] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:08.109488  8286 raft_consensus.cc:614] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:08.110149  8114 catalog_manager.cc:5697] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.112100  8286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:08.112689  8286 raft_consensus.cc:606] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:08.112015  8114 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 10 to 11, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 11 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.113008  8286 raft_consensus.cc:614] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:08.114491  8114 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 8 to 12, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.115872  8286 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eacbb7965099474082590e4b50221087"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:08.143312  8286 raft_consensus.cc:606] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:08.116323  8258 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:08.119083  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:08.125372 13403 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:08.147044 13353 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:08.147097 13417 consensus_queue.cc:1048] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:08.147586 13353 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.147969 13353 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.148815 13398 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.149309 13398 raft_consensus.cc:493] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:18:08.149782 13398 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.159226  8295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:08.159865  8295 raft_consensus.cc:606] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:08.160250  8295 raft_consensus.cc:614] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:08.161340  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:08.165153  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:08.169865 13398 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.177760 13353 raft_consensus.cc:515] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.184149  8295 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 7 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.185597 13413 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:08.148059  8114 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 11 to 12, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:08.191668  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:08.198609  8360 raft_consensus.cc:2393] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 14: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:08.200301 13413 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.208593  8114 catalog_manager.cc:5697] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 11 to 12, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.210520  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:08.211182  8360 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:18:08.212389  8186 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:08.212488 13398 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:08.215150 13233 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:08.215806 13233 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:08.216197 13233 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:08.211668  8114 catalog_manager.cc:5697] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 7 to 8, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 8 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:08.224198  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:08.228477  8114 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 11 to 13, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.230626  8114 catalog_manager.cc:5697] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 10 to 12, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:08.232657  8114 catalog_manager.cc:5697] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 10 to 11, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 11 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.234303  8114 catalog_manager.cc:5697] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 6 to 9, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 9 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.236119  8114 catalog_manager.cc:5697] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:08.238457  8921 raft_consensus.cc:2368] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 14. Current term is 15.
I20260709 13:18:08.244436  8258 leader_election.cc:400] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 14. Current term is 15.
I20260709 13:18:08.244860  8258 leader_election.cc:403] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.240430 13413 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:08.245007  8114 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:08.246022 13121 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.269860  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:08.270053 13398 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:08.270684 13398 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:08.273051 13398 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:08.274080  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:08.274900  8360 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 14: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:08.279166 13121 raft_consensus.cc:2749] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491) with higher term. Message: Invalid argument: T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 14. Current term is 15.
I20260709 13:18:08.270709  8921 raft_consensus.cc:2393] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:08.281266  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:08.282001  8213 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:18:08.283227  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:08.286676 13398 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.287132 13398 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:08.287540 13398 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.299607  8114 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 10 to 11, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 11 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.336010 13353 leader_election.cc:290] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:08.340108  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:08.356689  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afeb2f98236845469440c44ada463b5c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:08.357473  8364 raft_consensus.cc:3060] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.377429  8363 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:08.384213 13413 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:08.398043  8293 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 15.
I20260709 13:18:08.398811  8364 raft_consensus.cc:2468] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 15.
I20260709 13:18:08.399535  8889 leader_election.cc:304] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:18:08.401295  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 90812.5us
I20260709 13:18:08.404948 13403 raft_consensus.cc:2804] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:08.424726 13403 raft_consensus.cc:697] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:08.425736 13403 consensus_queue.cc:237] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.415208 13233 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.439191 13233 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:08.443531  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:08.451632 13342 raft_consensus.cc:993] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:08.452306 13208 raft_consensus.cc:1081] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:08.459465  8368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55878
I20260709 13:18:08.460132  8368 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.460578  8368 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.466020 13398 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:08.483490 13342 raft_consensus.cc:993] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:08.484144 13121 raft_consensus.cc:1081] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:08.488382  8364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eacbb7965099474082590e4b50221087"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55878
I20260709 13:18:08.471881  8367 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 11.
I20260709 13:18:08.491649  8364 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.493248  8364 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:08.493582  8186 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:08.497088  8368 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.500730  8368 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:08.500573  8364 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:08.505611  8364 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:08.505776  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:08.506721  8293 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:08.507181  8293 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:08.508285  8293 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.510133  8293 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:08.513188  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 94412.2us
I20260709 13:18:08.514801  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:08.515533  8923 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.516551  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:08.504244 13413 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:08.525590 13413 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:08.526788 13342 raft_consensus.cc:1064] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:08.526681 13413 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.530472 13342 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.521324 13432 raft_consensus.cc:993] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:08.513860 13431 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.545615  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:08.545892 13233 raft_consensus.cc:1081] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:08.546452  8364 raft_consensus.cc:2393] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in current term 14: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:08.546124 13431 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.541417  8213 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:18:08.550316  8293 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:18:08.537755 13398 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:08.518674  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:08.550189  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:08.551743  8923 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:18:08.553100 13431 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:08.559011 13398 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:08.579887 13398 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:08.581035 13398 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:08.559240  8217 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:08.561127  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:08.587854  8928 raft_consensus.cc:2393] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e95b04d03d241329435b6d08dd1f236 in current term 11: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:08.563424  8921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:18:08.589391  8921 raft_consensus.cc:493] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:08.553059  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:08.565130  8922 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:08.590327  8286 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:08.590768  8286 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:08.589903  8921 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:08.591589  8286 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:08.597460  8286 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:08.598304  8217 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:18:08.589331  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:08.563233  8332 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
W20260709 13:18:08.609104  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 45951us
I20260709 13:18:08.609256 12922 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:08.609911 12922 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:08.610944 12922 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.614130  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:08.615051  8363 raft_consensus.cc:2410] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:18:08.617007  8921 raft_consensus.cc:515] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.619724  8363 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:08.621663  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:08.622241  8214 raft_consensus.cc:3055] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:08.625715 13342 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:08.622514  8214 raft_consensus.cc:740] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:08.628749  8214 consensus_queue.cc:260] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.629952  8214 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:08.695143  8921 leader_election.cc:290] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:08.713291  8286 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
W20260709 13:18:08.716454  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 85781.5us
I20260709 13:18:08.718050  8922 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:08.718693 13410 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.719219 13410 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:08.720611  8217 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:08.721349 13410 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:08.724877  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:08.725682 13252 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:08.726229 13252 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:08.727140 13252 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:08.733036 13438 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:08.736255  8214 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:18:08.748306 13398 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:08.750566 13398 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:08.787053  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236" is_pre_election: true
I20260709 13:18:08.787716  8217 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:08.789325  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:08.794152  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:08.794956 13121 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.794958 13351 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:08.800207  8889 leader_election.cc:304] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:08.801270 13351 raft_consensus.cc:2804] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:08.801873 13351 raft_consensus.cc:697] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:08.802856 13351 consensus_queue.cc:237] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:08.815006  8922 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.818111  8214 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.835412  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d693bc5288d40ae98bb93862716c589" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:08.836199  8363 raft_consensus.cc:3060] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:08.845904  8363 raft_consensus.cc:2468] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:18:08.853052  8286 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:08.858652 13403 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:08.888062  8364 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.898057  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:08.898929 13252 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:08.900375 13252 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.901006 13252 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:08.917219 13252 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:08.933130  8118 catalog_manager.cc:5697] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.936269  8364 raft_consensus.cc:1275] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:08.936035  8118 catalog_manager.cc:5697] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 10, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 10 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.938189  8118 catalog_manager.cc:5697] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 11, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 11 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.940222  8118 catalog_manager.cc:5697] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 13 to 14, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 14 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:08.954239  8114 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46486 (request call id 270) took 17810 ms (client timeout 15000 ms). Trace:
I20260709 13:18:08.946902  8118 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.958689  8118 catalog_manager.cc:5697] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 12, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.976089  8118 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:08.954936  8114 rpcz_store.cc:269] 0709 13:17:51.150711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.155457 (+  4746us) service_pool.cc:224] Handling call
0709 13:18:08.954149 (+17798692us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:08.408977 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:08.413353 (+  4376us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:08.416596 (+  3243us) write_op.cc:435] Acquired schema lock
0709 13:18:08.417587 (+   991us) tablet.cc:662] Decoding operations
0709 13:18:08.461641 (+ 44054us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:08.461754 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:08.461794 (+    40us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:18:08.463341 (+  1547us) tablet.cc:701] Row locks acquired
0709 13:18:08.463367 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:18:08.463571 (+   204us) write_op.cc:270] Start()
0709 13:18:08.463724 (+   153us) write_op.cc:276] Timestamp: P: 1783603088463508 usec, L: 0
0709 13:18:08.463755 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:18:08.532599 (+ 68844us) log.cc:844] Serialized 5870 byte log entry
0709 13:18:08.611135 (+ 78536us) op_driver.cc:464] REPLICATION: finished
0709 13:18:08.765390 (+154255us) write_op.cc:301] APPLY: starting
0709 13:18:08.775742 (+ 10352us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:08.868230 (+ 92488us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:08.868340 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:08.876744 (+  8404us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:08.877060 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:18:08.877111 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:08.877475 (+   364us) log.cc:844] Serialized 139 byte log entry
0709 13:18:08.878302 (+   827us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:08.884603 (+  6301us) write_op.cc:454] Released schema lock
0709 13:18:08.884663 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:08.896177 (+ 11514us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:08.896212 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23623,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":154036,"apply.run_cpu_time_us":18572,"apply.run_wall_time_us":130692,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66857,"num_ops":15,"prepare.queue_time_us":44564,"prepare.run_cpu_time_us":6503,"prepare.run_wall_time_us":123988,"replication_time_us":147227,"thread_start_us":202422,"threads_started":2}]]}
I20260709 13:18:08.977334  8118 catalog_manager.cc:5697] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 12, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 12 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.978669 13252 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:08.979240  8118 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 14 to 16, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 16 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.995079  8364 raft_consensus.cc:1240] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Rejecting Update request from peer 4cf23888b4fe42b594b9443ae6ee9cd2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:08.981124  8118 catalog_manager.cc:5697] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 12, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 12 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:08.997316  8118 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:08.998404 13208 consensus_queue.cc:1059] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:08.999229 13398 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:08.999632 13398 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:09.000695  8118 catalog_manager.cc:5697] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 14, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 14 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.002447  8118 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 10 to 14, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 14 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.004676  8118 catalog_manager.cc:5697] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 11, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 11 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.006289  8118 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 12 to 13, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.007930  8118 catalog_manager.cc:5697] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 11, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 11 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.009254  8118 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 14, leader changed from d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 14 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.009865 13398 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:09.010612  8118 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 12 to 14, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.011363 13398 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.011946  8118 catalog_manager.cc:5697] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 13, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.013312  8118 catalog_manager.cc:5697] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index -1 to 7, term changed from 9 to 12, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3), NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added, now has a pending config: VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1), VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2), VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3), VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.015297  8118 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.016602  8118 catalog_manager.cc:5697] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 8 to 13, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 13 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.018023  8118 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 12 to 14, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.019281  8118 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 13 to 16, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 16 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:09.020650  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 65055.2us
I20260709 13:18:09.028775  8214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:09.029458  8214 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.032456  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:09.033443 13431 consensus_queue.cc:1048] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:09.043110  8364 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:09.044761 13413 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:09.055938  8293 raft_consensus.cc:2410] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:09.064919  8214 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:18:09.071010  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:09.073022 13278 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:09.073884 13278 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:09.075286 13278 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:09.157402  8922 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:09.160398 13433 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:09.164763  8928 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:09.166448 13432 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:18:09.171943  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:09.184880  8295 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:09.197395  8214 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:09.206097 12922 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:09.210935 12922 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:09.244828  8368 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:09.300400  8293 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:09.301824 13268 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:09.269210 13431 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:18:09.484191  8292 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:18:09.485177  8292 pending_rounds.cc:85] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting all ops after (but not including) 8
I20260709 13:18:09.485472  8292 pending_rounds.cc:107] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:18:09.485913  8292 raft_consensus.cc:2889] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.490248  8213 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:09.494858 13268 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:09.500530  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 48358.9us
W20260709 13:18:09.495456  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 243720us
I20260709 13:18:09.546680 12922 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:09.584707  8113 catalog_manager.cc:5697] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 13 to 14, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.593010  8213 raft_consensus.cc:1275] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:09.587704  8113 catalog_manager.cc:5697] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 12 to 14, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 14 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.605528  8113 catalog_manager.cc:5697] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 13 to 16, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 16 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.608656  8113 catalog_manager.cc:5697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.610793  8113 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 12 to 14, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.616613  8113 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 12 to 13, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 13 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.635814  8113 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 11 to 14, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.670821  8113 catalog_manager.cc:5697] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 12 to 13, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2), now has a pending config: VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1), VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2), VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3), NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:09.673761  8113 catalog_manager.cc:5697] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.684226 13417 consensus_queue.cc:1048] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:18:09.701277  8113 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 11 to 12, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 12 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.705019  8113 catalog_manager.cc:5697] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 13, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.739758  8113 catalog_manager.cc:5697] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 13, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.773397  8113 catalog_manager.cc:5697] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 12 to 15, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 15 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.775954  8113 catalog_manager.cc:5697] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 10 to 14, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.767370  8118 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32980 (request call id 193) took 1898 ms. Trace:
I20260709 13:18:09.786680  8113 catalog_manager.cc:5697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 11, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 11 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.785075  8118 rpcz_store.cc:276] 0709 13:18:07.868934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.872156 (+  3222us) service_pool.cc:224] Handling call
0709 13:18:07.886470 (+ 14314us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37b090 00007f31fd419f3a 00007f32031d01cc 00007f32032ce37e 00007f320178f2a4 00007f320178f232 00007f320178f161 00007f320178f0dc 00007f320178e392 00007f31fb74c48c 00007f31fb74b8c6
0709 13:18:09.767163 (+1880693us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:09.099216 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:09.104228 (+  5012us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:09.104263 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:09.104280 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:09.110532 (+  6252us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:09.110644 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:09.110686 (+    42us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:18:09.115083 (+  4397us) tablet.cc:701] Row locks acquired
0709 13:18:09.115102 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:09.115312 (+   210us) write_op.cc:270] Start()
0709 13:18:09.115430 (+   118us) write_op.cc:276] Timestamp: P: 1783603089115260 usec, L: 0
0709 13:18:09.115455 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:09.170209 (+ 54754us) log.cc:844] Serialized 9628 byte log entry
0709 13:18:09.176291 (+  6082us) op_driver.cc:464] REPLICATION: finished
0709 13:18:09.176916 (+   625us) write_op.cc:301] APPLY: starting
0709 13:18:09.176993 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:09.215647 (+ 38654us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:09.215735 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:09.285752 (+ 70017us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b54003ed854. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f31fd37a571 00007f31fd40ce28 00007f3200e47581 00007f3200e46d58 00007f3200e4b9f1 00007f3200e4b9a9 00007f3200e4b939 00007f3200e4b901 00007f3200e4ab2d 000000000038f354 000000000038f199
0709 13:18:09.361219 (+ 75467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:09.361540 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:18:09.361585 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:09.362060 (+   475us) log.cc:844] Serialized 212 byte log entry
0709 13:18:09.362227 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.362392 (+   165us) write_op.cc:454] Released schema lock
0709 13:18:09.362463 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:09.427479 (+ 65016us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.427577 (+    98us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":585,"mutex_wait_us":99885,"reported_tablets":28,"spinlock_wait_cycles":8302976,"child_traces":[["op",{"apply.queue_time_us":418,"apply.run_cpu_time_us":31274,"apply.run_wall_time_us":250315,"cfile_cache_hit":96,"cfile_cache_hit_bytes":100368,"num_ops":24,"prepare.queue_time_us":44605,"prepare.run_cpu_time_us":21111,"prepare.run_wall_time_us":186705,"replication_time_us":60718,"spinlock_wait_cycles":40427776,"thread_start_us":44281,"threads_started":1}]]}
I20260709 13:18:09.820329  8113 catalog_manager.cc:5697] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 11 to 13, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.840672  8113 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 13 to 15, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 15 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.842612  8113 catalog_manager.cc:5697] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 12, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:09.856959  8113 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 11 to 12, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:09.854691  8922 consensus_queue.cc:237] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:09.889910  8212 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:09.890944  8364 raft_consensus.cc:1275] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:09.891435 13417 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:09.895324 13417 consensus_queue.cc:1048] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:09.931440 13417 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 6 to 10, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.937618  8212 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 6 to 10, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:09.976372  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48e600fe8a934349bb2d4d18d10815a6 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:09.978746  8364 raft_consensus.cc:2955] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 6 to 10, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.165592  8118 catalog_manager.cc:5697] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index -1 to 9, VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added, no longer has a pending config: VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1), VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2), VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3), NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.167539  8118 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 14 to 15, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 15 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.169925  8118 catalog_manager.cc:5697] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 12 to 15, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 15 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.188545  8118 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.190112  8118 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.191556  8118 catalog_manager.cc:5697] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 7 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1), VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2), VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3), VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.193738  8118 catalog_manager.cc:5697] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 10 to 11, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 11 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.317406  8113 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46484 (request call id 262) took 5400 ms. Trace:
I20260709 13:18:10.317865  8113 rpcz_store.cc:276] 0709 13:18:04.917535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.917833 (+   298us) service_pool.cc:224] Handling call
0709 13:18:10.317317 (+5399484us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:09.970741 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:09.971906 (+  1165us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:09.971953 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:18:09.971970 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:09.977837 (+  5867us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:09.977952 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:09.977982 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:18:09.995575 (+ 17593us) tablet.cc:701] Row locks acquired
0709 13:18:09.995622 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:18:09.995815 (+   193us) write_op.cc:270] Start()
0709 13:18:09.995982 (+   167us) write_op.cc:276] Timestamp: P: 1783603089995755 usec, L: 0
0709 13:18:09.996017 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:18:09.996880 (+   863us) log.cc:844] Serialized 7651 byte log entry
0709 13:18:10.083043 (+ 86163us) op_driver.cc:464] REPLICATION: finished
0709 13:18:10.110430 (+ 27387us) write_op.cc:301] APPLY: starting
0709 13:18:10.110538 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:10.131388 (+ 20850us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:10.131523 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:10.148303 (+ 16780us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:10.152592 (+  4289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:18:10.152669 (+    77us) write_op.cc:312] APPLY: finished
0709 13:18:10.153175 (+   506us) log.cc:844] Serialized 172 byte log entry
0709 13:18:10.153349 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.153529 (+   180us) write_op.cc:454] Released schema lock
0709 13:18:10.153602 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:10.154048 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.154082 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":227085,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":27120,"apply.run_cpu_time_us":24179,"apply.run_wall_time_us":43578,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83585,"num_ops":19,"prepare.queue_time_us":75081,"prepare.run_cpu_time_us":6190,"prepare.run_wall_time_us":36951,"replication_time_us":86830,"thread_start_us":80374,"threads_started":2}]]}
I20260709 13:18:10.358899  8115 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 10 to 14, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.363610  8115 catalog_manager.cc:5697] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 10 to 14, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.367202  8115 catalog_manager.cc:5697] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 13 to 14, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.388782  8118 catalog_manager.cc:5697] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 6 to 10, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 14 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.455116  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 48e600fe8a934349bb2d4d18d10815a6 with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36518
I20260709 13:18:10.535780 13487 tablet_replica.cc:333] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:10.541045 13487 raft_consensus.cc:2243] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:10.541764 13487 raft_consensus.cc:2272] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:10.545298 13487 ts_tablet_manager.cc:1916] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:10.562108  8115 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46486 (request call id 271) took 3603 ms. Trace:
I20260709 13:18:10.562536  8115 rpcz_store.cc:276] 0709 13:18:06.958409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.958551 (+   142us) service_pool.cc:224] Handling call
0709 13:18:10.562018 (+3603467us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:10.373470 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:10.373963 (+   493us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:10.373985 (+    22us) write_op.cc:435] Acquired schema lock
0709 13:18:10.373999 (+    14us) tablet.cc:662] Decoding operations
0709 13:18:10.374465 (+   466us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:10.374523 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:10.374543 (+    20us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:18:10.374816 (+   273us) tablet.cc:701] Row locks acquired
0709 13:18:10.374837 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:10.374966 (+   129us) write_op.cc:270] Start()
0709 13:18:10.375056 (+    90us) write_op.cc:276] Timestamp: P: 1783603090374919 usec, L: 0
0709 13:18:10.375070 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:18:10.375525 (+   455us) log.cc:844] Serialized 1299 byte log entry
0709 13:18:10.377241 (+  1716us) op_driver.cc:464] REPLICATION: finished
0709 13:18:10.377562 (+   321us) write_op.cc:301] APPLY: starting
0709 13:18:10.377639 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:10.379380 (+  1741us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:10.379473 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:10.381244 (+  1771us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:10.381438 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:18:10.381492 (+    54us) write_op.cc:312] APPLY: finished
0709 13:18:10.381695 (+   203us) log.cc:844] Serialized 41 byte log entry
0709 13:18:10.381855 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.381955 (+   100us) write_op.cc:454] Released schema lock
0709 13:18:10.381996 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:10.382393 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:10.382424 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22305,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":102,"apply.run_cpu_time_us":4777,"apply.run_wall_time_us":4777,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":2393,"prepare.run_wall_time_us":2392,"replication_time_us":2074}]]}
I20260709 13:18:10.566860 13487 ts_tablet_manager.cc:1929] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 13:18:10.567444 13487 log.cc:1199] T 48e600fe8a934349bb2d4d18d10815a6 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/48e600fe8a934349bb2d4d18d10815a6
I20260709 13:18:10.592814  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 48e600fe8a934349bb2d4d18d10815a6 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:10.664808  8368 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:10.680887  8118 catalog_manager.cc:5697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.692065  8118 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 13 to 15, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 15 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:10.697273  8922 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:10.698640  8213 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:10.699695  8118 catalog_manager.cc:5697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 11 to 12, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:10.701284  8118 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 13 to 16, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 16 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } }
I20260709 13:18:10.703061  8116 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46474 (request call id 263) took 8614 ms. Trace:
I20260709 13:18:10.703202 13455 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:10.704241  8116 rpcz_store.cc:276] 0709 13:18:02.088611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.088800 (+   189us) service_pool.cc:224] Handling call
0709 13:18:10.702858 (+8614058us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21990,"reported_tablets":48}
I20260709 13:18:10.705725 12922 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:10.717157  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 49652.9us
I20260709 13:18:10.737876  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:10.783737 12922 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.797040  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 48e600fe8a934349bb2d4d18d10815a6 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:36518
I20260709 13:18:10.798935  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 48e600fe8a934349bb2d4d18d10815a6 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
W20260709 13:18:10.852737 13491 log.cc:927] Time spent T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.053s	user 0.011s	sys 0.000s
I20260709 13:18:10.857700  8292 consensus_queue.cc:237] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:10.868007  8922 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.890211  8928 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:10.891781 13342 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:10.905344  8118 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 7 to 11, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:10.920919  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:10.964318 13494 log.cc:927] Time spent T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:18:10.973788 13495 log.cc:927] Time spent T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:18:11.000814  8217 raft_consensus.cc:2955] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:11.003381  8364 consensus_queue.cc:237] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:11.029479  8363 raft_consensus.cc:1275] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:11.057951 13501 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:11.066110  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36518
I20260709 13:18:11.067981 13487 tablet_replica.cc:333] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:11.069326 13487 raft_consensus.cc:2243] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.070749 13487 raft_consensus.cc:2272] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.077373 13487 ts_tablet_manager.cc:1916] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:11.084868  8922 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:11.140486 13208 consensus_queue.cc:1048] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:11.147176  8363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:11.147907  8363 raft_consensus.cc:606] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:11.158761  8923 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:11.169232  8211 raft_consensus.cc:1275] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:11.176257  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:11.176882  8364 raft_consensus.cc:606] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:11.181922  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:11.182512  8364 raft_consensus.cc:606] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:11.190397  8363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8942278c55614601a1290e32997fe007"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:11.191080  8363 raft_consensus.cc:606] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:11.194258 13497 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:11.198987  8217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:11.199631  8217 raft_consensus.cc:606] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:11.200268  8116 catalog_manager.cc:5697] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 9 to 10, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:11.203740  8363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:11.204768  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7dca780f49cb4f62912f333b3185e48f with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:11.204463  8363 raft_consensus.cc:606] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:11.207782  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:11.210291  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:11.234364 13469 raft_consensus.cc:993] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:11.235062 13502 raft_consensus.cc:1081] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:11.237010  8922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:18:11.237689  8922 raft_consensus.cc:493] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:11.238075  8922 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.245527  8922 raft_consensus.cc:515] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:11.264559  8922 leader_election.cc:290] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:18:11.268188 12922 consensus_queue.cc:1048] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:11.356110  8286 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:11.356901  8286 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.269850  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf02b6ca7a34be9bbac5771e91f767a" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:11.358088  8217 raft_consensus.cc:3055] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:11.358397  8217 raft_consensus.cc:740] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:11.369553  8217 consensus_queue.cc:260] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:11.382052 13487 ts_tablet_manager.cc:1929] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:18:11.382594 13487 log.cc:1199] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/2ebc3be5b6ff4d2b90d60c9a508dafc7
I20260709 13:18:11.384389  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 2ebc3be5b6ff4d2b90d60c9a508dafc7 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
W20260709 13:18:11.391178  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 124382us
I20260709 13:18:11.396175  8217 raft_consensus.cc:3060] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:11.414287  8217 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:11.449712  8286 raft_consensus.cc:2468] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:11.454952  8364 raft_consensus.cc:2955] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:11.459594  8889 leader_election.cc:304] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:11.460544 13417 raft_consensus.cc:2804] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:11.461082 13417 raft_consensus.cc:697] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:11.462092 13417 consensus_queue.cc:237] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:11.582602  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 7dca780f49cb4f62912f333b3185e48f with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49976
W20260709 13:18:11.592660  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 156934us
I20260709 13:18:11.667918 12922 raft_consensus.cc:993] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.685985 12922 raft_consensus.cc:1081] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.691572 13516 tablet_replica.cc:333] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:11.681288  8115 catalog_manager.cc:5697] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 12 to 13, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 13 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:11.693358 13516 raft_consensus.cc:2243] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.695508 13516 raft_consensus.cc:2272] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.694736 13410 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:11.698585 13516 ts_tablet_manager.cc:1916] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:11.763397  8293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8942278c55614601a1290e32997fe007"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:11.764093  8293 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:11.764462  8293 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.772373  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c96431d125f4d169be8f25647f9371e with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:11.779067  8115 catalog_manager.cc:5697] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 9 to 10, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 12 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:11.788421 12922 raft_consensus.cc:993] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.789000 12922 raft_consensus.cc:1081] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.774056  8293 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:11.794438  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:11.795025  8364 raft_consensus.cc:3055] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:11.795347  8364 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:11.788869  8922 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:11.796738  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c96431d125f4d169be8f25647f9371e with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:36518
I20260709 13:18:11.797722  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8942278c55614601a1290e32997fe007" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:11.798302  8217 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.798617 13487 tablet_replica.cc:333] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:11.799671 13487 raft_consensus.cc:2243] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.800671 13487 raft_consensus.cc:2272] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.804817  8364 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:11.805787  8364 raft_consensus.cc:3060] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.812325  8213 raft_consensus.cc:2955] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:11.817265 13487 ts_tablet_manager.cc:1916] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:11.822643 13516 ts_tablet_manager.cc:1929] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 13:18:11.823470  8217 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:11.823819 13516 log.cc:1199] T 7dca780f49cb4f62912f333b3185e48f P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/7dca780f49cb4f62912f333b3185e48f
I20260709 13:18:11.829707  8293 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:11.836673  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 7dca780f49cb4f62912f333b3185e48f (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:11.836722  8258 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:11.838696 13342 raft_consensus.cc:2804] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:11.839269 13342 raft_consensus.cc:697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:11.840901 13342 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:11.831174  8364 raft_consensus.cc:2468] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:11.855261 13455 raft_consensus.cc:993] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.855795 13455 raft_consensus.cc:1081] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.861181 12922 raft_consensus.cc:993] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.861831 13510 raft_consensus.cc:1081] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.875658 13487 ts_tablet_manager.cc:1929] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:18:11.876305 13487 log.cc:1199] T 4c96431d125f4d169be8f25647f9371e P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/4c96431d125f4d169be8f25647f9371e
I20260709 13:18:11.878044  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet 4c96431d125f4d169be8f25647f9371e (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:11.882691  8213 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:11.884358 13474 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:11.893488  8115 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 14 to 15, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:11.909528 13497 raft_consensus.cc:993] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.910439 13497 raft_consensus.cc:1081] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:11.916585  8286 raft_consensus.cc:1275] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:11.918933 13417 consensus_queue.cc:1048] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:11.920258  8293 raft_consensus.cc:1240] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:11.924014  8290 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:11.924587  8290 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:11.925060  8290 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.926316  8295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:11.926946  8295 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:11.927299  8295 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.927886  8289 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:11.928448  8289 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:11.928772  8289 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.935832  8290 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:11.942442  8289 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:11.949556  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:11.950141  8213 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.951184  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:11.951748  8364 raft_consensus.cc:3055] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:11.952072  8364 raft_consensus.cc:740] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:11.952934  8364 consensus_queue.cc:260] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:11.953814  8364 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.953193  8290 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:11.966252  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:11.966818  8368 raft_consensus.cc:3055] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:11.967089  8368 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:11.967818  8368 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:11.968357  8289 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 17 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:11.968937  8368 raft_consensus.cc:3060] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.974423  8293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:11.974979  8293 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:11.975306  8293 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.982928  8364 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:11.975728  8368 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 17.
I20260709 13:18:11.984134  8261 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:11.985831 13505 raft_consensus.cc:2804] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:11.986339 13505 raft_consensus.cc:697] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:11.987233  8213 raft_consensus.cc:2468] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 17.
I20260709 13:18:11.988262 13505 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:11.997828  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:11.998445  8922 raft_consensus.cc:3060] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.004015  8261 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:12.004858 13342 raft_consensus.cc:2804] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:12.044273  8922 raft_consensus.cc:2468] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:12.053289  8295 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:12.071895  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:12.072870  8213 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.074887  8295 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:12.081396  8293 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:12.084754  8213 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:12.086930  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d81288332c1b4610a2fe2b09dba77503" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:12.089133  8364 raft_consensus.cc:3055] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:12.094902  8364 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:12.101919  8364 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:12.103150  8364 raft_consensus.cc:3060] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.106364  8295 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:12.106668  8211 raft_consensus.cc:1240] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:12.145429  8364 raft_consensus.cc:2468] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:12.151361  8293 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 17 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:12.152820  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:12.153560  8364 raft_consensus.cc:3055] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:12.153764  8364 raft_consensus.cc:740] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:12.152733  8261 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:12.156570  8364 consensus_queue.cc:260] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:12.157655  8364 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:12.162889  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "749a008ddc4d4f31a1bcd1a446b5916d" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:12.163482  8213 raft_consensus.cc:3060] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:12.150980 13342 raft_consensus.cc:697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:12.172698  8213 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 17.
I20260709 13:18:12.174342  8292 raft_consensus.cc:1240] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Rejecting Update request from peer 8ff54842a32a414d8cbb4a3f32527f4a for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:12.175447  8364 raft_consensus.cc:2468] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 17.
I20260709 13:18:12.176842  8261 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:12.184733 13526 raft_consensus.cc:2804] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:12.185261 13526 raft_consensus.cc:697] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:12.192109  8118 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 16 to 17, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 17 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.173972 13505 raft_consensus.cc:2804] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:12.201551 13505 raft_consensus.cc:697] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:12.202423 13505 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:12.205869 13342 consensus_queue.cc:237] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:12.186100 13526 consensus_queue.cc:237] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:12.250110  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:12.312376  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 57024.1us
I20260709 13:18:12.363387  8118 catalog_manager.cc:5697] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 14 to 15, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.365447  8118 catalog_manager.cc:5697] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 16 to 17, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 17 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.366982  8118 catalog_manager.cc:5697] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 14 to 15, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:12.388296  8364 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:12.390440 13342 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:12.419003  8211 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:12.420449 13526 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:12.435124  8213 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:12.436645 13526 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:12.469323  8368 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:12.471185 13529 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:12.630653  8363 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:12.633001 13530 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:12.671340  8213 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:12.673429 13526 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:18:12.710983  8213 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:12.713737 13530 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:12.739583  8923 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:12.735422  8363 raft_consensus.cc:1275] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:12.741668 13505 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:12.742601 13526 consensus_queue.cc:1048] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:12.780185  8364 raft_consensus.cc:1275] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:12.781987 13505 consensus_queue.cc:1048] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:12.915558  8293 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:12.923305  8364 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:12.925621 13505 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:12.929697  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d81288332c1b4610a2fe2b09dba77503. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:12.931505  8211 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:12.933413 13342 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:12.947132 13526 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:12.955156  8213 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:12.968868  8363 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.007161  8118 catalog_manager.cc:5697] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 10, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.040908  8293 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
W20260709 13:18:13.059804  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55586274911e4f2eb326f0741d200c17. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:13.064276  8363 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:13.069024 13529 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:13.071483  8213 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:13.073060 13529 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:13.135607 13529 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.144058  8363 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.149261  8213 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.161135  8115 catalog_manager.cc:5697] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.163082  8364 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:13.241361  8292 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:18:13.243713 13497 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:13.246665  8332 consensus_peers.cc:597] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee0be2dae2824fd89d658f949f717dfc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:13.269843  8211 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:18:13.274025 13455 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:13.307227 13555 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Committing config change with OpId 13.6: config changed from index -1 to 6, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.326071  8211 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Committing config change with OpId 13.6: config changed from index -1 to 6, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.383834  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:13.429304  8295 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:13.463018  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:13.463709  8364 raft_consensus.cc:606] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:13.472641  8115 catalog_manager.cc:5697] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 6, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.477470 13560 ts_tablet_manager.cc:933] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:13.479465  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:13.480155  8364 raft_consensus.cc:606] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:13.496821  8292 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Committing config change with OpId 13.6: config changed from index -1 to 6, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.529980  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:13.530691  8364 raft_consensus.cc:606] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:13.529136 13560 tablet_copy_client.cc:323] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:18:13.536002  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet d81288332c1b4610a2fe2b09dba77503 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:18:13.536659  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet d81288332c1b4610a2fe2b09dba77503 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-d81288332c1b4610a2fe2b09dba77503
I20260709 13:18:13.541613  8364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "509edc927d524436b819a0e96e615799"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:13.542265  8364 raft_consensus.cc:606] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:18:13.542536  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 102223us
I20260709 13:18:13.545524  8305 tablet_copy_source_session.cc:215] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:13.549742 13560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81288332c1b4610a2fe2b09dba77503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:13.565466  8364 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:18:13.566260  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8942278c55614601a1290e32997fe007. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:13.566985 13526 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:13.568536  8213 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:13.569778 13529 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:13.573406  8211 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:13.573956  8211 raft_consensus.cc:606] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:13.585675 13529 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.591502  8363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:13.592133  8363 raft_consensus.cc:606] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:13.594794  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:13.598676 13496 raft_consensus.cc:993] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:13.599434 13496 raft_consensus.cc:1081] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:13.604228  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:13.599058  8213 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.609258  8360 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.615710 13517 raft_consensus.cc:993] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:13.616235 13517 raft_consensus.cc:1081] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:13.618402  8295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46272
I20260709 13:18:13.618906  8295 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.619225  8295 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:13.613476  8922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "509edc927d524436b819a0e96e615799"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:56040
I20260709 13:18:13.620011 13560 tablet_copy_client.cc:806] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:13.620362  8922 raft_consensus.cc:493] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.620632 13560 tablet_copy_client.cc:670] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:13.620779  8922 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.626261 13560 tablet_copy_client.cc:538] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:13.627012  8922 raft_consensus.cc:515] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:13.629554  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:13.630101  8292 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.637044  8292 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 17.
I20260709 13:18:13.638352  8889 leader_election.cc:304] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:13.638803  8115 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:13.639953 13563 raft_consensus.cc:2804] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:13.640501 13563 raft_consensus.cc:697] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:13.641302 13563 consensus_queue.cc:237] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:13.652145  8295 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:13.680621  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:13.681186  8364 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:13.687470  8922 leader_election.cc:290] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:13.687654  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509edc927d524436b819a0e96e615799" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:13.688261  8360 raft_consensus.cc:3055] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:13.688567  8360 raft_consensus.cc:740] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:13.689307  8360 consensus_queue.cc:260] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:13.690188  8211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73873ecf3459400d839d6e8c0d8743b4" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:13.690517  8360 raft_consensus.cc:3060] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.690804  8211 raft_consensus.cc:3055] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:13.691171  8211 raft_consensus.cc:740] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:13.691885  8211 consensus_queue.cc:260] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:13.692870 13560 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:13.693043  8211 raft_consensus.cc:3060] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:13.696457  8360 raft_consensus.cc:2468] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 17.
I20260709 13:18:13.698982  8295 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:13.715628  8211 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:18:13.720747 13568 ts_tablet_manager.cc:933] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:13.718057  8258 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:13.721777 13505 raft_consensus.cc:2804] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:13.722330 13505 raft_consensus.cc:697] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:13.723234 13505 consensus_queue.cc:237] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:13.733284  8116 catalog_manager.cc:5697] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 16 to 17, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 17 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.724171  8364 raft_consensus.cc:2468] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 10.
I20260709 13:18:13.786427 13555 raft_consensus.cc:993] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:13.791659 13555 raft_consensus.cc:1081] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:13.811138 13573 ts_tablet_manager.cc:933] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:13.843088  8292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:13.843636  8292 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.844004  8292 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.845332 13573 tablet_copy_client.cc:323] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:18:13.846313 13568 tablet_copy_client.cc:323] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:18:13.848685  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 55586274911e4f2eb326f0741d200c17 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:18:13.849160  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 55586274911e4f2eb326f0741d200c17 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-55586274911e4f2eb326f0741d200c17
I20260709 13:18:13.903301  8116 catalog_manager.cc:5697] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 9 to 10, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 10 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:13.906415 13560 log.cc:927] Time spent T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.050s	user 0.001s	sys 0.006s
I20260709 13:18:13.911921  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet ee0be2dae2824fd89d658f949f717dfc from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:18:13.912542  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet ee0be2dae2824fd89d658f949f717dfc from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-ee0be2dae2824fd89d658f949f717dfc
I20260709 13:18:13.913825  8292 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:13.915997  8305 tablet_copy_source_session.cc:215] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:13.924909  8378 tablet_copy_source_session.cc:215] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:13.928960 13496 raft_consensus.cc:993] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:13.932816 13496 raft_consensus.cc:1081] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:13.930390 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55586274911e4f2eb326f0741d200c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:13.939260 13573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee0be2dae2824fd89d658f949f717dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:13.939574  8923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:56040
I20260709 13:18:13.940146  8923 raft_consensus.cc:493] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.940460  8923 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.920536  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:13.921622  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:13.948927  8360 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:13.948917  8213 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.949271  8360 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:13.950310  8360 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:13.951331  8360 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.955916  8213 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:13.957558  8360 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:13.919368  8292 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:13.958760  8261 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:13.960227 13505 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:13.960712 13505 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:13.960969 13560 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:13.961915 13560 tablet_bootstrap.cc:492] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:18:13.961620 13505 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:13.963791 13560 ts_tablet_manager.cc:1403] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.271s	user 0.050s	sys 0.027s
I20260709 13:18:13.964923  8923 raft_consensus.cc:515] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:13.966874  8923 leader_election.cc:290] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:13.967823 13560 raft_consensus.cc:359] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:13.974677 13560 raft_consensus.cc:740] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:13.975414 13560 consensus_queue.cc:260] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:13.978801 13560 ts_tablet_manager.cc:1434] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:18:13.985702  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:13.987180  8213 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.993865  8116 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 14 to 15, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.998216  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebc3be5b6ff4d2b90d60c9a508dafc7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:13.998798  8360 raft_consensus.cc:3055] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:13.999097  8360 raft_consensus.cc:740] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:13.999766  8360 consensus_queue.cc:260] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:14.000922  8360 raft_consensus.cc:3060] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:13.995889 13573 tablet_copy_client.cc:806] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:14.014878 13573 tablet_copy_client.cc:670] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:14.016810 13496 raft_consensus.cc:993] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:14.017347 13559 raft_consensus.cc:1081] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:14.018222 13559 raft_consensus.cc:993] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:14.018702 13578 raft_consensus.cc:1081] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:14.020351  8292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:14.020924  8292 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:14.021255  8292 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.022500  8923 raft_consensus.cc:1217] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:18:14.029565  8213 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:18:14.034576  8889 leader_election.cc:304] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:14.035386 13576 raft_consensus.cc:2804] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:14.035882 13576 raft_consensus.cc:697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:14.036530  8295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:14.037106  8295 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:14.036780 13576 consensus_queue.cc:237] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:14.037451  8295 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.037375  8360 raft_consensus.cc:2468] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:18:14.040316  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-d81288332c1b4610a2fe2b09dba77503 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:18:14.040829  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-d81288332c1b4610a2fe2b09dba77503 on tablet d81288332c1b4610a2fe2b09dba77503 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:14.044796 13573 tablet_copy_client.cc:538] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:14.055729 13573 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:14.058015  8360 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:14.060575 13563 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:14.060472  8295 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:14.067801  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:14.068645  8213 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.069928  8363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f62e72429d24920b32bee17b0d2aadd" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:14.070603  8363 raft_consensus.cc:3055] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:14.070892  8363 raft_consensus.cc:740] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:14.071597  8363 consensus_queue.cc:260] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:14.072650  8363 raft_consensus.cc:3060] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.079885  8295 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:14.085297  8292 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:14.084343  8213 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 16.
I20260709 13:18:14.089857  8258 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:14.091420  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:14.092195  8364 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:14.092550  8364 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:14.093614  8292 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:14.101078 13529 raft_consensus.cc:2804] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:14.101613 13529 raft_consensus.cc:697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:14.102231  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:14.102779  8923 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.102499 13529 consensus_queue.cc:237] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:14.116402  8364 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:14.117704  8364 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.086546  8363 raft_consensus.cc:2468] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 16.
I20260709 13:18:14.130473 13568 tablet_copy_client.cc:806] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:14.146476  8364 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 16.
I20260709 13:18:14.147708  8923 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 16.
I20260709 13:18:14.148264  8261 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:14.150846 13568 tablet_copy_client.cc:670] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:14.156531 13505 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:14.181710 13505 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:14.201499  8116 catalog_manager.cc:5697] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 15 to 16, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 16 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:14.239359  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 56592.2us
I20260709 13:18:14.241904  8213 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:14.246268  8292 raft_consensus.cc:1275] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:14.251353 13583 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:14.254107 13560 ts_tablet_manager.cc:933] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:14.257120 13568 tablet_copy_client.cc:538] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:14.260526 13576 consensus_queue.cc:1048] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:14.267738 13505 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:14.293954 13568 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:14.299439  8116 catalog_manager.cc:5697] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 13 to 14, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 14 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.325716  8115 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 15 to 16, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 16 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.385708 13560 tablet_copy_client.cc:323] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:18:14.420666 13573 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=2 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:14.479360 13573 tablet_bootstrap.cc:492] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
W20260709 13:18:14.482172  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 53032.4us
I20260709 13:18:14.495333  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 8942278c55614601a1290e32997fe007 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:18:14.495985  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 8942278c55614601a1290e32997fe007 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-8942278c55614601a1290e32997fe007
W20260709 13:18:14.489107  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 50073.2us
I20260709 13:18:14.516563 13584 raft_consensus.cc:1064] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:14.489037 13573 ts_tablet_manager.cc:1403] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.434s	user 0.036s	sys 0.011s
W20260709 13:18:14.521152  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 113566us
I20260709 13:18:14.545583  8360 raft_consensus.cc:1275] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:14.553707  8305 tablet_copy_source_session.cc:215] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:14.550860 13584 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:14.618189  8360 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:14.625185  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:14.628877  8211 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:14.630827 13529 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:14.633149 13573 raft_consensus.cc:359] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:14.634069 13573 raft_consensus.cc:740] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:14.637223 13573 consensus_queue.cc:260] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:14.644282  8217 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:14.660995  8360 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:14.672250 13571 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:18:14.676751 13560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8942278c55614601a1290e32997fe007. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:14.693115  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 84106us
I20260709 13:18:14.711906 13594 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:14.713433 13573 ts_tablet_manager.cc:1434] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.191s	user 0.006s	sys 0.001s
I20260709 13:18:14.719020  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-ee0be2dae2824fd89d658f949f717dfc received from {username='slave'} at 127.0.0.1:59420
I20260709 13:18:14.719517  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-ee0be2dae2824fd89d658f949f717dfc on tablet ee0be2dae2824fd89d658f949f717dfc with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:14.735941  8217 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:18:14.741310  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 150059us
I20260709 13:18:14.745563 13602 consensus_queue.cc:1048] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:18:14.746181 13605 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:14.764012 13505 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:14.765743  8364 raft_consensus.cc:1275] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:14.772794  8367 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:14.774506  8928 raft_consensus.cc:1217] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.5->[13.6-13.6]   Dedup: 13.6->[]
I20260709 13:18:14.879462 13560 tablet_copy_client.cc:806] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:14.882398  8928 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:18:14.893903  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 117745us
W20260709 13:18:14.894665  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 133795us
I20260709 13:18:14.905336  8928 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:14.906697 13560 tablet_copy_client.cc:670] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:14.967216 13605 consensus_queue.cc:1048] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:14.980886 13605 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:14.983956 13568 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:14.984164 13505 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:14.985137 13568 tablet_bootstrap.cc:492] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:18:14.985873 13568 ts_tablet_manager.cc:1403] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.692s	user 0.050s	sys 0.017s
I20260709 13:18:14.989987  8368 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:14.991379  8211 raft_consensus.cc:1275] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:15.004408 13576 consensus_queue.cc:1048] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:14.997403 13605 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:18:15.024224 13568 raft_consensus.cc:359] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:15.025593 13568 raft_consensus.cc:740] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:15.026438 13568 consensus_queue.cc:260] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:15.047928 13603 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:18:15.111078 13568 ts_tablet_manager.cc:1434] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.002s
I20260709 13:18:15.132215 13505 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:15.138449  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 56454.5us
I20260709 13:18:15.141873  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-55586274911e4f2eb326f0741d200c17 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:18:15.142269  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-55586274911e4f2eb326f0741d200c17 on tablet 55586274911e4f2eb326f0741d200c17 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:15.174525  8360 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.196075 13560 tablet_copy_client.cc:538] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:15.199867  8217 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:15.212604 13626 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:15.233876  8922 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.251065  8928 raft_consensus.cc:1217] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 13:18:15.288722 13560 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:15.365605  8115 catalog_manager.cc:5697] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 10 to 11, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:15.406716 13555 raft_consensus.cc:1064] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:15.413700 13555 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 4, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:15.438498  8922 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:15.443914  8295 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:15.447453  8217 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:18:15.455776 13627 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:15.458498 13627 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:15.466786 13627 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:15.479280 13560 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:15.500698 13560 tablet_bootstrap.cc:492] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:18:15.501389 13560 ts_tablet_manager.cc:1403] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.230s	user 0.033s	sys 0.013s
I20260709 13:18:15.504465 13560 raft_consensus.cc:359] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:15.505229 13560 raft_consensus.cc:740] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:15.505813 13560 consensus_queue.cc:260] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:15.524905 13496 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Committing config change with OpId 13.7: config changed from index 6 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.531040 13560 ts_tablet_manager.cc:1434] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:18:15.532832  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-8942278c55614601a1290e32997fe007 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:18:15.533226  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-8942278c55614601a1290e32997fe007 on tablet 8942278c55614601a1290e32997fe007 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:15.536712  8217 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index 6 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.564666  8922 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index 6 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.581254  8293 consensus_queue.cc:237] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:15.596724  8928 raft_consensus.cc:1217] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:18:15.596890  8213 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:15.599885 13571 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:15.602929  8118 catalog_manager.cc:5697] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 6 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.605474  8928 raft_consensus.cc:1275] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:15.614114 13571 consensus_queue.cc:1048] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:15.617063 13571 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:15.637544  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 59509.7us
I20260709 13:18:15.623073  8213 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.663897  8293 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index 6 to 7, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.678439  8367 consensus_queue.cc:237] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:15.682269  8923 raft_consensus.cc:2955] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:15.739082  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 45586.4us
I20260709 13:18:15.754434  8928 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:15.775166  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d81288332c1b4610a2fe2b09dba77503 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:15.776559  8292 raft_consensus.cc:1275] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:15.788635 13555 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:18:15.818564 13604 raft_consensus.cc:1064] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:15.836719 13604 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:15.846982  8113 catalog_manager.cc:5697] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 11 to 12, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.850103 13555 consensus_queue.cc:1048] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:18:15.860541 13590 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index 7 to 8, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.874773  8293 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index 7 to 8, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:15.885859  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 90465.3us
I20260709 13:18:15.917068  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee0be2dae2824fd89d658f949f717dfc with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:15.920871  8923 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:15.925484  8928 raft_consensus.cc:2955] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index 7 to 8, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.927057 13604 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:15.930555  8360 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:15.933104 13604 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:15.946866 13529 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.948594  8360 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.950945  8213 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:15.957885 13604 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:15.962234  8923 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.970144  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet d81288332c1b4610a2fe2b09dba77503 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:60056
I20260709 13:18:15.982587  8116 catalog_manager.cc:5697] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 7 to 8, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:15.983180  8113 catalog_manager.cc:5697] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:15.992214 13583 raft_consensus.cc:1064] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:15.995366 13583 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:16.006759  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet ee0be2dae2824fd89d658f949f717dfc with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:49976
I20260709 13:18:16.028378  8213 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.033524  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:16.054790 13647 tablet_replica.cc:333] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:16.055639 13647 raft_consensus.cc:2243] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:16.056339 13647 raft_consensus.cc:2272] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:16.058485 13646 tablet_replica.cc:333] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:16.113214  8928 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:16.156782 13647 ts_tablet_manager.cc:1916] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:16.114820  8363 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:16.158619 13604 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:16.131604  8213 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:16.166536 13596 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:16.172186 13583 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:16.175155  8292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:16.175807  8292 raft_consensus.cc:606] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Received request to transfer leadership to TS 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:16.176059 13646 raft_consensus.cc:2243] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:16.176915 13646 raft_consensus.cc:2272] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:16.183597 13646 ts_tablet_manager.cc:1916] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:16.189280  8360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eacbb7965099474082590e4b50221087"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:16.189922  8360 raft_consensus.cc:606] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Received request to transfer leadership to TS 4cf23888b4fe42b594b9443ae6ee9cd2
I20260709 13:18:16.195401  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:16.199194  8213 raft_consensus.cc:606] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:16.203342  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:16.211714  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:16.238384 13583 raft_consensus.cc:993] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:16.239500 13583 raft_consensus.cc:1081] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Signalling peer 8ff54842a32a414d8cbb4a3f32527f4a to start an election
I20260709 13:18:16.242663  8363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
 from {username='slave'} at 127.0.0.1:55878
I20260709 13:18:16.243988  8363 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.244410  8363 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.251037 13646 ts_tablet_manager.cc:1929] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:18:16.251545 13646 log.cc:1199] T d81288332c1b4610a2fe2b09dba77503 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/d81288332c1b4610a2fe2b09dba77503
I20260709 13:18:16.250813  8363 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:16.251622 13505 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.253990  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet d81288332c1b4610a2fe2b09dba77503 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:16.257047  8363 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:16.258364  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:16.259652  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd269c56db8748ddba9b5528d4c49916" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:16.260464  8217 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.260656  8292 raft_consensus.cc:3055] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:16.261183  8292 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:16.268674  8292 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:16.271275  8292 raft_consensus.cc:3060] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.270274  8213 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.288584  8292 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
I20260709 13:18:16.291442  8217 raft_consensus.cc:2468] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
I20260709 13:18:16.298508  8332 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236; no voters: 
I20260709 13:18:16.301798 13555 raft_consensus.cc:2804] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:16.313254 13555 raft_consensus.cc:697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:16.314184 13555 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:16.330164  8118 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.342381  8928 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.368598 13647 ts_tablet_manager.cc:1929] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.7
I20260709 13:18:16.369833 13590 raft_consensus.cc:993] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:16.372206 13590 raft_consensus.cc:1081] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Signalling peer 4cf23888b4fe42b594b9443ae6ee9cd2 to start an election
I20260709 13:18:16.373914 13647 log.cc:1199] T ee0be2dae2824fd89d658f949f717dfc P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/ee0be2dae2824fd89d658f949f717dfc
I20260709 13:18:16.377187  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet ee0be2dae2824fd89d658f949f717dfc (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
W20260709 13:18:16.386215  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 56210.7us
I20260709 13:18:16.393831  8293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eacbb7965099474082590e4b50221087"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
 from {username='slave'} at 127.0.0.1:46288
I20260709 13:18:16.394351  8293 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.394670  8293 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.407313 13517 raft_consensus.cc:993] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:16.407855 13517 raft_consensus.cc:1081] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:16.402068  8363 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.416158  8293 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:16.411878  8921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:18:16.417948  8115 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 15 to 16, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 16 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.418536  8921 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.421284  8292 consensus_queue.cc:237] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:16.422569  8921 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.421564  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:16.424010  8367 raft_consensus.cc:3055] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:16.424299  8367 raft_consensus.cc:740] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:16.425076  8367 consensus_queue.cc:260] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:16.426766  8367 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:16.419214  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 74123.2us
I20260709 13:18:16.418349  8293 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:16.453156  8921 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:16.461815  8213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacbb7965099474082590e4b50221087" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:16.464871  8213 raft_consensus.cc:3060] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.466281  8921 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:16.469626  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:16.470328  8217 raft_consensus.cc:3055] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:16.470669  8217 raft_consensus.cc:740] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:16.471489  8217 consensus_queue.cc:260] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:16.475556  8217 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.498093  8921 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:16.498950  8293 consensus_queue.cc:237] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:16.504594  8211 raft_consensus.cc:1275] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:16.507054  8217 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 17.
I20260709 13:18:16.508378  8889 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:16.509384 13654 raft_consensus.cc:2804] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:16.509984 13654 raft_consensus.cc:697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:16.510957 13654 consensus_queue.cc:237] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:16.532407 13505 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:16.491325  8213 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:18:16.544169  8367 raft_consensus.cc:2468] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 13.
I20260709 13:18:16.549451  8261 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:16.550577 13505 raft_consensus.cc:2804] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:16.551164 13505 raft_consensus.cc:697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:16.552423 13505 consensus_queue.cc:237] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:16.558701  8292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:16.559276  8292 raft_consensus.cc:3060] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.571352  8292 raft_consensus.cc:2468] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 17.
I20260709 13:18:16.587098 13652 consensus_queue.cc:1048] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:16.589975  8213 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:16.592991  8928 raft_consensus.cc:1275] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:16.595038 13505 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:16.602511 13529 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.630770  8213 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.633167  8118 catalog_manager.cc:5697] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 12 to 13, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 13 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.636512  8115 catalog_manager.cc:5697] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 16 to 17, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 17 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:16.641155 13585 consensus_queue.cc:1048] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:16.643945 13652 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.665139  8928 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.677626  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8942278c55614601a1290e32997fe007 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:16.682893  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55586274911e4f2eb326f0741d200c17 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:16.696278  8213 raft_consensus.cc:2955] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.716831  8116 catalog_manager.cc:5697] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 12 to 13, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.703076  8921 raft_consensus.cc:2955] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.724646  8118 catalog_manager.cc:5697] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 9 to 10, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:16.725986  8293 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:16.727661 13590 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:16.760667  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 8942278c55614601a1290e32997fe007 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:60056
I20260709 13:18:16.778451 13660 tablet_replica.cc:333] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:16.798969  8213 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:16.803160 13627 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:16.805660 13660 raft_consensus.cc:2243] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:16.828490 13660 raft_consensus.cc:2272] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:16.838300  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 55586274911e4f2eb326f0741d200c17 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:60056
I20260709 13:18:16.873200 13660 ts_tablet_manager.cc:1916] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:16.906625  8217 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:16.911387 13608 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:16.938591 13660 ts_tablet_manager.cc:1929] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:18:16.939265 13660 log.cc:1199] T 8942278c55614601a1290e32997fe007 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/8942278c55614601a1290e32997fe007
I20260709 13:18:16.953251  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 8942278c55614601a1290e32997fe007 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:16.952214 13660 tablet_replica.cc:333] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:16.970808 13660 raft_consensus.cc:2243] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:16.971902 13660 raft_consensus.cc:2272] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:16.979609 13660 ts_tablet_manager.cc:1916] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:17.027951 13660 ts_tablet_manager.cc:1929] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 13:18:17.028422 13660 log.cc:1199] T 55586274911e4f2eb326f0741d200c17 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/55586274911e4f2eb326f0741d200c17
I20260709 13:18:17.029758  8293 raft_consensus.cc:1275] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:17.030908  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 55586274911e4f2eb326f0741d200c17 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:17.037123 13563 consensus_queue.cc:1048] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:17.091991  8363 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:17.098879 13652 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:17.169765  8217 raft_consensus.cc:1275] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:17.171933 13596 consensus_queue.cc:1048] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:17.214036  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:18.196177  8293 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:18.219641  8363 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:18.222440 13596 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:18.228155  8213 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:18:18.236368  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53535408ea514f8db7292852927e7743. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.243162 13505 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:18.271832  8211 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.270407 13673 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
W20260709 13:18:18.267949  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 83634.1us
I20260709 13:18:18.303838  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:18.317620  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 45324.4us
I20260709 13:18:18.344686  8115 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 7, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
W20260709 13:18:18.366305  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 60361.5us
I20260709 13:18:18.368822  8363 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Committing config change with OpId 12.7: config changed from index -1 to 7, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
W20260709 13:18:18.381846  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 44521.8us
I20260709 13:18:18.411115  8363 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:18.416689  8293 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497"
dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:49556
I20260709 13:18:18.417418  8293 raft_consensus.cc:606] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:18.420619  8360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e"
dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
mode: GRACEFUL
new_leader_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:37538
I20260709 13:18:18.421221  8360 raft_consensus.cc:606] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Received request to transfer leadership to TS 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:18.422683  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:18.424471  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:18.465649  8921 raft_consensus.cc:3060] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 5 LEARNER]: Advancing to term 14
W20260709 13:18:18.471823  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 61203.4us
I20260709 13:18:18.475988  8921 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:18.481868  8217 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:18.481868  8293 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:18.483225 13672 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:18.484287 13672 consensus_queue.cc:1243] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Peer d03eaa3ce81042f9b114cd00a7f41b17 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:18.490777  8928 pending_rounds.cc:85] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Aborting all ops after (but not including) 2
I20260709 13:18:18.491093  8928 pending_rounds.cc:107] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.3
I20260709 13:18:18.491344  8928 raft_consensus.cc:2917] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEARNER]: Aborting config change with OpId 3.3: Aborted: Op aborted by new leader
I20260709 13:18:18.491964  8928 raft_consensus.cc:2889] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:18.504262 13590 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:18.506320 13590 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:18:18.520457 13682 log.cc:927] Time spent T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:18:18.619807 13590 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.624879  8293 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.639070  8217 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
W20260709 13:18:18.640722  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 46966.3us
I20260709 13:18:18.694891  8928 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEARNER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.678723  8116 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index -1 to 8, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.701020 13689 raft_consensus.cc:993] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: : Instructing follower 9e95b04d03d241329435b6d08dd1f236 to start an election
I20260709 13:18:18.704538 13672 raft_consensus.cc:1081] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Signalling peer 9e95b04d03d241329435b6d08dd1f236 to start an election
I20260709 13:18:18.709239  8212 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
 from {username='slave'} at 127.0.0.1:58438
I20260709 13:18:18.709854  8212 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:18.710270  8212 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.717905  8212 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:18.727005  8212 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Requested vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:18.727473  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:18.732987  8217 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:18.729333  8923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:18.734088  8923 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.733479  8360 raft_consensus.cc:3055] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:18.736373  8360 raft_consensus.cc:740] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:18.736630 13692 ts_tablet_manager.cc:933] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:18.737342  8360 consensus_queue.cc:260] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:18.738648  8360 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.750560  8923 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 15.
I20260709 13:18:18.753388  8360 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e95b04d03d241329435b6d08dd1f236 in term 15.
I20260709 13:18:18.754776  8183 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:18.755847 13681 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:18.756323 13681 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 15 LEADER]: Becoming Leader. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:18.757143 13681 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:18.781615  8183 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf2b3e0ac13b4eaf94a555cbea2ea41d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.782548  8363 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:18.784212 13641 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:18.791618  8293 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:18.794678 13641 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:18.816159 13641 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.832783  8293 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.845971 13679 raft_consensus.cc:993] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:18.846511 13679 raft_consensus.cc:1081] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:18.849144  8921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54804
I20260709 13:18:18.849687  8921 raft_consensus.cc:493] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:18.850499  8921 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.865847  8292 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:18.860791  8115 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: term changed from 14 to 15, leader changed from 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) to 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1). New cstate: current_term: 15 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.879510  8118 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 9, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 15 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.887634  8921 raft_consensus.cc:515] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:18.903710  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:18.904340  8293 raft_consensus.cc:3055] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:18.904613  8293 raft_consensus.cc:740] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:18.906272  8363 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:18.909242  8360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e06d1a840c4315837a871dc31b4497" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:18.910017  8360 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.917955  8293 consensus_queue.cc:260] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:18.919055  8293 raft_consensus.cc:3060] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.922149  8921 leader_election.cc:290] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: Requested vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:18.930473  8360 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 17.
I20260709 13:18:18.936059  8892 leader_election.cc:304] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:18.939352 13654 raft_consensus.cc:2804] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:18.940018 13654 raft_consensus.cc:697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:18.941798 13689 raft_consensus.cc:1064] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:18.941170 13654 consensus_queue.cc:237] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:18.944873 13689 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 6, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:18.967674  8293 raft_consensus.cc:2468] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 17.
I20260709 13:18:18.989820  8928 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:18.990272  8217 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:18.992241  8292 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:18.993554  8363 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:18.993539 13672 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:18.994051 13692 tablet_copy_client.cc:323] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
I20260709 13:18:18.995824  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 53535408ea514f8db7292852927e7743 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:18:18.996347  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 53535408ea514f8db7292852927e7743 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-53535408ea514f8db7292852927e7743
I20260709 13:18:18.999557  8212 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:18.996426 13672 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:19.008306  8305 tablet_copy_source_session.cc:215] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:19.001479 13679 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:18:19.016279  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 019e9c29effc40928d5f5e795b8aeed0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:19.018250  8115 catalog_manager.cc:5697] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 16 to 17, leader changed from 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 17 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:19.061483  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 57490.6us
I20260709 13:18:19.040280 13700 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:18:19.022814 13678 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:18:19.070813 13692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53535408ea514f8db7292852927e7743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.130694 13701 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:19.146730 13673 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:19.151783  8293 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:19.166349  8115 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 17 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.187493  8217 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:19.198354  8118 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.201779  8360 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:19.215157  8212 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:19.231086  8923 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } attrs { replace: true } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:19.247187  8367 consensus_queue.cc:237] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:19.266265  8292 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:19.267831 13627 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:19.269305 13692 tablet_copy_client.cc:806] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:19.269881 13692 tablet_copy_client.cc:670] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:19.293903  8923 raft_consensus.cc:1275] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:19.300937 13692 tablet_copy_client.cc:538] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:19.301486 13700 consensus_queue.cc:1048] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:19.307523 13701 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:19.320217  8292 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:19.321033  8923 raft_consensus.cc:2955] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:19.329698  8105 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d3403855d4147a9b056dc8678880fdf with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:19.349200 13692 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:19.360981  8292 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:19.366003  8360 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:19.368870 13641 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:19.372789 13654 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:19.373373  8922 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:19.374773 13681 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:19.362443  8115 catalog_manager.cc:5697] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 9 to 10, VOTER 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) evicted. New cstate: current_term: 14 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.433844  8204 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d3403855d4147a9b056dc8678880fdf with delete_type TABLET_DATA_TOMBSTONED (TS 9e95b04d03d241329435b6d08dd1f236 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:49976
I20260709 13:18:19.436226 13715 ts_tablet_manager.cc:933] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925)
I20260709 13:18:19.441370 13713 ts_tablet_manager.cc:933] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:19.445765 13715 tablet_copy_client.cc:323] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.1:43925
I20260709 13:18:19.447875  8230 tablet_copy_service.cc:140] P 9e95b04d03d241329435b6d08dd1f236: Received BeginTabletCopySession request for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:37896)
I20260709 13:18:19.448488  8230 tablet_copy_service.cc:161] P 9e95b04d03d241329435b6d08dd1f236: Beginning new tablet copy session on tablet cf2b3e0ac13b4eaf94a555cbea2ea41d from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:37896: session id = d03eaa3ce81042f9b114cd00a7f41b17-cf2b3e0ac13b4eaf94a555cbea2ea41d
I20260709 13:18:19.458190  8230 tablet_copy_source_session.cc:215] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:19.476492  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:19.481312 13715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.509718 13714 tablet_replica.cc:333] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:19.574633 13714 raft_consensus.cc:2243] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:19.522081 13713 tablet_copy_client.cc:323] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.2:40391
W20260709 13:18:19.613299 13708 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:18:19.716418 13711 log.cc:927] Time spent T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:18:19.732308  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 213709us
I20260709 13:18:19.728519 13714 raft_consensus.cc:2272] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:19.741806  8305 tablet_copy_service.cc:140] P 4cf23888b4fe42b594b9443ae6ee9cd2: Received BeginTabletCopySession request for tablet 019e9c29effc40928d5f5e795b8aeed0 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:33926)
I20260709 13:18:19.742319  8305 tablet_copy_service.cc:161] P 4cf23888b4fe42b594b9443ae6ee9cd2: Beginning new tablet copy session on tablet 019e9c29effc40928d5f5e795b8aeed0 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:33926: session id = d03eaa3ce81042f9b114cd00a7f41b17-019e9c29effc40928d5f5e795b8aeed0
I20260709 13:18:19.774880  8367 raft_consensus.cc:1275] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:19.784590 13714 ts_tablet_manager.cc:1916] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:18:19.831836  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 98375.1us
I20260709 13:18:19.836339  8305 tablet_copy_source_session.cc:215] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:18:19.861649  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 78452.4us
I20260709 13:18:19.801224 13715 tablet_copy_client.cc:806] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
W20260709 13:18:19.847612  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 329063us
I20260709 13:18:19.937325 13713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019e9c29effc40928d5f5e795b8aeed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:19.939446 13715 tablet_copy_client.cc:670] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:19.941843 13417 consensus_queue.cc:1048] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:19.983894 13714 ts_tablet_manager.cc:1929] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 13:18:19.997532 13692 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:20.025084 13692 tablet_bootstrap.cc:492] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:18:20.026294 13692 ts_tablet_manager.cc:1403] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.677s	user 0.038s	sys 0.006s
I20260709 13:18:20.041018 13714 log.cc:1199] T 8d3403855d4147a9b056dc8678880fdf P 9e95b04d03d241329435b6d08dd1f236: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/wals/8d3403855d4147a9b056dc8678880fdf
I20260709 13:18:20.044215  8102 catalog_manager.cc:5028] TS 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): tablet 8d3403855d4147a9b056dc8678880fdf (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:20.081489 13692 raft_consensus.cc:359] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:20.082763 13692 raft_consensus.cc:740] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:20.083480 13692 consensus_queue.cc:260] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:20.092792 13713 tablet_copy_client.cc:806] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:20.101084 13692 ts_tablet_manager.cc:1434] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.004s
I20260709 13:18:20.120481 13713 tablet_copy_client.cc:670] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:20.124589 13713 tablet_copy_client.cc:538] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:20.127074  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-53535408ea514f8db7292852927e7743 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:18:20.127664  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-53535408ea514f8db7292852927e7743 on tablet 53535408ea514f8db7292852927e7743 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:20.229195 13715 tablet_copy_client.cc:538] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:20.240974 13715 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:20.324406 13713 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:20.403860  8921 raft_consensus.cc:1217] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.6->[12.7-12.7]   Dedup: 12.7->[]
I20260709 13:18:20.684264 13713 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:20.713261 13715 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=3 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:20.714982 13713 tablet_bootstrap.cc:492] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:18:20.715862 13713 ts_tablet_manager.cc:1403] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.409s	user 0.041s	sys 0.028s
I20260709 13:18:20.725134 13715 tablet_bootstrap.cc:492] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:18:20.735296 13715 ts_tablet_manager.cc:1403] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.495s	user 0.043s	sys 0.016s
I20260709 13:18:20.738241 13713 raft_consensus.cc:359] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:20.739164 13715 raft_consensus.cc:359] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:20.750540 13715 raft_consensus.cc:740] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:20.750375 13713 raft_consensus.cc:740] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:20.757337 13715 consensus_queue.cc:260] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:20.757371 13713 consensus_queue.cc:260] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:20.770169 13715 ts_tablet_manager.cc:1434] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:18:20.793008  8230 tablet_copy_service.cc:342] P 9e95b04d03d241329435b6d08dd1f236: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-cf2b3e0ac13b4eaf94a555cbea2ea41d received from {username='slave'} at 127.0.0.1:37896
I20260709 13:18:20.793605  8230 tablet_copy_service.cc:434] P 9e95b04d03d241329435b6d08dd1f236: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-cf2b3e0ac13b4eaf94a555cbea2ea41d on tablet cf2b3e0ac13b4eaf94a555cbea2ea41d with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:20.804728 13713 ts_tablet_manager.cc:1434] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.003s
I20260709 13:18:20.819001  8305 tablet_copy_service.cc:342] P 4cf23888b4fe42b594b9443ae6ee9cd2: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-019e9c29effc40928d5f5e795b8aeed0 received from {username='slave'} at 127.0.0.1:33926
I20260709 13:18:20.819468  8305 tablet_copy_service.cc:434] P 4cf23888b4fe42b594b9443ae6ee9cd2: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-019e9c29effc40928d5f5e795b8aeed0 on tablet 019e9c29effc40928d5f5e795b8aeed0 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:20.865376 13673 raft_consensus.cc:1064] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:20.874866 13673 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 5, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:20.898195  8928 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:20.900071 13735 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:20.906276  8364 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:20.907155  8217 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:20.909134 13735 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:20.909986 13673 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:20.934710  8928 raft_consensus.cc:1217] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 13:18:20.985232 13735 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index 7 to 8, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:20.993909  8217 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.039659  8113 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 7 to 8, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.052112  8921 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.066570  8922 raft_consensus.cc:1217] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:18:21.066064  8368 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index 7 to 8, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:21.169737  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 79937.1us
I20260709 13:18:21.169842  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:21.270007  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 59593.7us
W20260709 13:18:21.272882  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 60113.2us
W20260709 13:18:21.287654 13752 log.cc:927] Time spent T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:18:21.292992  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 75067.6us
I20260709 13:18:21.377303 13751 raft_consensus.cc:1064] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:21.385900 13751 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:21.412823  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 61927.9us
I20260709 13:18:21.458357  8293 consensus_queue.cc:237] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:21.467450  8925 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEARNER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:21.469197 13747 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:21.474753 13673 raft_consensus.cc:1064] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:21.480886  8295 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:21.481221  8368 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:21.488335 13747 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:21.489372 13723 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:21.490443  8922 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:21.484517 13673 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:21.494634 13735 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:21.501204  8217 raft_consensus.cc:1275] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:21.502728  8213 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419"
dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
mode: GRACEFUL
new_leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:48574
I20260709 13:18:21.516911  8213 raft_consensus.cc:606] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Received request to transfer leadership to TS d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:21.521507  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:18:21.530526 13726 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.527139  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:21.539119 13735 consensus_queue.cc:1048] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:18:21.533510  8925 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.556437  8217 raft_consensus.cc:2955] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.610059  8116 catalog_manager.cc:5697] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 8 to 9, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 12 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.616539 13751 raft_consensus.cc:993] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: : Instructing follower d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:21.617092 13751 raft_consensus.cc:1081] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Signalling peer d03eaa3ce81042f9b114cd00a7f41b17 to start an election
I20260709 13:18:21.620793  8922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419"
dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
 from {username='slave'} at 127.0.0.1:54790
I20260709 13:18:21.621351  8922 raft_consensus.cc:493] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:21.621671  8922 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.626260 13748 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.628005  8925 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEARNER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:21.631283  8362 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:21.632782 13735 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:21.635712 13745 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:21.646109  8922 raft_consensus.cc:515] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:21.643383  8293 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.652161  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53535408ea514f8db7292852927e7743 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:21.660750  8213 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:21.666088 13673 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:21.669111  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 53535408ea514f8db7292852927e7743 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:60056
I20260709 13:18:21.685418  8118 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 9 to 10, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.684502  8921 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.682457  8362 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.710632  8922 leader_election.cc:290] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:21.739575  8217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "9e95b04d03d241329435b6d08dd1f236"
I20260709 13:18:21.740309  8217 raft_consensus.cc:3055] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:21.740599  8217 raft_consensus.cc:740] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9e95b04d03d241329435b6d08dd1f236, State: Running, Role: LEADER
I20260709 13:18:21.731443  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57b9174dc54540e597799ccc6b10b419" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:21.749513  8364 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.741287  8217 consensus_queue.cc:260] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:21.752900  8217 raft_consensus.cc:3060] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.759039  8217 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:18:21.765350 13763 tablet_replica.cc:333] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:21.765317  8889 leader_election.cc:304] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:21.766249 13417 raft_consensus.cc:2804] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:21.766489 13763 raft_consensus.cc:2243] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:21.766706 13417 raft_consensus.cc:697] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:21.767370 13763 raft_consensus.cc:2272] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:21.940706 13763 ts_tablet_manager.cc:1916] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:21.767594 13417 consensus_queue.cc:237] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:21.960275 13749 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:21.935927  8364 raft_consensus.cc:2468] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 8.
I20260709 13:18:21.982885  8928 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:22.042121  8217 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:22.071226  8921 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:18:22.079967  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 72314.1us
I20260709 13:18:22.099238  8362 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Refusing update from remote peer 9e95b04d03d241329435b6d08dd1f236: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:22.145889  8118 catalog_manager.cc:5697] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 7 to 8, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 8 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.190671  8118 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:22.204546  8183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 114563us
W20260709 13:18:22.207876  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 115749us
I20260709 13:18:22.215988 13748 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:18:22.222916  8368 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:22.266583  8295 consensus_queue.cc:237] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:22.244376  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 154788us
I20260709 13:18:22.278724 13772 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:22.280006  8928 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:22.299338  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 208628us
I20260709 13:18:22.300971 13724 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:22.315557 13763 ts_tablet_manager.cc:1929] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.8
I20260709 13:18:22.317615  8925 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:22.319100 13778 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:22.322187 13763 log.cc:1199] T 53535408ea514f8db7292852927e7743 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/53535408ea514f8db7292852927e7743
I20260709 13:18:22.324142  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 53535408ea514f8db7292852927e7743 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:22.328764 13778 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:22.333573  8213 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } attrs { replace: true } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:22.340677  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:22.342888  8925 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:22.346103  8368 raft_consensus.cc:2955] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:22.372872  8218 raft_consensus.cc:1275] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:22.365948  8116 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 reported cstate change: config changed from index 10 to 11, VOTER 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2) evicted. New cstate: current_term: 15 leader_uuid: "9e95b04d03d241329435b6d08dd1f236" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.387880 13749 consensus_queue.cc:1048] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:22.404304  8102 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 019e9c29effc40928d5f5e795b8aeed0 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:22.406845  8218 raft_consensus.cc:2955] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:22.411878  8113 catalog_manager.cc:5697] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: config changed from index 12 to 13, VOTER 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3) evicted. New cstate: current_term: 17 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.424204  8281 tablet_service.cc:1558] Processing DeleteTablet for tablet cf2b3e0ac13b4eaf94a555cbea2ea41d with delete_type TABLET_DATA_TOMBSTONED (TS 4cf23888b4fe42b594b9443ae6ee9cd2 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36518
I20260709 13:18:22.432965  8356 tablet_service.cc:1558] Processing DeleteTablet for tablet 019e9c29effc40928d5f5e795b8aeed0 with delete_type TABLET_DATA_TOMBSTONED (TS 8ff54842a32a414d8cbb4a3f32527f4a not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:60056
I20260709 13:18:22.433938 13763 tablet_replica.cc:333] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:22.435000 13763 raft_consensus.cc:2243] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.435906 13763 raft_consensus.cc:2272] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.445479 13763 ts_tablet_manager.cc:1916] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:22.462216 13763 ts_tablet_manager.cc:1929] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:18:22.462692 13763 log.cc:1199] T 019e9c29effc40928d5f5e795b8aeed0 P 8ff54842a32a414d8cbb4a3f32527f4a: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/wals/019e9c29effc40928d5f5e795b8aeed0
I20260709 13:18:22.464286  8105 catalog_manager.cc:5028] TS 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): tablet 019e9c29effc40928d5f5e795b8aeed0 (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
I20260709 13:18:22.473829 13784 tablet_replica.cc:333] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:22.477156 13784 raft_consensus.cc:2243] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:22.485848 13784 raft_consensus.cc:2272] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:22.508013  8218 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:22.509495 13773 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:22.512570 13784 ts_tablet_manager.cc:1916] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:22.539906  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:22.557260  8364 raft_consensus.cc:1275] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:22.559125 13777 consensus_queue.cc:1048] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:22.707409 13784 ts_tablet_manager.cc:1929] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:18:22.708110 13784 log.cc:1199] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 4cf23888b4fe42b594b9443ae6ee9cd2: Deleting WAL directory at /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/wals/cf2b3e0ac13b4eaf94a555cbea2ea41d
I20260709 13:18:22.840173  8102 catalog_manager.cc:5028] TS 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): tablet cf2b3e0ac13b4eaf94a555cbea2ea41d (table test-workload [id=4a48956e092241caaba46fad01c0b37e]) successfully deleted
W20260709 13:18:23.036439  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 144642us
W20260709 13:18:23.056408  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 174788us
W20260709 13:18:23.154780  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 89249.3us
W20260709 13:18:23.160161  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 89176.8us
I20260709 13:18:23.178013  7076 tablet_server.cc:179] TabletServer@127.6.233.1:0 shutting down...
W20260709 13:18:23.193657  8186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 121427us
W20260709 13:18:23.202135  8889 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:18:23.278091  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 75986.2us
W20260709 13:18:23.278635  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 61585us
W20260709 13:18:23.383709  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.394099  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.466403  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 66673us
W20260709 13:18:23.486028  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.486689  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.487246  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.487775  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.489498  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.490139  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.491729  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.492316  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.492867  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.493382  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.493953  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.494477  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.495344  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.495957  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.496562  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.497944  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.500227  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.506623  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.508026  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.508652  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.509569  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.510138  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.517700  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.517158  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.520929  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.544659  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:23.569093  8367 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:23.616745  8293 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:23.618356 13627 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:18:23.621040  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.622098  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.624018  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:23.625479  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491): Couldn't send request to peer d03eaa3ce81042f9b114cd00a7f41b17. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd269c56db8748ddba9b5528d4c49916. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:23.679157 13627 raft_consensus.cc:2955] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:23.682904  8293 raft_consensus.cc:2955] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } } }
I20260709 13:18:23.707870  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:23.722823  7076 tablet_replica.cc:333] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.724025  7076 raft_consensus.cc:2243] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:23.724895  7076 raft_consensus.cc:2272] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.717597  8116 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index -1 to 11, NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) added. New cstate: current_term: 16 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.732862  7076 tablet_replica.cc:333] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.733852  7076 raft_consensus.cc:2243] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.736526  7076 raft_consensus.cc:2272] T 73873ecf3459400d839d6e8c0d8743b4 P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.740835  7076 tablet_replica.cc:333] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.741776  7076 raft_consensus.cc:2243] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.742697  7076 raft_consensus.cc:2272] T 53535408ea514f8db7292852927e7743 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.745515  7076 tablet_replica.cc:333] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.746402  7076 raft_consensus.cc:2243] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.747012  7076 raft_consensus.cc:2272] T 5da27e18b189452598381f95fe6f22cf P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.750154  7076 tablet_replica.cc:333] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.751210  7076 raft_consensus.cc:2243] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.751848  7076 raft_consensus.cc:2272] T fea6012070404ef6b810517d977625da P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.754997  7076 tablet_replica.cc:333] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.760106  7076 raft_consensus.cc:2243] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.760762  7076 raft_consensus.cc:2272] T eacbb7965099474082590e4b50221087 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.767504  7076 tablet_replica.cc:333] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.769456  7076 raft_consensus.cc:2243] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.770187  7076 raft_consensus.cc:2272] T e36ea2a6e04a442397de5d29398d0314 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.773821  7076 tablet_replica.cc:333] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.774748  7076 raft_consensus.cc:2243] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.775516  7076 raft_consensus.cc:2272] T 1924d44c50904ed09f8f93dd9b4928ca P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.792487  7076 tablet_replica.cc:333] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.796753  7076 raft_consensus.cc:2243] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:23.797978  7076 raft_consensus.cc:2272] T 64f8ae67f51c4ec482dada7787dc153e P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.800761  7076 tablet_replica.cc:333] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.811861  7076 raft_consensus.cc:2243] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.812824  7076 raft_consensus.cc:2272] T a15d60ee93c04debb4b2f6a595555fbb P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.818547  7076 tablet_replica.cc:333] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.819360  7076 raft_consensus.cc:2243] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.825300  7076 raft_consensus.cc:2272] T 55586274911e4f2eb326f0741d200c17 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:23.828207  8952 debug-util.cc:398] Leaking SignalData structure 0x7b080036aa20 after lost signal to thread 7079
I20260709 13:18:23.828715  7076 tablet_replica.cc:333] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
W20260709 13:18:23.829312  8952 debug-util.cc:398] Leaking SignalData structure 0x7b0800159f00 after lost signal to thread 8152
I20260709 13:18:23.829756  7076 raft_consensus.cc:2243] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:23.830646  8952 debug-util.cc:398] Leaking SignalData structure 0x7b080033fbe0 after lost signal to thread 8244
I20260709 13:18:23.830659  7076 raft_consensus.cc:2272] T 749a008ddc4d4f31a1bcd1a446b5916d P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:23.832140  8952 debug-util.cc:398] Leaking SignalData structure 0x7b0800126a80 after lost signal to thread 8319
W20260709 13:18:23.839898  8952 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3e60 after lost signal to thread 8393
W20260709 13:18:23.841203  8952 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3f20 after lost signal to thread 8955
I20260709 13:18:23.853152  7076 tablet_replica.cc:333] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.854127  7076 raft_consensus.cc:2243] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:23.855192  7076 raft_consensus.cc:2272] T 0e9e53d1d8204518834e32e1ef952157 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.865242  7076 tablet_replica.cc:333] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.866233  7076 raft_consensus.cc:2243] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:23.867307  7076 raft_consensus.cc:2272] T 57b9174dc54540e597799ccc6b10b419 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.910712 13794 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:23.911340 13794 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:23.912622  7076 tablet_replica.cc:333] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.913552  7076 raft_consensus.cc:2243] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:23.913642 13794 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:23.914616  7076 raft_consensus.cc:2272] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.915824  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:23.917335  7076 tablet_replica.cc:333] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.918174  7076 raft_consensus.cc:2243] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:23.920090  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019e9c29effc40928d5f5e795b8aeed0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:23.924067  8183 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:23.927052 13794 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:23.948361  7076 raft_consensus.cc:2272] T 7ac72d56568b4857a1bd70aadbb026c1 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:23.958604  7076 tablet_replica.cc:333] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:23.995788  7076 raft_consensus.cc:2243] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:23.997453  7076 raft_consensus.cc:2272] T 1a722bdfa4d04d60b64682ee5868136f P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.006963  7076 tablet_replica.cc:333] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.011965  7076 raft_consensus.cc:2243] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.014446  7076 raft_consensus.cc:2272] T bd269c56db8748ddba9b5528d4c49916 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.018631 13794 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:24.019268 13794 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:24.021446 13794 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:24.023496  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:24.024883  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7984a0dbb5d4008936cec86daf790e9" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:24.027845  8186 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:24.029928 13772 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:24.038407  7076 tablet_replica.cc:333] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.056667  7076 raft_consensus.cc:2243] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.058950 13794 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:24.059525 13794 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:24.061682 13794 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:24.063184  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:24.063416  7076 raft_consensus.cc:2272] T 1f62e72429d24920b32bee17b0d2aadd P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.066011  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef2eafec27ce4eb48cfb13c576f7cefb" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:24.068573  8186 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:24.069677 13794 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.074885  7076 tablet_replica.cc:333] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.075899  7076 raft_consensus.cc:2243] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.078941  7076 raft_consensus.cc:2272] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.080744 13794 raft_consensus.cc:493] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:24.081314 13794 raft_consensus.cc:515] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:24.089447  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:24.091418 13772 raft_consensus.cc:493] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:24.092010 13772 raft_consensus.cc:515] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:24.094882  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:24.096936  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83404a77373349799a8b3ee06b2a7ccd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:24.098584  8186 leader_election.cc:304] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:24.099431 13772 leader_election.cc:290] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:24.099438 13810 raft_consensus.cc:2749] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.101697 13794 leader_election.cc:290] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:24.102085  8926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c96431d125f4d169be8f25647f9371e" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:24.103497  8183 leader_election.cc:304] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:24.105408 13810 raft_consensus.cc:2749] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:24.112882 13794 raft_consensus.cc:493] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:24.113529 13794 raft_consensus.cc:515] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:24.116348  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:24.116607  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ab3ddb872e454ab0de56eb9ba4ccf3" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:24.117902  8186 leader_election.cc:304] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:24.118780 13772 raft_consensus.cc:2749] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.124325 13794 leader_election.cc:290] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:24.149587  7076 tablet_replica.cc:333] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.150816  7076 raft_consensus.cc:2243] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.153028 13822 ts_tablet_manager.cc:933] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: Initiating tablet copy from peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:24.164103  7076 raft_consensus.cc:2272] T 4c835fd22b7643a981b446089ad74066 P 9e95b04d03d241329435b6d08dd1f236 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.165947 13822 tablet_copy_client.cc:323] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Beginning tablet copy session from remote peer at address 127.6.233.3:43697
I20260709 13:18:24.168767  8378 tablet_copy_service.cc:140] P 8ff54842a32a414d8cbb4a3f32527f4a: Received BeginTabletCopySession request for tablet bd269c56db8748ddba9b5528d4c49916 from peer d03eaa3ce81042f9b114cd00a7f41b17 ({username='slave'} at 127.0.0.1:59420)
I20260709 13:18:24.169518  8378 tablet_copy_service.cc:161] P 8ff54842a32a414d8cbb4a3f32527f4a: Beginning new tablet copy session on tablet bd269c56db8748ddba9b5528d4c49916 from peer d03eaa3ce81042f9b114cd00a7f41b17 at {username='slave'} at 127.0.0.1:59420: session id = d03eaa3ce81042f9b114cd00a7f41b17-bd269c56db8748ddba9b5528d4c49916
I20260709 13:18:24.177332  7076 tablet_replica.cc:333] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.182111  7076 raft_consensus.cc:2243] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.187474  7076 raft_consensus.cc:2272] T 3becc403d217418988bb94be41c015e9 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.190315  7076 tablet_replica.cc:333] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.208503  7076 raft_consensus.cc:2243] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.220887  7076 raft_consensus.cc:2272] T 5bded28881ef4440a713698e8088bd77 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.238117  7076 tablet_replica.cc:333] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.238948  7076 raft_consensus.cc:2243] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.239944  7076 raft_consensus.cc:2272] T 4c96431d125f4d169be8f25647f9371e P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.246574  7076 tablet_replica.cc:333] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.258020  7076 raft_consensus.cc:2243] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.265007  7076 raft_consensus.cc:2272] T d81288332c1b4610a2fe2b09dba77503 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.282151  7076 tablet_replica.cc:333] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.283047  7076 raft_consensus.cc:2243] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.284243  7076 raft_consensus.cc:2272] T f62f6597a8604eb9b9228657a7c3a7eb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.284906  8378 tablet_copy_source_session.cc:215] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:24.299993  7076 tablet_replica.cc:333] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.300890  7076 raft_consensus.cc:2243] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.301955  7076 raft_consensus.cc:2272] T 5da6736db6d7413682f6b3e035ca2084 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.309295  7076 tablet_replica.cc:333] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.313938 13772 raft_consensus.cc:493] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:18:24.314136  7076 raft_consensus.cc:2243] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.314622 13772 raft_consensus.cc:515] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:24.315169  7076 raft_consensus.cc:2272] T 133eb5f61ebc499ab283df4c068d5be7 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.317045 13772 leader_election.cc:290] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:24.319909  7076 tablet_replica.cc:333] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.321003 13822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd269c56db8748ddba9b5528d4c49916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:24.320787  7076 raft_consensus.cc:2243] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.322125  7076 raft_consensus.cc:2272] T eadd35a48bd34475b97994ba7c427ae5 P 9e95b04d03d241329435b6d08dd1f236 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.323444  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:24.324946  7076 tablet_replica.cc:333] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.325847  7076 raft_consensus.cc:2243] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.326472  7076 raft_consensus.cc:2272] T 83404a77373349799a8b3ee06b2a7ccd P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.329061  7076 tablet_replica.cc:333] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.329898  7076 raft_consensus.cc:2243] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.330523  7076 raft_consensus.cc:2272] T ef2eafec27ce4eb48cfb13c576f7cefb P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.335033  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5614e6d15c446ba2addddda765efdd" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:24.336416  8183 leader_election.cc:304] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:24.337323 13772 raft_consensus.cc:2749] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.338241  7076 tablet_replica.cc:333] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.339174  7076 raft_consensus.cc:2243] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.339839  7076 raft_consensus.cc:2272] T 3caa82d776714435898936cb4c6041c0 P 9e95b04d03d241329435b6d08dd1f236 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.346375  7076 tablet_replica.cc:333] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.347200  7076 raft_consensus.cc:2243] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.348152  7076 raft_consensus.cc:2272] T 019e9c29effc40928d5f5e795b8aeed0 P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.349841 13772 raft_consensus.cc:493] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:18:24.351796 13794 raft_consensus.cc:493] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d03eaa3ce81042f9b114cd00a7f41b17)
I20260709 13:18:24.354060 13772 raft_consensus.cc:515] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:24.354146 13794 raft_consensus.cc:515] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:24.351401 13822 tablet_copy_client.cc:806] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:24.356838 13822 tablet_copy_client.cc:670] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:24.357113  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:24.357642 13794 leader_election.cc:290] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:24.358325  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:24.359988  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f77585d3144b70a0f742dcd66411d0" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:24.360412  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e600fe8a934349bb2d4d18d10815a6" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:24.362440  8183 leader_election.cc:304] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:24.363519  8183 leader_election.cc:304] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:24.364218 13810 raft_consensus.cc:2749] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.364538 13794 raft_consensus.cc:2749] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.385264 13822 tablet_copy_client.cc:538] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:24.394702 13822 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap starting.
I20260709 13:18:24.405340 13794 raft_consensus.cc:493] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:24.405913 13794 raft_consensus.cc:515] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:24.408974  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:24.407876 13794 leader_election.cc:290] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:24.410866  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9006ab90a84d6fae17b6b86c0530b8" candidate_uuid: "9e95b04d03d241329435b6d08dd1f236" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:24.397223 13772 leader_election.cc:290] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:24.417965  8183 leader_election.cc:304] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e95b04d03d241329435b6d08dd1f236; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:24.435895 13772 raft_consensus.cc:2749] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:24.445410  7076 tablet_replica.cc:333] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.446377  7076 raft_consensus.cc:2243] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.447057  7076 raft_consensus.cc:2272] T ff5614e6d15c446ba2addddda765efdd P 9e95b04d03d241329435b6d08dd1f236 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.454195  7076 tablet_replica.cc:333] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.472281  7076 raft_consensus.cc:2243] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.472746  7076 raft_consensus.cc:2272] T 1d693bc5288d40ae98bb93862716c589 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.474815  7076 tablet_replica.cc:333] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.475484  7076 raft_consensus.cc:2243] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.476322  7076 raft_consensus.cc:2272] T 8942278c55614601a1290e32997fe007 P 9e95b04d03d241329435b6d08dd1f236 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.479003  7076 tablet_replica.cc:333] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.479692  7076 raft_consensus.cc:2243] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.480533  7076 raft_consensus.cc:2272] T 48e600fe8a934349bb2d4d18d10815a6 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.484627  7076 tablet_replica.cc:333] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.489652  7076 raft_consensus.cc:2243] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.490243  7076 raft_consensus.cc:2272] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.492883  7076 tablet_replica.cc:333] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.498382  7076 raft_consensus.cc:2243] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.499514  7076 raft_consensus.cc:2272] T cfe43428b7ca43928b7eeb8cce815e8d P 9e95b04d03d241329435b6d08dd1f236 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.502225  7076 tablet_replica.cc:333] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.503021  7076 raft_consensus.cc:2243] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.503199 13822 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:24.503680  7076 raft_consensus.cc:2272] T b7f77585d3144b70a0f742dcd66411d0 P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.504225 13822 tablet_bootstrap.cc:492] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: Bootstrap complete.
I20260709 13:18:24.505007 13822 ts_tablet_manager.cc:1403] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent bootstrapping tablet: real 0.111s	user 0.022s	sys 0.026s
I20260709 13:18:24.508083 13822 raft_consensus.cc:359] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:24.508909 13822 raft_consensus.cc:740] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Initialized, Role: LEARNER
I20260709 13:18:24.509828 13822 consensus_queue.cc:260] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: NON_VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: true } }
I20260709 13:18:24.520526 13822 ts_tablet_manager.cc:1434] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:18:24.522321  8378 tablet_copy_service.cc:342] P 8ff54842a32a414d8cbb4a3f32527f4a: Request end of tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-bd269c56db8748ddba9b5528d4c49916 received from {username='slave'} at 127.0.0.1:59420
I20260709 13:18:24.522800  8378 tablet_copy_service.cc:434] P 8ff54842a32a414d8cbb4a3f32527f4a: ending tablet copy session d03eaa3ce81042f9b114cd00a7f41b17-bd269c56db8748ddba9b5528d4c49916 on tablet bd269c56db8748ddba9b5528d4c49916 with peer d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:24.537847  7076 tablet_replica.cc:333] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.538671  7076 raft_consensus.cc:2243] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.539251  7076 raft_consensus.cc:2272] T a7984a0dbb5d4008936cec86daf790e9 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.543056  7076 tablet_replica.cc:333] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.544337  7076 raft_consensus.cc:2243] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:24.545404  7076 raft_consensus.cc:2272] T 3c999e73d071475d9e848e7e83e79be3 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.547943  7076 tablet_replica.cc:333] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.548605  7076 raft_consensus.cc:2243] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.549113  7076 raft_consensus.cc:2272] T 8b9006ab90a84d6fae17b6b86c0530b8 P 9e95b04d03d241329435b6d08dd1f236 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.551879  7076 tablet_replica.cc:333] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.552524  7076 raft_consensus.cc:2243] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.552999  7076 raft_consensus.cc:2272] T c802b19bdf2e4f69b169d31056091820 P 9e95b04d03d241329435b6d08dd1f236 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.555614  7076 tablet_replica.cc:333] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236: stopping tablet replica
I20260709 13:18:24.556223  7076 raft_consensus.cc:2243] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:24.556993  7076 raft_consensus.cc:2272] T caf02b6ca7a34be9bbac5771e91f767a P 9e95b04d03d241329435b6d08dd1f236 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:24.644376  8921 raft_consensus.cc:1217] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:18:24.862440 13417 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:24.862926 13417 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:24.865743 13417 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:24.868620  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:18:24.888106  8889 leader_election.cc:336] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:24.893241  8889 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:24.893975 13417 raft_consensus.cc:2749] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.924124 13417 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:24.924597 13417 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:24.926524 13417 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:24.929550  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:18:24.931810  8889 leader_election.cc:336] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:24.932641  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:24.933302 13417 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.941655 13821 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:24.942243 13821 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:24.944442 13821 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:24.969873  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:24.970587  8921 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:18:25.007342  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.009510 13627 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:25.009899 13627 raft_consensus.cc:493] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.010226 13627 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.017148 13627 raft_consensus.cc:515] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.018858 13627 leader_election.cc:290] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.029501  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2b3e0ac13b4eaf94a555cbea2ea41d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:25.030184  8921 raft_consensus.cc:3060] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.047391  8921 raft_consensus.cc:2468] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
W20260709 13:18:25.053743  8332 leader_election.cc:336] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.055202 13796 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.055814 13796 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.059115  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:25.063078 13821 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:18:25.063418  8258 leader_election.cc:336] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.063673 13821 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.063922  8258 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.065964 13799 raft_consensus.cc:2749] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.066388 13821 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.058036 13796 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.081835  8332 leader_election.cc:304] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.082635 13821 raft_consensus.cc:2804] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:25.083124 13821 raft_consensus.cc:697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:25.083974 13821 consensus_queue.cc:237] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.102006  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:18:25.104463  8332 leader_election.cc:336] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.119364  8113 catalog_manager.cc:5697] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 15 to 16, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 16 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.126235 13821 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.126817 13821 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.129019 13821 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:25.134945  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.155426  8332 leader_election.cc:336] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.157359  8332 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.158079 13627 raft_consensus.cc:2749] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.159963  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:25.160677  8295 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 14.
I20260709 13:18:25.180740  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:25.181535 13627 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.181910 13627 raft_consensus.cc:493] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.182235 13627 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.188963 13627 raft_consensus.cc:515] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.190330 13824 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.190706 13627 leader_election.cc:290] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.191396 13627 raft_consensus.cc:1064] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: attempting to promote NON_VOTER d03eaa3ce81042f9b114cd00a7f41b17 to VOTER
I20260709 13:18:25.191107 13824 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.193284 13824 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:25.199524  8889 leader_election.cc:336] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.201355 13627 consensus_queue.cc:237] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:25.201417  8332 leader_election.cc:336] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.211129  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a722bdfa4d04d60b64682ee5868136f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:25.211707  8295 raft_consensus.cc:3060] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.220208  8295 raft_consensus.cc:2468] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 15.
I20260709 13:18:25.224017  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:25.224656  8362 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 15.
I20260709 13:18:25.240628  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.241725 13824 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:25.242159 13824 raft_consensus.cc:493] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.242584 13824 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.248653 13824 raft_consensus.cc:515] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.250762  8332 leader_election.cc:304] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:25.251504 13821 raft_consensus.cc:2804] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:25.251958 13821 raft_consensus.cc:697] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:25.254976 13821 consensus_queue.cc:237] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
W20260709 13:18:25.257552  8889 leader_election.cc:336] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.265239 13796 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.265446 13824 leader_election.cc:290] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.265846 13796 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.268667 13799 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.269228 13799 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.271185 13799 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.272296  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:25.278052  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:25.267908 13796 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:25.282342  8258 leader_election.cc:336] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.283746  8258 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
W20260709 13:18:25.290944  8258 leader_election.cc:336] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.291929  8258 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.291424 13796 raft_consensus.cc:2749] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:25.301566  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 48652.1us
I20260709 13:18:25.293560 13799 raft_consensus.cc:2749] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.308424  8921 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 LEARNER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:25.315934 13799 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.316465 13799 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.317430  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ae67f51c4ec482dada7787dc153e" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:25.318022  8362 raft_consensus.cc:3060] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.318534 13799 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
W20260709 13:18:25.327283  8258 leader_election.cc:336] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.329659  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:25.332355 13839 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.332867  8921 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 14.
I20260709 13:18:25.335533  8295 raft_consensus.cc:1275] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:18:25.335682  8332 leader_election.cc:336] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.337011  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.337846 13778 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.338186 13778 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.338539 13778 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.340301  8362 raft_consensus.cc:2468] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 16.
I20260709 13:18:25.346382  8113 catalog_manager.cc:5697] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 14 to 15, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 15 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.352923 13778 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.365242 13778 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.365811 13778 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.366242 13778 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.368247 13778 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.369073 13821 consensus_queue.cc:1048] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.375376  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e9e53d1d8204518834e32e1ef952157" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:25.395072  8921 raft_consensus.cc:3060] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.376473  8925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:18:25.396414  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:25.408208 13821 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.408723 13821 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.410626 13821 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.421231  8921 raft_consensus.cc:2468] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 15.
I20260709 13:18:25.393854 13841 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.424945  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:25.435146  8293 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 12.
I20260709 13:18:25.435057 13841 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.437371 13841 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:25.380426  8258 leader_election.cc:336] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.440374  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 59986.8us
W20260709 13:18:25.440898  8258 leader_election.cc:336] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.441481  8889 leader_election.cc:336] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.443964  8892 leader_election.cc:304] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.447322  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:25.453156  8295 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:18:25.454337 13841 raft_consensus.cc:2804] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:25.447975  8258 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.454872 13841 raft_consensus.cc:697] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:25.455901 13799 raft_consensus.cc:2749] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.455811 13841 consensus_queue.cc:237] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.450251  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:25.458503 13799 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:18:25.458607  8332 leader_election.cc:336] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.459396 13837 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:25.459052 13799 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.459816 13837 raft_consensus.cc:493] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.460295 13837 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:25.463075 13799 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.455914  8258 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.468281 13778 raft_consensus.cc:2804] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:25.468922 13778 raft_consensus.cc:697] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:25.469151 13837 raft_consensus.cc:515] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.470043 13778 consensus_queue.cc:237] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.471378 13837 leader_election.cc:290] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.479825  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.482982 13841 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.483376 13841 raft_consensus.cc:493] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.483721 13841 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.486260  8113 catalog_manager.cc:5697] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 15 to 16, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 16 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.491740 13417 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.492362 13417 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.493311  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:25.494120 13417 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.494128  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a6cfa6f2cf49b6b8ad9a3beb86c0be" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:25.495812  8295 raft_consensus.cc:3060] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:25.505806 13841 raft_consensus.cc:515] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.518141  8295 raft_consensus.cc:2468] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 13.
I20260709 13:18:25.521844 13841 leader_election.cc:290] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.522668 13837 raft_consensus.cc:2955] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:25.525168  8927 raft_consensus.cc:1275] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:18:25.526650  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:25.527361 13821 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.528651 13821 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.530624 13821 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.532477  8113 catalog_manager.cc:5697] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 14 to 15, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 15 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:25.542915  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.545629  8258 leader_election.cc:336] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.546187  8258 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.543573  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:25.547371  8295 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:18:25.548403 13845 raft_consensus.cc:2749] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:25.555392  8116 catalog_manager.cc:5697] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:25.565203  8889 leader_election.cc:336] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.568681 13841 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.528126  8332 leader_election.cc:304] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 
I20260709 13:18:25.569205 13841 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.571209 13837 raft_consensus.cc:2804] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:25.571697 13837 raft_consensus.cc:697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Becoming Leader. State: Replica: 8ff54842a32a414d8cbb4a3f32527f4a, State: Running, Role: LEADER
I20260709 13:18:25.572607 13837 consensus_queue.cc:237] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.576536  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac72d56568b4857a1bd70aadbb026c1" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:25.577519  8295 raft_consensus.cc:3060] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.580407  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:25.581769 13778 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.582281 13778 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.586359  8291 raft_consensus.cc:2955] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
I20260709 13:18:25.579669  8927 raft_consensus.cc:2955] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } } }
W20260709 13:18:25.589315  8258 leader_election.cc:336] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.589779 13778 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.593719 13824 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.594277 13824 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.596571 13824 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.571233 13841 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.603259 13813 consensus_queue.cc:1048] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.605445  8295 raft_consensus.cc:2468] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 15.
I20260709 13:18:25.609053 13835 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.609778 13835 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.612761 13627 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.613219 13627 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.615229 13627 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.628671 13835 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.635011 13841 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.636016 13841 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.638067 13841 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:25.635705  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 68273.4us
W20260709 13:18:25.639449  8889 leader_election.cc:336] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.645407  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:25.653524  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:25.654206  8291 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:25.661419  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:25.662076  8362 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:18:25.663558  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:25.664217  8367 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 16.
I20260709 13:18:25.660527  8113 catalog_manager.cc:5697] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a reported cstate change: term changed from 12 to 13, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3). New cstate: current_term: 13 leader_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.650089  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.668728 13847 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.669159 13847 raft_consensus.cc:493] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.669489 13847 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:25.669888  8332 leader_election.cc:336] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.671649  8889 leader_election.cc:304] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.672384 13417 raft_consensus.cc:2804] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:25.676872 13847 raft_consensus.cc:515] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.678984 13847 leader_election.cc:290] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:25.679625  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:25.680389 13845 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.686841  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:25.688601  8921 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 16.
I20260709 13:18:25.686941 13417 raft_consensus.cc:697] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:25.689806 13417 consensus_queue.cc:237] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.694684 13845 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.687992  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.701458 13847 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:25.701840 13847 raft_consensus.cc:493] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.702195 13847 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:25.702993  8258 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.703750 13778 raft_consensus.cc:2749] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:25.704073  8258 leader_election.cc:336] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.703593 13845 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.713060  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:25.713757  8927 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 11.
I20260709 13:18:25.715672 13847 raft_consensus.cc:515] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.720781 13847 leader_election.cc:290] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.724870  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.727396  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3becc403d217418988bb94be41c015e9" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:25.728058  8291 raft_consensus.cc:3060] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.729449  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62f6597a8604eb9b9228657a7c3a7eb" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:25.729979  8293 raft_consensus.cc:3060] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:25.731010 13837 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.731390 13837 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.731743 13837 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.719012  8116 catalog_manager.cc:5697] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 14 to 15, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 15 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.738433 13837 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.740631  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
W20260709 13:18:25.742268  8332 leader_election.cc:336] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.742408  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.743933  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.738790  8293 raft_consensus.cc:2468] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
W20260709 13:18:25.744810  8889 leader_election.cc:336] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.745743  8332 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.747112  8291 raft_consensus.cc:2468] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 15.
I20260709 13:18:25.747756 13417 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.748143 13417 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.748461 13417 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.750118 13841 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:25.750484 13813 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.750548 13841 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.753547 13841 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:25.757709  8332 leader_election.cc:336] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.749094 13839 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:25.752029 13821 raft_consensus.cc:2749] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:25.751122 13813 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.760314 13839 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:18:25.760087  8332 leader_election.cc:336] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.763525  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:25.764340 13813 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.762259 13839 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:25.764746 13845 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
W20260709 13:18:25.769955  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.771502  8889 leader_election.cc:336] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.772286  8889 leader_election.cc:336] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.774417  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:25.775993  8889 leader_election.cc:304] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.777280 13851 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.783010  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
W20260709 13:18:25.784433  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:25.786223 13851 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.788357 13841 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.790457 13841 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.791049 13841 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.791522 13841 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.792436 13847 raft_consensus.cc:2804] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:25.792963 13847 raft_consensus.cc:697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:25.793829 13847 consensus_queue.cc:237] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.788376 13851 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.796387 13813 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.796926 13813 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.797809 13417 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.798810 13813 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:25.770429 13837 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.793434 13841 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.805368  8293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
W20260709 13:18:25.809080  7076 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8241)
I20260709 13:18:25.809240 13417 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.803668  8889 leader_election.cc:304] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.768699 13845 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.823035 13839 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.826771 13839 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:25.814399 13841 raft_consensus.cc:2804] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:25.827802 13841 raft_consensus.cc:697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:25.829206  8293 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ff54842a32a414d8cbb4a3f32527f4a in term 8.
W20260709 13:18:25.839119  8889 leader_election.cc:336] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.839990  8889 leader_election.cc:336] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.855875 13845 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.843472 13851 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.858851 13851 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.860893 13851 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:25.861018  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:25.861677  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.862342  8332 leader_election.cc:336] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.862813  8332 leader_election.cc:336] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.863560  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:25.864177  8291 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 14.
I20260709 13:18:25.864738  8258 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.866986 13845 raft_consensus.cc:2749] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:25.869477  8332 leader_election.cc:336] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.869812  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.870110  8332 leader_election.cc:336] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.870415  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.870792  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.870914  8258 leader_election.cc:336] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.877863  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:25.884497  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 53907us
I20260709 13:18:25.889310  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" is_pre_election: true
I20260709 13:18:25.889659 13856 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.889997  8291 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:18:25.890223 13856 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.892462 13856 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.872066 13841 consensus_queue.cc:237] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:25.900939  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:25.910807  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:25.911402  8368 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 8.
I20260709 13:18:25.911919  8927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:25.912667  8927 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 17: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:25.913307  8261 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.914016  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17"
I20260709 13:18:25.916559  8921 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8ff54842a32a414d8cbb4a3f32527f4a in current term 12: Already voted for candidate d03eaa3ce81042f9b114cd00a7f41b17 in this term.
I20260709 13:18:25.917817  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:25.917917  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:25.918414  8368 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 10.
I20260709 13:18:25.919689  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:25.920372  8368 raft_consensus.cc:2393] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 17: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
W20260709 13:18:25.920665  8889 leader_election.cc:336] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.921756  8889 leader_election.cc:336] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.922290  8367 raft_consensus.cc:2393] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d03eaa3ce81042f9b114cd00a7f41b17 in current term 12: Already voted for candidate 8ff54842a32a414d8cbb4a3f32527f4a in this term.
I20260709 13:18:25.923794  8332 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
W20260709 13:18:25.924341  8889 leader_election.cc:336] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.927857 13821 raft_consensus.cc:2749] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:25.915043 13847 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.917919 13799 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:25.931294  8889 leader_election.cc:336] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:25.944530  8113 catalog_manager.cc:5697] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 13 to 14, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 14 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.951371  8332 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.931929 13799 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.953150 13627 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.953177 13799 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.931790 13847 raft_consensus.cc:493] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.961567 13847 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.962217 13799 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.964282 13799 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:25.966864  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadd35a48bd34475b97994ba7c427ae5" candidate_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:25.967491  8367 raft_consensus.cc:3060] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.973362  8332 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:25.974692 13813 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:25.974257  8116 catalog_manager.cc:5697] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 14 to 15, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 15 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:25.975450  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:25.981264  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.982393  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.982870 13855 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:25.983309 13855 raft_consensus.cc:493] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:25.983472  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.983572 13856 raft_consensus.cc:2749] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.983667 13855 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:25.984633  8258 leader_election.cc:336] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:25.985265  8258 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:25.987888  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:25.989424  8367 raft_consensus.cc:2468] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cf23888b4fe42b594b9443ae6ee9cd2 in term 9.
I20260709 13:18:25.990688  8261 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:25.991918 13859 raft_consensus.cc:2804] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:25.992481 13859 raft_consensus.cc:697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Becoming Leader. State: Replica: 4cf23888b4fe42b594b9443ae6ee9cd2, State: Running, Role: LEADER
I20260709 13:18:25.993314 13859 consensus_queue.cc:237] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:25.993273  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:26.003386  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:26.004086  8367 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
I20260709 13:18:26.010885  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:26.016680 13862 raft_consensus.cc:2764] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:18:26.023134  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.023319 13861 log.cc:927] Time spent T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:18:25.979889 13847 raft_consensus.cc:515] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:26.024674 13855 raft_consensus.cc:515] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:26.025554 13847 leader_election.cc:290] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:26.026985 13855 leader_election.cc:290] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:26.028184  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 44796.3us
W20260709 13:18:26.030102  8889 leader_election.cc:336] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:26.030967  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.031661  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:26.032218 13851 raft_consensus.cc:2749] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:26.032289 13841 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:26.033468 13841 raft_consensus.cc:493] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:26.033852 13841 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:26.042057  8291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5da6736db6d7413682f6b3e035ca2084" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:26.042656  8291 raft_consensus.cc:3060] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:26.050657  8921 raft_consensus.cc:1275] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:18:26.053220  8889 leader_election.cc:336] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:26.053822  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.054836  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:26.072597  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.071419  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.071967  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 48896.7us
W20260709 13:18:26.080988  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:26.056663  8291 raft_consensus.cc:2468] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 15.
I20260709 13:18:26.108233 13841 raft_consensus.cc:515] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:26.115876 13841 leader_election.cc:290] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:26.160966  8295 raft_consensus.cc:1275] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:18:26.162097  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 68103.2us
I20260709 13:18:26.172358 13859 consensus_queue.cc:1048] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:18:26.174350  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:26.177047  8368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe43428b7ca43928b7eeb8cce815e8d" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
W20260709 13:18:26.177541  8892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 85893.1us
I20260709 13:18:26.178527  8362 raft_consensus.cc:1275] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:26.178750  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:26.177623  8368 raft_consensus.cc:3060] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:26.184719 13854 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:26.185160 13854 raft_consensus.cc:493] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9e95b04d03d241329435b6d08dd1f236)
I20260709 13:18:26.185567 13854 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:26.190704  8368 raft_consensus.cc:2468] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 11.
W20260709 13:18:26.196887  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.197504  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:26.198441 13854 raft_consensus.cc:515] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:26.207396  8116 catalog_manager.cc:5697] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 reported cstate change: term changed from 8 to 9, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2). New cstate: current_term: 9 leader_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.213023  8295 raft_consensus.cc:1275] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Refusing update from remote peer 8ff54842a32a414d8cbb4a3f32527f4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:18:26.227833 13854 leader_election.cc:290] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:26.179858  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.230531  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 84170us
W20260709 13:18:26.232795  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 52972.3us
W20260709 13:18:26.233282  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:26.233254  8889 leader_election.cc:304] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:26.236939 13857 raft_consensus.cc:2804] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:26.237475 13857 raft_consensus.cc:697] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:26.238355 13857 consensus_queue.cc:237] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:26.241199 13417 consensus_queue.cc:1048] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:26.246243  8892 leader_election.cc:304] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:26.248260 13856 raft_consensus.cc:2804] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:26.248791 13856 raft_consensus.cc:697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:26.249670 13856 consensus_queue.cc:237] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:26.269974  8295 raft_consensus.cc:1275] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:26.272099  8295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c999e73d071475d9e848e7e83e79be3" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2"
I20260709 13:18:26.272712  8295 raft_consensus.cc:3060] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:26.284910  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:26.285535 13838 consensus_queue.cc:1048] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:26.298363  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "133eb5f61ebc499ab283df4c068d5be7" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:26.299188  8367 raft_consensus.cc:3060] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:26.283043 13837 consensus_queue.cc:1048] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:18:26.308399  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.311573  8367 raft_consensus.cc:2468] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:18:26.312109  8295 raft_consensus.cc:2468] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:18:26.325917  8892 leader_election.cc:304] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 
I20260709 13:18:26.331938 13841 raft_consensus.cc:2804] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:26.332527 13841 raft_consensus.cc:697] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:26.333417 13841 consensus_queue.cc:237] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:26.334561  8889 leader_election.cc:336] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:26.373975  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 88559.8us
W20260709 13:18:26.375262  8889 leader_election.cc:336] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:26.388798  8293 raft_consensus.cc:1275] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:18:26.396123 13865 log.cc:927] Time spent T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:18:26.397786 13868 log.cc:927] Time spent T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.053s	user 0.004s	sys 0.000s
W20260709 13:18:26.413384  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.414108  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.414753  8889 leader_election.cc:336] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:26.421218  8116 catalog_manager.cc:5697] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 14 to 15, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 15 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.433357  8368 raft_consensus.cc:1275] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Refusing update from remote peer 4cf23888b4fe42b594b9443ae6ee9cd2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:26.443712 13417 consensus_queue.cc:1048] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:26.445016  8889 leader_election.cc:304] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:26.453030 13851 raft_consensus.cc:2804] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:26.453547 13851 raft_consensus.cc:697] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:26.454430 13851 consensus_queue.cc:237] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:26.456696 13417 consensus_queue.cc:1048] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:26.441910 13860 consensus_queue.cc:1048] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:18:26.460726 13869 log.cc:927] Time spent T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: Append to log took a long time: real 0.082s	user 0.001s	sys 0.002s
W20260709 13:18:26.535593  8889 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 78396.2us
I20260709 13:18:26.537724  8115 catalog_manager.cc:5697] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 12, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 12 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.540004  8115 catalog_manager.cc:5697] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 10 to 11, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 11 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:26.557729  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:26.564782  8889 leader_election.cc:336] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:26.595117  8293 raft_consensus.cc:1275] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:18:26.608245  8258 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:26.616813  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:42491, user_credentials={real_user=slave}} blocked reactor thread for 95320.5us
I20260709 13:18:26.617672  8115 catalog_manager.cc:5697] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 12, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 12 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:26.622759  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.633289 13417 consensus_queue.cc:1048] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:18:26.700169 13876 log.cc:927] Time spent T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:18:26.702925  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:26.707500  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:26.707569  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 54888.1us
I20260709 13:18:26.713635  8292 raft_consensus.cc:1275] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:26.729249 13855 consensus_queue.cc:1048] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:26.761583  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.788765  8367 raft_consensus.cc:1275] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:18:26.809667  7076 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:26.815451  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.880756 13856 consensus_queue.cc:1048] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:26.955793  8362 raft_consensus.cc:1275] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:18:26.956267  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:26.979740  8293 raft_consensus.cc:1275] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:26.981485 13856 consensus_queue.cc:1048] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:26.988775 13856 consensus_queue.cc:1048] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:26.997067  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.627238 13841 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.628520 13841 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:27.640246  8889 leader_election.cc:336] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:27.642871  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:27.643666  8362 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 12.
I20260709 13:18:27.644052 13417 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.644568 13417 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:27.647531  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:27.649572 13417 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:27.650966 13417 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:27.651340 13417 raft_consensus.cc:493] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.651634 13417 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.640475 13841 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:27.662451  8889 leader_election.cc:336] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:27.680644 13417 raft_consensus.cc:515] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:27.680928  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
I20260709 13:18:27.683828 13417 leader_election.cc:290] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:27.684258  8362 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 17.
I20260709 13:18:27.685756  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:27.687701 13841 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.688217 13841 raft_consensus.cc:493] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.688596 13841 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:27.689563  8889 leader_election.cc:336] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:27.692289  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:27.686761  8362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bded28881ef4440a713698e8088bd77" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:27.693796  8362 raft_consensus.cc:3060] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.708870  8362 raft_consensus.cc:2468] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 13.
I20260709 13:18:27.722196  8892 leader_election.cc:304] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:27.724670 13417 raft_consensus.cc:2804] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:27.725171 13417 raft_consensus.cc:697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:27.725986 13417 consensus_queue.cc:237] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:27.753512 13841 raft_consensus.cc:515] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:27.768811 13841 leader_election.cc:290] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 election: Requested vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:27.776559  8889 leader_election.cc:336] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:27.800683  8364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c835fd22b7643a981b446089ad74066" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a"
I20260709 13:18:27.801347  8364 raft_consensus.cc:3060] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.804679  8115 catalog_manager.cc:5697] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 11 to 13, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 13 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:27.810181  7076 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8241)
I20260709 13:18:27.812574  8364 raft_consensus.cc:2468] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d03eaa3ce81042f9b114cd00a7f41b17 in term 18.
I20260709 13:18:27.820663  8892 leader_election.cc:304] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a, d03eaa3ce81042f9b114cd00a7f41b17; no voters: 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:27.821838 13896 raft_consensus.cc:2804] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:27.822372 13896 raft_consensus.cc:697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 18 LEADER]: Becoming Leader. State: Replica: d03eaa3ce81042f9b114cd00a7f41b17, State: Running, Role: LEADER
I20260709 13:18:27.823218 13896 consensus_queue.cc:237] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
W20260709 13:18:27.923472  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:28.004227  8115 catalog_manager.cc:5697] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 reported cstate change: term changed from 16 to 18, leader changed from 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1) to d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4). New cstate: current_term: 18 leader_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:28.032886  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.038965  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.064244  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.079116  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.079682  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.115779  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.130472  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.151638  8889 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:28.173605  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.206467  8332 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111) [suppressed 412 similar messages]
W20260709 13:18:28.209803  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:28.225512  8364 raft_consensus.cc:1275] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 18 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:28.229193 13896 consensus_queue.cc:1048] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:18:28.237409  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.262519  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.303217  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.317590  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.335184  8889 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:28.350466  8362 raft_consensus.cc:1275] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Refusing update from remote peer d03eaa3ce81042f9b114cd00a7f41b17: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:28.355105 13899 consensus_queue.cc:1048] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:28.457574  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.484453  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.496919  8332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:40391, user_credentials={real_user=slave}} blocked reactor thread for 71637us
W20260709 13:18:28.530602  8258 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:28.550980  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:28.579831  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.600835  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:28.608176  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.621800  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.629976  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.631860  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.634148  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.649346  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.649942  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.641215  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.671985  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.689121  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.701823  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:28.721956  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:28.742360  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:28.810819  7076 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:28.854334  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.045208  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.060357  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:29.077836  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.081037  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.093168  8258 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.429199  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.477443  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.556610  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:29.811307  7076 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:30.239455  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.387287  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.413280  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.469911  8889 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:30.476085  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.501638  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.508064  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.527209  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.609524  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:30.641099  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.660897  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.678426  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.714550  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.723657  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.752847  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.762128  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:30.783736  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.811017  8889 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:30.811712  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.812153  7076 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:30.821411  8258 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:30.845911  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:30.876979  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.913548  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.915707  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.923120  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.936208  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:30.997172  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.191995  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.210227  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.248590  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.282910  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.310388  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.315980  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.383792  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.388855  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 46652us
W20260709 13:18:31.404640  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.427408  8258 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.462244  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.493598  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.509193  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.579437  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.641314  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:31.646143  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.692742  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.802407  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:31.812593  7076 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:32.027768  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:32.612511  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:32.689117  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:32.813079  7076 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:32.892169  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:32.961735  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:32.974460  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:32.988581  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:32.988807  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.012744  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.029314  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.070483  8889 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:33.086395  8258 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:33.108459  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.122722  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:33.239615  8332 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111) [suppressed 447 similar messages]
W20260709 13:18:33.242373  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:33.264637  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.284623  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.291167  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.317417  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.356949  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:33.376919  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.378659  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.382113  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.424965  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.454993  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.473948  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.474684  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:33.534344  8889 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:33.595153  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:33.642452  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:33.672374  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.730563  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.754879  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.757550  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:33.813592  7076 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:33.863384  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:33.976660  8258 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:34.088383  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:34.088901  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:34.114724  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:34.117000  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:34.248420  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:34.249038  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:34.312340  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:34.363945  8261 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:43697, user_credentials={real_user=slave}} blocked reactor thread for 58582.7us
W20260709 13:18:34.421849  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:34.435853  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:34.625164  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:34.814100  7076 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:35.134920  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.212703  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.292883  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.386762  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.414601  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.445564  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.453433  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.494442  8258 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:35.552479  8889 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:35.554294  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.563721  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.672158  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.694491  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.754047  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.763818  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:35.771341  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:35.802567  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:35.814597  7076 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:35.817832  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.835426  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.896085  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.918795  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.940429  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:35.964708  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:36.029227  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.123577  8889 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:36.136721  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.288916  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.329478  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:36.334884  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:36.335428  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.337570  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:36.338349  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.347963  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.361061  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.404376  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.420637  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:36.470201  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.515889  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:36.524961  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.550918  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.553848  8258 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:36.754988  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:36.815083  7076 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:36.882092  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:36.939324  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:37.195333  8149 debug-util.cc:398] Leaking SignalData structure 0x7b080012f660 after lost signal to thread 7079
W20260709 13:18:37.196578  8149 debug-util.cc:398] Leaking SignalData structure 0x7b0800035620 after lost signal to thread 8152
W20260709 13:18:37.197918  8149 debug-util.cc:398] Leaking SignalData structure 0x7b0800035780 after lost signal to thread 8319
W20260709 13:18:37.199102  8149 debug-util.cc:398] Leaking SignalData structure 0x7b0800035500 after lost signal to thread 8393
W20260709 13:18:37.200342  8149 debug-util.cc:398] Leaking SignalData structure 0x7b08000f5d20 after lost signal to thread 8955
W20260709 13:18:37.519023  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:37.586844  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:37.725317  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:37.749235  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:37.791600  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:37.815856  7076 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:37.846297  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:37.900331  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:37.920542  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:37.951786  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:37.952508  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.047379  8258 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:38.142807  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.166361  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.228271  8889 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:38.260748  8258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111) [suppressed 449 similar messages]
W20260709 13:18:38.269186  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.300194  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.363808  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.368702  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:38.382922  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.415024  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.420231  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.482193  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.551139  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.592512  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:38.597559  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.645165  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.659056  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.667126  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.705410  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:38.721254  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.729672  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:38.816362  7076 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:38.893177  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:38.916388  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.927992  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.929153  8889 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:38.942113  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.956966  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:38.987108  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:38.988015  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:39.030311  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:39.130491  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:39.189705  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:39.328655  8258 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:39.434231  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:39.605355  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:39.816855  7076 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:39.889734  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:40.025516  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.032364  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.220623  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.234629  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.282510  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.286746  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.408447  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.411996  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:40.503010  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.554062  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:40.656591  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.755939  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.817473  7076 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:40.898177  8258 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:40.898886  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.899430  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.927904  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.968106  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.976630  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.979116  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:40.997452  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.037825  8889 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:41.043882  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:41.118290  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.153504  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:41.173990  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:41.229473  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.280332  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.303228  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.322341  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:41.366351  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.370450  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.377267  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.422564  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.445926  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:41.451881  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.457741  8889 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:41.524886  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.528292  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:41.551397  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.600723  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:41.666325  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:41.711313  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003315e0 after lost signal to thread 7079
W20260709 13:18:41.713503  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08000be700 after lost signal to thread 8152
W20260709 13:18:41.714826  8316 debug-util.cc:398] Leaking SignalData structure 0x7b08003ad0a0 after lost signal to thread 8319
W20260709 13:18:41.715965  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080008f6e0 after lost signal to thread 8393
W20260709 13:18:41.717391  8316 debug-util.cc:398] Leaking SignalData structure 0x7b080031be20 after lost signal to thread 8955
W20260709 13:18:41.726663  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:41.818005  7076 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:41.955720  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:42.124614  8258 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:42.594681  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:42.708657  8258 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43925, user_credentials={real_user=slave}} blocked reactor thread for 79489us
W20260709 13:18:42.818521  7076 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:42.824978  8258 consensus_peers.cc:597] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:42.929289  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:42.948822  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:42.951175  8258 consensus_peers.cc:597] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:42.951777  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:42.956646  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:42.979122  8258 consensus_peers.cc:597] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:42.982239  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:42.991359  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:43.036418  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.131323  8258 consensus_peers.cc:597] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.138768  8258 consensus_peers.cc:597] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.269783  8258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111) [suppressed 446 similar messages]
W20260709 13:18:43.273074  8258 consensus_peers.cc:597] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:43.316917  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:43.374785  8258 consensus_peers.cc:597] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.389596  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.497404  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.534192  8258 consensus_peers.cc:597] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.601439  8889 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:43.635166  8258 consensus_peers.cc:597] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.723017  8258 consensus_peers.cc:597] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.746590  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.747190  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.747620  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:43.748025  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.748992  8258 consensus_peers.cc:597] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.818995  7076 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 8241)
W20260709 13:18:43.831565  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.843824  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:43.844630  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.866878  8889 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:18:43.902801  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:43.903342  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:43.917484  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:43.918056  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:43.938244  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:43.968829  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:44.005605  8258 consensus_peers.cc:597] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:44.036676  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:44.114543  8258 consensus_peers.cc:597] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:44.127920  8258 consensus_peers.cc:597] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:44.142738  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:44.248420  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:44.420280  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:44.731118  8258 consensus_peers.cc:597] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:44.838287  7076 tablet_server.cc:196] TabletServer@127.6.233.1:0 shutdown complete.
I20260709 13:18:44.988895  7076 tablet_server.cc:179] TabletServer@127.6.233.2:0 shutting down...
W20260709 13:18:45.017457  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.027637  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.065161  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:45.067734  7076 tablet_replica.cc:333] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.069633  7076 raft_consensus.cc:2243] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.070736  7076 raft_consensus.cc:2272] T 53535408ea514f8db7292852927e7743 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.072916  7076 tablet_replica.cc:333] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.073505  7076 raft_consensus.cc:2243] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.074366  7076 raft_consensus.cc:2272] T 73873ecf3459400d839d6e8c0d8743b4 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.076771  7076 tablet_replica.cc:333] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.078615  7076 raft_consensus.cc:2243] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.079684  7076 raft_consensus.cc:2272] T eacbb7965099474082590e4b50221087 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.082130  7076 tablet_replica.cc:333] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.082857  7076 raft_consensus.cc:2243] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.083854  7076 raft_consensus.cc:2272] T e36ea2a6e04a442397de5d29398d0314 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.085672  7076 tablet_replica.cc:333] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.086272  7076 raft_consensus.cc:2243] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.086766  7076 raft_consensus.cc:2272] T 1924d44c50904ed09f8f93dd9b4928ca P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.088878  7076 tablet_replica.cc:333] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.089412  7076 raft_consensus.cc:2243] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.090015  7076 raft_consensus.cc:2272] T 282a740dc06c41f0b77f4880423e4395 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.091845  7076 tablet_replica.cc:333] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.092397  7076 raft_consensus.cc:2243] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.092938  7076 raft_consensus.cc:2272] T 509edc927d524436b819a0e96e615799 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.095744  7076 tablet_replica.cc:333] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.097589  7076 raft_consensus.cc:2243] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.098256  7076 raft_consensus.cc:2272] T a15d60ee93c04debb4b2f6a595555fbb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.100977  7076 tablet_replica.cc:333] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.101781  7076 raft_consensus.cc:2243] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.103202  7076 raft_consensus.cc:2272] T 0e9e53d1d8204518834e32e1ef952157 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.104920  8332 consensus_peers.cc:597] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:45.105863  7076 tablet_replica.cc:333] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.106559  7076 raft_consensus.cc:2243] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.107398  7076 raft_consensus.cc:2272] T 55586274911e4f2eb326f0741d200c17 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.109474  7076 tablet_replica.cc:333] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.110198  7076 raft_consensus.cc:2243] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.111256  7076 raft_consensus.cc:2272] T 749a008ddc4d4f31a1bcd1a446b5916d P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.113963  7076 tablet_replica.cc:333] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.114760  7076 raft_consensus.cc:2243] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.115283  7076 raft_consensus.cc:2272] T 62e8a922b99844e085b2b1e126cfb02e P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.116379  8889 consensus_peers.cc:597] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.117870  7076 tablet_replica.cc:333] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.118685  7076 raft_consensus.cc:2243] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.119417  7076 raft_consensus.cc:2272] T 7ac72d56568b4857a1bd70aadbb026c1 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.119837  8332 consensus_peers.cc:597] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:45.121747  7076 tablet_replica.cc:333] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.122367  7076 raft_consensus.cc:2243] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.122968  7076 raft_consensus.cc:2272] T 1a722bdfa4d04d60b64682ee5868136f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.125061  7076 tablet_replica.cc:333] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.125645  7076 raft_consensus.cc:2243] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.126137  7076 raft_consensus.cc:2272] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.128512  7076 tablet_replica.cc:333] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.129252  7076 raft_consensus.cc:2243] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.130348  7076 raft_consensus.cc:2272] T 8d3403855d4147a9b056dc8678880fdf P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.132776  7076 tablet_replica.cc:333] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.133515  7076 raft_consensus.cc:2243] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.134259  7076 raft_consensus.cc:2272] T bd269c56db8748ddba9b5528d4c49916 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.136474  7076 tablet_replica.cc:333] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.137173  7076 raft_consensus.cc:2243] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.137705  7076 raft_consensus.cc:2272] T be0d0091520f4d6ea7668120e21a6aa0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.140417  7076 tablet_replica.cc:333] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.140978  7076 raft_consensus.cc:2243] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.142081  7076 raft_consensus.cc:2272] T 1f62e72429d24920b32bee17b0d2aadd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.144541  7076 tablet_replica.cc:333] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.145265  7076 raft_consensus.cc:2243] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:45.145624  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.145929  7076 raft_consensus.cc:2272] T 7a81beec7fc64c498918eb3ea356d2c7 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.149794  7076 tablet_replica.cc:333] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.150629  7076 raft_consensus.cc:2243] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.151537  7076 raft_consensus.cc:2272] T 3becc403d217418988bb94be41c015e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.154134  7076 tablet_replica.cc:333] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.154871  7076 raft_consensus.cc:2243] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.156009  7076 raft_consensus.cc:2272] T 29a17bfa374c4aa6a25b919a48f0583c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.157896  8332 consensus_peers.cc:597] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.159590  7076 tablet_replica.cc:333] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.160357  7076 raft_consensus.cc:2243] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.161527  7076 raft_consensus.cc:2272] T d81288332c1b4610a2fe2b09dba77503 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.162693  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.164122  7076 tablet_replica.cc:333] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.164938  7076 raft_consensus.cc:2243] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.165539  7076 raft_consensus.cc:2272] T f62f6597a8604eb9b9228657a7c3a7eb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.166980  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.168085  7076 tablet_replica.cc:333] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.168874  7076 raft_consensus.cc:2243] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:45.170707  8332 consensus_peers.cc:597] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.171193  7076 raft_consensus.cc:2272] T 5da6736db6d7413682f6b3e035ca2084 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.171132  8889 consensus_peers.cc:597] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.174240  7076 tablet_replica.cc:333] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
W20260709 13:18:45.174155  8332 consensus_peers.cc:597] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.175104  7076 raft_consensus.cc:2243] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.175701  7076 raft_consensus.cc:2272] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.178386  7076 tablet_replica.cc:333] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.179113  7076 raft_consensus.cc:2243] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.180230  7076 raft_consensus.cc:2272] T 019e9c29effc40928d5f5e795b8aeed0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.182647  7076 tablet_replica.cc:333] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.183284  7076 raft_consensus.cc:2243] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:45.183959  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.184381  7076 raft_consensus.cc:2272] T ee0be2dae2824fd89d658f949f717dfc P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.186683  7076 tablet_replica.cc:333] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.187310  7076 raft_consensus.cc:2243] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.187796  7076 raft_consensus.cc:2272] T 47a3ff85da594e17a687e7c116983565 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.190209  7076 tablet_replica.cc:333] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.190824  7076 raft_consensus.cc:2243] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.191303  7076 raft_consensus.cc:2272] T ff5614e6d15c446ba2addddda765efdd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.193873  7076 tablet_replica.cc:333] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.194676  7076 raft_consensus.cc:2243] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.195415  7076 raft_consensus.cc:2272] T b7f77585d3144b70a0f742dcd66411d0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.195979  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.199004  7076 tablet_replica.cc:333] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.199890  7076 raft_consensus.cc:2243] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.200846  7076 raft_consensus.cc:2272] T eadd35a48bd34475b97994ba7c427ae5 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.202839  7076 tablet_replica.cc:333] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.203367  7076 raft_consensus.cc:2243] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.203827  7076 raft_consensus.cc:2272] T 83404a77373349799a8b3ee06b2a7ccd P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.205694  7076 tablet_replica.cc:333] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.206321  7076 raft_consensus.cc:2243] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.207198  7076 raft_consensus.cc:2272] T ef2eafec27ce4eb48cfb13c576f7cefb P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.209081  7076 tablet_replica.cc:333] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.209785  7076 raft_consensus.cc:2243] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.210359  7076 raft_consensus.cc:2272] T 3caa82d776714435898936cb4c6041c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.211488  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.213874  7076 tablet_replica.cc:333] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
W20260709 13:18:45.213901  8889 consensus_peers.cc:597] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.214898  7076 raft_consensus.cc:2243] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.216539  7076 raft_consensus.cc:2272] T afeb2f98236845469440c44ada463b5c P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.219115  7076 tablet_replica.cc:333] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.219887  7076 raft_consensus.cc:2243] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.220534  7076 raft_consensus.cc:2272] T 7feffaf779354992809fb6a460399626 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.221163  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:45.222816  7076 tablet_replica.cc:333] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.223625  7076 raft_consensus.cc:2243] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.224825  7076 raft_consensus.cc:2272] T 7dca780f49cb4f62912f333b3185e48f P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.225672  8889 consensus_peers.cc:597] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.227246  7076 tablet_replica.cc:333] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.228096  7076 raft_consensus.cc:2243] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.228668  7076 raft_consensus.cc:2272] T c4b32c39d3034dc0b1e48b0daa2308c0 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.230981  7076 tablet_replica.cc:333] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.231650  7076 raft_consensus.cc:2243] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.232689  7076 raft_consensus.cc:2272] T a7984a0dbb5d4008936cec86daf790e9 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.235195  7076 tablet_replica.cc:333] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.235883  7076 raft_consensus.cc:2243] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.236876  7076 raft_consensus.cc:2272] T 3c999e73d071475d9e848e7e83e79be3 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.238420  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.240856  8332 consensus_peers.cc:597] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.239373  7076 tablet_replica.cc:333] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.253110  7076 raft_consensus.cc:2243] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.253697  7076 raft_consensus.cc:2272] T 46e06d1a840c4315837a871dc31b4497 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.256687  7076 tablet_replica.cc:333] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.257316  7076 raft_consensus.cc:2243] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.258173  7076 raft_consensus.cc:2272] T 8942278c55614601a1290e32997fe007 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.260077  7076 tablet_replica.cc:333] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.260538  7076 raft_consensus.cc:2243] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.261384  7076 raft_consensus.cc:2272] T c802b19bdf2e4f69b169d31056091820 P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.263164  7076 tablet_replica.cc:333] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2: stopping tablet replica
I20260709 13:18:45.263629  7076 raft_consensus.cc:2243] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.264137  7076 raft_consensus.cc:2272] T caf02b6ca7a34be9bbac5771e91f767a P 4cf23888b4fe42b594b9443ae6ee9cd2 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.291990  8332 consensus_peers.cc:597] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.292917  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.295272  8332 consensus_peers.cc:597] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.304837  8889 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:45.305188  8332 consensus_peers.cc:597] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.323371  8332 consensus_peers.cc:597] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:45.362545  8889 consensus_peers.cc:597] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.371070  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.413225  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.425021  8889 consensus_peers.cc:597] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.447211  8889 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:45.456244  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.462481  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.509859  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.596009  8889 consensus_peers.cc:597] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:45.601282  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:45.686753  8332 consensus_peers.cc:597] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:45.698132  8889 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:18:46.011519 13977 raft_consensus.cc:493] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.013374 13977 raft_consensus.cc:515] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.015812 13977 leader_election.cc:290] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.023464  8889 leader_election.cc:336] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:46.024094  8332 consensus_peers.cc:597] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:46.024991  8889 leader_election.cc:336] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.025460  8889 leader_election.cc:304] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.026188 13977 raft_consensus.cc:2749] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:46.033947  8332 consensus_peers.cc:597] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:46.055347  8332 consensus_peers.cc:597] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:46.080642  8889 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:46.084170 13970 raft_consensus.cc:493] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.084774 13970 raft_consensus.cc:515] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:46.086935 13970 leader_election.cc:290] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.093421  8889 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:46.094204  8332 leader_election.cc:336] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:46.098953  8332 leader_election.cc:336] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.099922  8332 leader_election.cc:304] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.100718 13970 raft_consensus.cc:2749] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:46.156335  8889 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:46.180615 13970 raft_consensus.cc:493] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.181149 13970 raft_consensus.cc:515] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:46.183166 13970 leader_election.cc:290] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.197028  8332 leader_election.cc:336] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:46.197743  8332 leader_election.cc:336] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.198711  8332 leader_election.cc:304] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.199884 13970 raft_consensus.cc:2749] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:46.200559  8889 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:18:46.234737  8889 consensus_peers.cc:597] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:46.245083  7076 tablet_server.cc:196] TabletServer@127.6.233.2:0 shutdown complete.
I20260709 13:18:46.257073 13977 raft_consensus.cc:493] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.257601 13977 raft_consensus.cc:515] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.260255 13977 leader_election.cc:290] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:46.262470  8367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a17bfa374c4aa6a25b919a48f0583c" candidate_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" is_pre_election: true
W20260709 13:18:46.264925  8889 leader_election.cc:336] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.265419  8889 leader_election.cc:304] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:46.265489 13975 raft_consensus.cc:493] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.266110 13975 raft_consensus.cc:515] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:46.268581 13975 leader_election.cc:290] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:46.269527 13977 raft_consensus.cc:2749] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:46.271548 13977 raft_consensus.cc:493] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.272152 13977 raft_consensus.cc:515] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.276968 13977 leader_election.cc:290] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.280745  8332 leader_election.cc:336] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
W20260709 13:18:46.281762  8889 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:46.282532  8332 leader_election.cc:336] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:46.283392  8332 leader_election.cc:304] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.284776 13975 raft_consensus.cc:2749] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:46.288530  8889 leader_election.cc:336] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:46.291165  8889 leader_election.cc:336] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
W20260709 13:18:46.291297  8332 consensus_peers.cc:597] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:46.291806  8889 leader_election.cc:304] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.292632 13977 raft_consensus.cc:2749] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:46.304031  8332 consensus_peers.cc:597] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:46.307116  8889 consensus_peers.cc:597] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:46.314852 13972 raft_consensus.cc:493] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.315387 13972 raft_consensus.cc:515] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.317430 13972 leader_election.cc:290] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:46.324262 13975 raft_consensus.cc:493] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.324888 13975 raft_consensus.cc:515] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:46.327052 13975 leader_election.cc:290] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:46.331782 13970 raft_consensus.cc:493] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.332350 13970 raft_consensus.cc:515] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:46.334903 13970 leader_election.cc:290] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.337726  8889 leader_election.cc:336] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:46.338523 13970 raft_consensus.cc:493] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
W20260709 13:18:46.338452  8889 leader_election.cc:336] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.339133 13970 raft_consensus.cc:515] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:46.342072  8889 leader_election.cc:304] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.342973 13972 raft_consensus.cc:2749] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:46.353009 13970 leader_election.cc:290] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.353832  8332 leader_election.cc:336] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
W20260709 13:18:46.356241  8332 leader_election.cc:336] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:46.356700  8332 leader_election.cc:304] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.358719 13970 raft_consensus.cc:2749] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:46.363399  8332 leader_election.cc:336] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
W20260709 13:18:46.364192  8332 leader_election.cc:336] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:46.364522  8332 leader_election.cc:304] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.365134 13970 raft_consensus.cc:2749] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:46.370712  8332 leader_election.cc:336] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:46.371795  8332 leader_election.cc:336] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.372256  8332 leader_election.cc:304] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.376242 13970 raft_consensus.cc:2749] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:46.383457 13977 raft_consensus.cc:493] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.384025 13977 raft_consensus.cc:515] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.386152 13977 leader_election.cc:290] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
I20260709 13:18:46.383965  7076 tablet_server.cc:179] TabletServer@127.6.233.3:0 shutting down...
W20260709 13:18:46.393608  8889 leader_election.cc:336] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:46.394384  8889 leader_election.cc:336] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.394850  8889 leader_election.cc:304] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.396174 13975 raft_consensus.cc:493] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.396435 13977 raft_consensus.cc:2749] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:46.396716 13975 raft_consensus.cc:515] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:46.398579 13975 leader_election.cc:290] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.400995  8892 consensus_peers.cc:597] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.401968  8332 consensus_peers.cc:597] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:18:46.405838  8892 consensus_peers.cc:597] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.406518  8332 leader_election.cc:336] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
W20260709 13:18:46.409431  8332 leader_election.cc:336] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:46.409868  8332 leader_election.cc:304] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.410576 13975 raft_consensus.cc:2749] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:46.416242  8892 consensus_peers.cc:597] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.416882 13975 raft_consensus.cc:493] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.417466 13975 raft_consensus.cc:515] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } }
I20260709 13:18:46.419535 13975 leader_election.cc:290] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.416993  8889 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:46.427234  8892 consensus_peers.cc:597] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.431308  8332 leader_election.cc:336] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
W20260709 13:18:46.433648  8892 consensus_peers.cc:597] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.434509  8332 leader_election.cc:336] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:46.434988  8332 leader_election.cc:304] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.435698 13975 raft_consensus.cc:2749] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:46.444633  8889 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:46.445102 13972 raft_consensus.cc:493] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.445761 13972 raft_consensus.cc:515] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.450577 13972 leader_election.cc:290] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.452775  8892 consensus_peers.cc:597] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.455993  8889 leader_election.cc:336] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:46.457021  8889 leader_election.cc:336] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.457432  8889 leader_election.cc:304] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.458143 13972 raft_consensus.cc:2749] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:46.464224 13972 raft_consensus.cc:493] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.464785 13972 raft_consensus.cc:515] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.469271 13972 leader_election.cc:290] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.473678  8889 leader_election.cc:336] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
I20260709 13:18:46.474295  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:46.475638  7076 tablet_replica.cc:333] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.476519  7076 raft_consensus.cc:2243] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.478073  7076 raft_consensus.cc:2272] T cf2b3e0ac13b4eaf94a555cbea2ea41d P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.481107  7076 tablet_replica.cc:333] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.481854  7076 raft_consensus.cc:2243] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:46.481900  8889 leader_election.cc:336] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.482527  7076 raft_consensus.cc:2272] T 73873ecf3459400d839d6e8c0d8743b4 P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:46.482589  8892 consensus_peers.cc:597] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.482542  8889 leader_election.cc:304] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.484161 13977 raft_consensus.cc:2749] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:46.485365  7076 tablet_replica.cc:333] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.486095  7076 raft_consensus.cc:2243] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.487031  7076 raft_consensus.cc:2272] T 5da27e18b189452598381f95fe6f22cf P 8ff54842a32a414d8cbb4a3f32527f4a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.489523  7076 tablet_replica.cc:333] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.490337  7076 raft_consensus.cc:2243] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.490938  7076 raft_consensus.cc:2272] T afeb2f98236845469440c44ada463b5c P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.493523  7076 tablet_replica.cc:333] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
W20260709 13:18:46.494043  8332 consensus_peers.cc:597] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:46.494148  7076 raft_consensus.cc:2243] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.494832  7076 raft_consensus.cc:2272] T eacbb7965099474082590e4b50221087 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.496819  7076 tablet_replica.cc:333] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.497375  7076 raft_consensus.cc:2243] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.497833  7076 raft_consensus.cc:2272] T e36ea2a6e04a442397de5d29398d0314 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.499699  7076 tablet_replica.cc:333] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.500322  7076 raft_consensus.cc:2243] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.501155  7076 raft_consensus.cc:2272] T 1924d44c50904ed09f8f93dd9b4928ca P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.503106  7076 tablet_replica.cc:333] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.503629  7076 raft_consensus.cc:2243] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.504033  7076 raft_consensus.cc:2272] T fea6012070404ef6b810517d977625da P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.505820  7076 tablet_replica.cc:333] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.506397  7076 raft_consensus.cc:2243] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.506973  7076 raft_consensus.cc:2272] T 282a740dc06c41f0b77f4880423e4395 P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.508853  7076 tablet_replica.cc:333] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.509418  7076 raft_consensus.cc:2243] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.509883  7076 raft_consensus.cc:2272] T 509edc927d524436b819a0e96e615799 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.511814  7076 tablet_replica.cc:333] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.512398  7076 raft_consensus.cc:2243] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.513219  7076 raft_consensus.cc:2272] T a15d60ee93c04debb4b2f6a595555fbb P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.515167  7076 tablet_replica.cc:333] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.515687  7076 raft_consensus.cc:2243] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.516181  7076 raft_consensus.cc:2272] T 64f8ae67f51c4ec482dada7787dc153e P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.518863  7076 tablet_replica.cc:333] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.519546  7076 raft_consensus.cc:2243] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.520100  7076 raft_consensus.cc:2272] T 749a008ddc4d4f31a1bcd1a446b5916d P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.522373  7076 tablet_replica.cc:333] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.522927  7076 raft_consensus.cc:2243] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.523681  7076 raft_consensus.cc:2272] T 62e8a922b99844e085b2b1e126cfb02e P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.525588  7076 tablet_replica.cc:333] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.526094  7076 raft_consensus.cc:2243] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.526535  7076 raft_consensus.cc:2272] T 57b9174dc54540e597799ccc6b10b419 P 8ff54842a32a414d8cbb4a3f32527f4a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.528518  7076 tablet_replica.cc:333] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.529063  7076 raft_consensus.cc:2243] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.529944  7076 raft_consensus.cc:2272] T 1a722bdfa4d04d60b64682ee5868136f P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.532148  7076 tablet_replica.cc:333] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.532867  7076 raft_consensus.cc:2243] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.533921  7076 raft_consensus.cc:2272] T 4c96431d125f4d169be8f25647f9371e P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.536284  7076 tablet_replica.cc:333] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.537034  7076 raft_consensus.cc:2243] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:18:46.537338  8892 consensus_peers.cc:597] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.537955  7076 raft_consensus.cc:2272] T 8d3403855d4147a9b056dc8678880fdf P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.540270  7076 tablet_replica.cc:333] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.540803  7076 raft_consensus.cc:2243] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.542038  7076 raft_consensus.cc:2272] T bd269c56db8748ddba9b5528d4c49916 P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.544461  7076 tablet_replica.cc:333] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.544963  7076 raft_consensus.cc:2243] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.545985  7076 raft_consensus.cc:2272] T be0d0091520f4d6ea7668120e21a6aa0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:46.547745  8889 consensus_peers.cc:597] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:18:46.548403  7076 tablet_replica.cc:333] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.549093  7076 raft_consensus.cc:2243] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.549546  7076 raft_consensus.cc:2272] T 1f62e72429d24920b32bee17b0d2aadd P 8ff54842a32a414d8cbb4a3f32527f4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.551489  7076 tablet_replica.cc:333] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.552134  7076 raft_consensus.cc:2243] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.552558  7076 raft_consensus.cc:2272] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.554559  7076 tablet_replica.cc:333] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.555086  7076 raft_consensus.cc:2243] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.555670  7076 raft_consensus.cc:2272] T 133eb5f61ebc499ab283df4c068d5be7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.557955 13975 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.558259  7076 tablet_replica.cc:333] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.558920  7076 raft_consensus.cc:2243] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.558449 13975 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.559953  7076 raft_consensus.cc:2272] T 7a81beec7fc64c498918eb3ea356d2c7 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.562366  7076 tablet_replica.cc:333] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.563032  7076 raft_consensus.cc:2243] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.563542  7076 raft_consensus.cc:2272] T 5bded28881ef4440a713698e8088bd77 P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.563809 13975 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), d03eaa3ce81042f9b114cd00a7f41b17 (127.6.233.4:42491)
I20260709 13:18:46.566040  8928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dca780f49cb4f62912f333b3185e48f" candidate_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" is_pre_election: true
I20260709 13:18:46.567955  7076 tablet_replica.cc:333] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.568838  7076 raft_consensus.cc:2243] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:46.569398  8892 consensus_peers.cc:597] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.569612  7076 raft_consensus.cc:2272] T 4c835fd22b7643a981b446089ad74066 P 8ff54842a32a414d8cbb4a3f32527f4a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:46.570071  8332 leader_election.cc:336] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.570533  8332 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8ff54842a32a414d8cbb4a3f32527f4a; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, d03eaa3ce81042f9b114cd00a7f41b17
I20260709 13:18:46.571225 13975 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:46.573714  7076 tablet_replica.cc:333] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.574548  7076 raft_consensus.cc:2243] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.575099  7076 raft_consensus.cc:2272] T 29a17bfa374c4aa6a25b919a48f0583c P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.577775  7076 tablet_replica.cc:333] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.578403  7076 raft_consensus.cc:2243] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.578974  7076 raft_consensus.cc:2272] T c4b32c39d3034dc0b1e48b0daa2308c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.581482  7076 tablet_replica.cc:333] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.582013  7076 raft_consensus.cc:2243] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.582738  7076 raft_consensus.cc:2272] T 7dca780f49cb4f62912f333b3185e48f P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.584712  7076 tablet_replica.cc:333] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.585234  7076 raft_consensus.cc:2243] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.585678  7076 raft_consensus.cc:2272] T cfe43428b7ca43928b7eeb8cce815e8d P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.587493  7076 tablet_replica.cc:333] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.587986  7076 raft_consensus.cc:2243] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.588896  7076 raft_consensus.cc:2272] T 48e600fe8a934349bb2d4d18d10815a6 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.591500  7076 tablet_replica.cc:333] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.592283  7076 raft_consensus.cc:2243] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.593555  7076 raft_consensus.cc:2272] T e1ab3ddb872e454ab0de56eb9ba4ccf3 P 8ff54842a32a414d8cbb4a3f32527f4a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.596065  7076 tablet_replica.cc:333] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.596705  7076 raft_consensus.cc:2243] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.597261  7076 raft_consensus.cc:2272] T eadd35a48bd34475b97994ba7c427ae5 P 8ff54842a32a414d8cbb4a3f32527f4a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.599684  7076 tablet_replica.cc:333] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.600309  7076 raft_consensus.cc:2243] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.601181  7076 raft_consensus.cc:2272] T 83404a77373349799a8b3ee06b2a7ccd P 8ff54842a32a414d8cbb4a3f32527f4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.602998  7076 tablet_replica.cc:333] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.603487  7076 raft_consensus.cc:2243] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.603928  7076 raft_consensus.cc:2272] T ef2eafec27ce4eb48cfb13c576f7cefb P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.605798  7076 tablet_replica.cc:333] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.606290  7076 raft_consensus.cc:2243] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.607023  7076 raft_consensus.cc:2272] T 3caa82d776714435898936cb4c6041c0 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.608974  7076 tablet_replica.cc:333] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.609505  7076 raft_consensus.cc:2243] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.609990  7076 raft_consensus.cc:2272] T 1d693bc5288d40ae98bb93862716c589 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.611759  7076 tablet_replica.cc:333] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.612325  7076 raft_consensus.cc:2243] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.612960  7076 raft_consensus.cc:2272] T 47a3ff85da594e17a687e7c116983565 P 8ff54842a32a414d8cbb4a3f32527f4a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.614804  7076 tablet_replica.cc:333] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.615356  7076 raft_consensus.cc:2243] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.616293  7076 raft_consensus.cc:2272] T ee0be2dae2824fd89d658f949f717dfc P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.618669  7076 tablet_replica.cc:333] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.619329  7076 raft_consensus.cc:2243] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.620327  7076 raft_consensus.cc:2272] T 7feffaf779354992809fb6a460399626 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.622754  7076 tablet_replica.cc:333] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.623399  7076 raft_consensus.cc:2243] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.624107  7076 raft_consensus.cc:2272] T a7984a0dbb5d4008936cec86daf790e9 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.626641  7076 tablet_replica.cc:333] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.627276  7076 raft_consensus.cc:2243] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:18:46.627498  8892 consensus_peers.cc:597] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.628340  7076 raft_consensus.cc:2272] T 54a6cfa6f2cf49b6b8ad9a3beb86c0be P 8ff54842a32a414d8cbb4a3f32527f4a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.630512  7076 tablet_replica.cc:333] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.631047  7076 raft_consensus.cc:2243] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.631837  7076 raft_consensus.cc:2272] T 8b9006ab90a84d6fae17b6b86c0530b8 P 8ff54842a32a414d8cbb4a3f32527f4a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.634213  7076 tablet_replica.cc:333] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a: stopping tablet replica
I20260709 13:18:46.634819  7076 raft_consensus.cc:2243] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.635362  7076 raft_consensus.cc:2272] T 46e06d1a840c4315837a871dc31b4497 P 8ff54842a32a414d8cbb4a3f32527f4a [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:46.635870  8892 consensus_peers.cc:597] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.641167  8892 consensus_peers.cc:597] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.699208 13977 raft_consensus.cc:493] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.699822 13977 raft_consensus.cc:515] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.702268 13977 leader_election.cc:290] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:46.705529  8892 leader_election.cc:336] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:46.707237  8889 leader_election.cc:336] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.707636  8889 leader_election.cc:304] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:46.708371 13977 raft_consensus.cc:2749] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:46.713095  8332 connection.cc:466] server connection from 127.0.0.1:59420 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59420 (request call id 1718) could send its response
W20260709 13:18:46.714576  8892 consensus_peers.cc:597] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Network error: recv got EOF from 127.6.233.3:43697 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.734812  8892 consensus_peers.cc:597] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:43697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.750771  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:18:46.755232 13977 raft_consensus.cc:493] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4cf23888b4fe42b594b9443ae6ee9cd2)
I20260709 13:18:46.755828 13977 raft_consensus.cc:515] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:46.758038 13977 leader_election.cc:290] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391)
W20260709 13:18:46.763733  8889 leader_election.cc:336] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:46.764350  8889 leader_election.cc:336] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:46.764698  8889 leader_election.cc:304] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:46.765372 13977 raft_consensus.cc:2749] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:46.773379  8889 consensus_peers.cc:597] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:46.862753  8892 consensus_peers.cc:597] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:43697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:46.886945  8889 consensus_peers.cc:597] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Couldn't send request to peer 9e95b04d03d241329435b6d08dd1f236. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:18:46.993817  8892 consensus_peers.cc:597] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Couldn't send request to peer 8ff54842a32a414d8cbb4a3f32527f4a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:43697: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.388087  7076 tablet_server.cc:196] TabletServer@127.6.233.3:0 shutdown complete.
W20260709 13:18:47.420753  8889 consensus_peers.cc:597] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.431401  8889 consensus_peers.cc:597] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 -> Peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Couldn't send request to peer 4cf23888b4fe42b594b9443ae6ee9cd2. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.445938 13981 raft_consensus.cc:493] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:47.446627 13981 raft_consensus.cc:515] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:47.449100 13981 leader_election.cc:290] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
W20260709 13:18:47.456746  8889 leader_election.cc:336] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111)
W20260709 13:18:47.457309  8892 leader_election.cc:336] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Network error: Client connection negotiation failed: client connection to 127.6.233.3:43697: connect: Connection refused (error 111)
I20260709 13:18:47.457763  8892 leader_election.cc:304] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 8ff54842a32a414d8cbb4a3f32527f4a, 9e95b04d03d241329435b6d08dd1f236
I20260709 13:18:47.459396 13981 raft_consensus.cc:2749] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:47.497525  7076 tablet_server.cc:179] TabletServer@127.6.233.4:0 shutting down...
I20260709 13:18:47.551771  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:47.552588  7076 tablet_replica.cc:333] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.553258  7076 raft_consensus.cc:2243] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.554044  7076 raft_consensus.cc:2272] T 019e9c29effc40928d5f5e795b8aeed0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.556746  7076 tablet_replica.cc:333] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.557420 13972 raft_consensus.cc:493] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:47.557662  7076 raft_consensus.cc:2243] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.557983 13972 raft_consensus.cc:515] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:47.558490  7076 raft_consensus.cc:2272] T cf2b3e0ac13b4eaf94a555cbea2ea41d P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.560290 13972 leader_election.cc:290] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:47.561667  7076 tablet_replica.cc:333] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.562676  7076 raft_consensus.cc:2243] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.563486  7076 raft_consensus.cc:2272] T 8942278c55614601a1290e32997fe007 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:47.565295  8892 leader_election.cc:336] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Network error: Client connection negotiation failed: client connection to 127.6.233.3:43697: connect: Connection refused (error 111)
I20260709 13:18:47.566546  7076 tablet_replica.cc:333] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
W20260709 13:18:47.567400  8889 leader_election.cc:336] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:47.567515  7076 raft_consensus.cc:2243] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.567873  8889 leader_election.cc:304] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:47.568305  7076 raft_consensus.cc:2272] T 55586274911e4f2eb326f0741d200c17 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.568614 13977 raft_consensus.cc:2749] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:47.570865  7076 tablet_replica.cc:333] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.571537  7076 raft_consensus.cc:2243] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.572031  7076 raft_consensus.cc:2272] T ee0be2dae2824fd89d658f949f717dfc P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.574216  7076 tablet_replica.cc:333] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.574761  7076 raft_consensus.cc:2243] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.575299  7076 raft_consensus.cc:2272] T d81288332c1b4610a2fe2b09dba77503 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.578083  7076 tablet_replica.cc:333] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.578873  7076 raft_consensus.cc:2243] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.579588  7076 raft_consensus.cc:2272] T 4c96431d125f4d169be8f25647f9371e P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.581895  7076 tablet_replica.cc:333] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.582440  7076 raft_consensus.cc:2243] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.583199  7076 raft_consensus.cc:2272] T 48e600fe8a934349bb2d4d18d10815a6 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.585204  7076 tablet_replica.cc:333] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.585731  7076 raft_consensus.cc:2243] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.586459  7076 raft_consensus.cc:2272] T 1d693bc5288d40ae98bb93862716c589 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.588454  7076 tablet_replica.cc:333] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.589035  7076 raft_consensus.cc:2243] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.589951  7076 raft_consensus.cc:2272] T 8d3403855d4147a9b056dc8678880fdf P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.592733  7076 tablet_replica.cc:333] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.593611  7076 raft_consensus.cc:2243] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.594429  7076 raft_consensus.cc:2272] T 2ebc3be5b6ff4d2b90d60c9a508dafc7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.596875  7076 tablet_replica.cc:333] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.597460  7076 raft_consensus.cc:2243] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.597965  7076 raft_consensus.cc:2272] T be0d0091520f4d6ea7668120e21a6aa0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.599901  7076 tablet_replica.cc:333] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.600459  7076 raft_consensus.cc:2243] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.601120  7076 raft_consensus.cc:2272] T 7dca780f49cb4f62912f333b3185e48f P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.603502  7076 tablet_replica.cc:333] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.604076  7076 raft_consensus.cc:2243] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.604568  7076 raft_consensus.cc:2272] T c802b19bdf2e4f69b169d31056091820 P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.606555  7076 tablet_replica.cc:333] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.607088  7076 raft_consensus.cc:2243] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.607846  7076 raft_consensus.cc:2272] T 57b9174dc54540e597799ccc6b10b419 P d03eaa3ce81042f9b114cd00a7f41b17 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.609686  7076 tablet_replica.cc:333] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.610292  7076 raft_consensus.cc:2243] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.611120  7076 raft_consensus.cc:2272] T fea6012070404ef6b810517d977625da P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.613072  7076 tablet_replica.cc:333] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.613580  7076 raft_consensus.cc:2243] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.614362  7076 raft_consensus.cc:2272] T 282a740dc06c41f0b77f4880423e4395 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.616612  7076 tablet_replica.cc:333] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.617130  7076 raft_consensus.cc:2243] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.617882  7076 raft_consensus.cc:2272] T ff5614e6d15c446ba2addddda765efdd P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.619741  7076 tablet_replica.cc:333] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.620323  7076 raft_consensus.cc:2243] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.621086  7076 raft_consensus.cc:2272] T c4b32c39d3034dc0b1e48b0daa2308c0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.623148  7076 tablet_replica.cc:333] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.623662  7076 raft_consensus.cc:2243] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.624470  7076 raft_consensus.cc:2272] T 4c835fd22b7643a981b446089ad74066 P d03eaa3ce81042f9b114cd00a7f41b17 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.625658 13977 raft_consensus.cc:493] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:47.626582  7076 tablet_replica.cc:333] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.626147 13977 raft_consensus.cc:515] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:47.627246  7076 raft_consensus.cc:2243] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.627805  7076 raft_consensus.cc:2272] T 7feffaf779354992809fb6a460399626 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.628465 13977 leader_election.cc:290] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:47.630424  7076 tablet_replica.cc:333] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.631250  7076 raft_consensus.cc:2243] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.632004  7076 raft_consensus.cc:2272] T 5da27e18b189452598381f95fe6f22cf P d03eaa3ce81042f9b114cd00a7f41b17 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:47.632799  8889 leader_election.cc:336] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
I20260709 13:18:47.634513  7076 tablet_replica.cc:333] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
W20260709 13:18:47.634513  8892 leader_election.cc:336] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Network error: Client connection negotiation failed: client connection to 127.6.233.3:43697: connect: Connection refused (error 111)
I20260709 13:18:47.635180  8892 leader_election.cc:304] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:47.635535  7076 raft_consensus.cc:2243] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.635896 13977 raft_consensus.cc:2749] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:47.636597  7076 raft_consensus.cc:2272] T afeb2f98236845469440c44ada463b5c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.639179  7076 tablet_replica.cc:333] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.639920  7076 raft_consensus.cc:2243] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.640751  7076 raft_consensus.cc:2272] T 64f8ae67f51c4ec482dada7787dc153e P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.642859  7076 tablet_replica.cc:333] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.643395  7076 raft_consensus.cc:2243] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.643951  7076 raft_consensus.cc:2272] T 8b9006ab90a84d6fae17b6b86c0530b8 P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.643990 13977 raft_consensus.cc:493] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8ff54842a32a414d8cbb4a3f32527f4a)
I20260709 13:18:47.644639 13977 raft_consensus.cc:515] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9e95b04d03d241329435b6d08dd1f236" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43925 } } peers { permanent_uuid: "4cf23888b4fe42b594b9443ae6ee9cd2" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 40391 } attrs { replace: true } } peers { permanent_uuid: "8ff54842a32a414d8cbb4a3f32527f4a" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 43697 } } peers { permanent_uuid: "d03eaa3ce81042f9b114cd00a7f41b17" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 42491 } attrs { promote: false } }
I20260709 13:18:47.646198  7076 tablet_replica.cc:333] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.646920  7076 raft_consensus.cc:2243] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.647450 13977 leader_election.cc:290] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925), 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391), 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697)
I20260709 13:18:47.647557  7076 raft_consensus.cc:2272] T 0e9e53d1d8204518834e32e1ef952157 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.650168  7076 tablet_replica.cc:333] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.650924  7076 raft_consensus.cc:2243] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.652201  7076 raft_consensus.cc:2272] T 7ac72d56568b4857a1bd70aadbb026c1 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:47.653429  8889 leader_election.cc:336] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4cf23888b4fe42b594b9443ae6ee9cd2 (127.6.233.2:40391): Network error: Client connection negotiation failed: client connection to 127.6.233.2:40391: connect: Connection refused (error 111)
W20260709 13:18:47.653951  8892 leader_election.cc:336] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8ff54842a32a414d8cbb4a3f32527f4a (127.6.233.3:43697): Network error: Client connection negotiation failed: client connection to 127.6.233.3:43697: connect: Connection refused (error 111)
I20260709 13:18:47.654361  8892 leader_election.cc:304] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d03eaa3ce81042f9b114cd00a7f41b17; no voters: 4cf23888b4fe42b594b9443ae6ee9cd2, 8ff54842a32a414d8cbb4a3f32527f4a
I20260709 13:18:47.654749  7076 tablet_replica.cc:333] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.655092 13977 raft_consensus.cc:2749] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:47.655573  7076 raft_consensus.cc:2243] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.656797  7076 raft_consensus.cc:2272] T 5bded28881ef4440a713698e8088bd77 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.658771  7076 tablet_replica.cc:333] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.659313  7076 raft_consensus.cc:2243] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.660102  7076 raft_consensus.cc:2272] T 3c999e73d071475d9e848e7e83e79be3 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.661906  7076 tablet_replica.cc:333] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.662413  7076 raft_consensus.cc:2243] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.662940  7076 raft_consensus.cc:2272] T 53535408ea514f8db7292852927e7743 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.664898  7076 tablet_replica.cc:333] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.665393  7076 raft_consensus.cc:2243] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.666122  7076 raft_consensus.cc:2272] T 46e06d1a840c4315837a871dc31b4497 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.667925  7076 tablet_replica.cc:333] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.668457  7076 raft_consensus.cc:2243] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.669183  7076 raft_consensus.cc:2272] T 47a3ff85da594e17a687e7c116983565 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.670950  7076 tablet_replica.cc:333] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.671439  7076 raft_consensus.cc:2243] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.672237  7076 raft_consensus.cc:2272] T caf02b6ca7a34be9bbac5771e91f767a P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.674085  7076 tablet_replica.cc:333] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.674587  7076 raft_consensus.cc:2243] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.675299  7076 raft_consensus.cc:2272] T b7f77585d3144b70a0f742dcd66411d0 P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.677218  7076 tablet_replica.cc:333] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.677724  7076 raft_consensus.cc:2243] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.678188  7076 raft_consensus.cc:2272] T 7a81beec7fc64c498918eb3ea356d2c7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.679939  7076 tablet_replica.cc:333] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.680445  7076 raft_consensus.cc:2243] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.681232  7076 raft_consensus.cc:2272] T 509edc927d524436b819a0e96e615799 P d03eaa3ce81042f9b114cd00a7f41b17 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.683084  7076 tablet_replica.cc:333] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.683570  7076 raft_consensus.cc:2243] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.684259  7076 raft_consensus.cc:2272] T 5da6736db6d7413682f6b3e035ca2084 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.686125  7076 tablet_replica.cc:333] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.686628  7076 raft_consensus.cc:2243] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.687376  7076 raft_consensus.cc:2272] T 133eb5f61ebc499ab283df4c068d5be7 P d03eaa3ce81042f9b114cd00a7f41b17 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.689338  7076 tablet_replica.cc:333] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.689817  7076 raft_consensus.cc:2243] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.690582  7076 raft_consensus.cc:2272] T f62f6597a8604eb9b9228657a7c3a7eb P d03eaa3ce81042f9b114cd00a7f41b17 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.692586  7076 tablet_replica.cc:333] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.693126  7076 raft_consensus.cc:2243] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.693977  7076 raft_consensus.cc:2272] T cfe43428b7ca43928b7eeb8cce815e8d P d03eaa3ce81042f9b114cd00a7f41b17 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.695776  7076 tablet_replica.cc:333] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.696283  7076 raft_consensus.cc:2243] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.696744  7076 raft_consensus.cc:2272] T 62e8a922b99844e085b2b1e126cfb02e P d03eaa3ce81042f9b114cd00a7f41b17 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.698503  7076 tablet_replica.cc:333] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.698974  7076 raft_consensus.cc:2243] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.699457  7076 raft_consensus.cc:2272] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.701479  7076 tablet_replica.cc:333] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.701923  7076 raft_consensus.cc:2243] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:47.702402  7076 raft_consensus.cc:2272] T 29a17bfa374c4aa6a25b919a48f0583c P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:47.704277  7076 tablet_replica.cc:333] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17: stopping tablet replica
I20260709 13:18:47.704711  7076 raft_consensus.cc:2243] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:47.705497  7076 raft_consensus.cc:2272] T 3becc403d217418988bb94be41c015e9 P d03eaa3ce81042f9b114cd00a7f41b17 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:47.963645  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.965021  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.001633  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.039146  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.117340  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.216231  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.439636  8890 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.453292  8889 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.522459  8891 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.544772  8889 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43925: connect: Connection refused (error 111) [suppressed 491 similar messages]
W20260709 13:18:48.550547 13983 leader_election.cc:336] T bd269c56db8748ddba9b5528d4c49916 P d03eaa3ce81042f9b114cd00a7f41b17 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9e95b04d03d241329435b6d08dd1f236 (127.6.233.1:43925): Service unavailable: reactor is shutting down (error 108)
I20260709 13:18:48.807941  7076 tablet_server.cc:196] TabletServer@127.6.233.4:0 shutdown complete.
I20260709 13:18:48.882833  7076 master.cc:562] Master@127.6.233.62:38939 shutting down...
W20260709 13:18:48.919589  8166 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:18:48.919946  8166 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:18:48.920195  8166 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:18:48.923170  7076 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:48.923823  7076 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:48.924350  7076 tablet_replica.cc:333] T 00000000000000000000000000000000 P e8c3cea2f3524d70be8a4a6e5be1c492: stopping tablet replica
I20260709 13:18:49.050213  7076 master.cc:584] Master@127.6.233.62:38939 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (191530 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:18:49.152905  7076 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.233.62:33061
I20260709 13:18:49.154085  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:49.159804 13985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.159909 13984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.160493 13987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:49.161991  7076 server_base.cc:1061] running on GCE node
I20260709 13:18:49.164783  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:49.164966  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:49.165156  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603129165120 us; error 0 us; skew 500 ppm
I20260709 13:18:49.165683  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:49.167923  7076 webserver.cc:533] Webserver started at http://127.6.233.62:34503/ using document root <none> and password file <none>
I20260709 13:18:49.168460  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:49.168659  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:49.168936  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:49.170070  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/master-0-root/instance:
uuid: "b1775a7361c44e159677c5147165954e"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.174530  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:18:49.177912 13993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.178627  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:18:49.178910  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/master-0-root
uuid: "b1775a7361c44e159677c5147165954e"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.179169  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:49.208317  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:49.209532  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:49.247521  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.62:33061
I20260709 13:18:49.247653 14044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.62:33061 every 8 connection(s)
I20260709 13:18:49.251535 14045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:49.261566 14045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e: Bootstrap starting.
I20260709 13:18:49.266132 14045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:49.270045 14045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e: No bootstrap required, opened a new log
I20260709 13:18:49.272156 14045 raft_consensus.cc:359] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1775a7361c44e159677c5147165954e" member_type: VOTER }
I20260709 13:18:49.272500 14045 raft_consensus.cc:385] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:49.272773 14045 raft_consensus.cc:740] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1775a7361c44e159677c5147165954e, State: Initialized, Role: FOLLOWER
I20260709 13:18:49.273347 14045 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1775a7361c44e159677c5147165954e" member_type: VOTER }
I20260709 13:18:49.273753 14045 raft_consensus.cc:399] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:49.273944 14045 raft_consensus.cc:493] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:49.274144 14045 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:49.278275 14045 raft_consensus.cc:515] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1775a7361c44e159677c5147165954e" member_type: VOTER }
I20260709 13:18:49.278713 14045 leader_election.cc:304] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1775a7361c44e159677c5147165954e; no voters: 
I20260709 13:18:49.279748 14045 leader_election.cc:290] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:49.280103 14048 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:49.281515 14048 raft_consensus.cc:697] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 1 LEADER]: Becoming Leader. State: Replica: b1775a7361c44e159677c5147165954e, State: Running, Role: LEADER
I20260709 13:18:49.282248 14048 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1775a7361c44e159677c5147165954e" member_type: VOTER }
I20260709 13:18:49.282984 14045 sys_catalog.cc:565] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:49.287551 14050 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1775a7361c44e159677c5147165954e. Latest consensus state: current_term: 1 leader_uuid: "b1775a7361c44e159677c5147165954e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1775a7361c44e159677c5147165954e" member_type: VOTER } }
I20260709 13:18:49.288350 14050 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:49.288434 14049 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1775a7361c44e159677c5147165954e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1775a7361c44e159677c5147165954e" member_type: VOTER } }
I20260709 13:18:49.289088 14049 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:49.290405 14055 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:49.295104 14055 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:49.299496  7076 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:49.303952 14055 catalog_manager.cc:1383] Generated new cluster ID: cc4f5658b01745b1b666811485dba0b4
I20260709 13:18:49.304248 14055 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:49.330070 14055 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:49.331306 14055 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:49.350594 14055 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e: Generated new TSK 0
I20260709 13:18:49.351229 14055 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:49.365664  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:49.371618 14066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.373406 14067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.376922 14069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:49.376955  7076 server_base.cc:1061] running on GCE node
I20260709 13:18:49.379146  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:49.379355  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:49.379544  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603129379523 us; error 0 us; skew 500 ppm
I20260709 13:18:49.380170  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:49.382484  7076 webserver.cc:533] Webserver started at http://127.6.233.1:46633/ using document root <none> and password file <none>
I20260709 13:18:49.382951  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:49.383153  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:49.383419  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:49.384662  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/instance:
uuid: "675788979b2e4a89be45b2af4fa3141a"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.389113  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:18:49.392203 14074 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.392913  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:49.393242  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "675788979b2e4a89be45b2af4fa3141a"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.393535  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:49.420284  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:49.421453  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:49.422907  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:49.425282  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:49.425493  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.425748  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:49.425937  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.467847  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:34585
I20260709 13:18:49.467980 14136 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:34585 every 8 connection(s)
I20260709 13:18:49.472994  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:49.480136 14141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.482038 14142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.486261 14144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:49.487242  7076 server_base.cc:1061] running on GCE node
I20260709 13:18:49.487567 14137 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33061
I20260709 13:18:49.487986 14137 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:49.488906 14137 heartbeater.cc:507] Master 127.6.233.62:33061 requested a full tablet report, sending...
I20260709 13:18:49.489360  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:49.489602  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:49.489801  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603129489777 us; error 0 us; skew 500 ppm
I20260709 13:18:49.490554  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:49.491496 14010 ts_manager.cc:194] Registered new tserver with Master: 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:49.493374  7076 webserver.cc:533] Webserver started at http://127.6.233.2:34341/ using document root <none> and password file <none>
I20260709 13:18:49.493897  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:49.494129 14010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36688
I20260709 13:18:49.494138  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:49.494686  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:49.496160  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/instance:
uuid: "45ddcb989aef4c9fa869766c3682632c"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.500558  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:18:49.503680 14149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.504523  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:49.504856  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-1-root
uuid: "45ddcb989aef4c9fa869766c3682632c"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.505249  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:49.526937  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:49.528163  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:49.529650  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:49.531958  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:49.532209  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.532466  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:49.532637  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.571584  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.2:46091
I20260709 13:18:49.571692 14211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.2:46091 every 8 connection(s)
I20260709 13:18:49.576519  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:49.583825 14215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.584893 14216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:49.586577  7076 server_base.cc:1061] running on GCE node
W20260709 13:18:49.587385 14219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:49.588505  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:49.588809  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:49.588995  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603129588962 us; error 0 us; skew 500 ppm
I20260709 13:18:49.589373 14212 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33061
I20260709 13:18:49.589712  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:49.589797 14212 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:49.590780 14212 heartbeater.cc:507] Master 127.6.233.62:33061 requested a full tablet report, sending...
I20260709 13:18:49.592690  7076 webserver.cc:533] Webserver started at http://127.6.233.3:35873/ using document root <none> and password file <none>
I20260709 13:18:49.593174 14010 ts_manager.cc:194] Registered new tserver with Master: 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:49.593376  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:49.593676  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:49.593997  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:49.595118 14010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36694
I20260709 13:18:49.595516  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/instance:
uuid: "c19f7f4ddb074bd8997d01296c3080d6"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.600648  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:18:49.603888 14223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.604693  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:49.605001  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-2-root
uuid: "c19f7f4ddb074bd8997d01296c3080d6"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.605255  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:49.617332  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:49.618551  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:49.619994  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:49.622226  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:49.622400  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.622696  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:49.622855  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.663527  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.3:35883
I20260709 13:18:49.663636 14285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.3:35883 every 8 connection(s)
I20260709 13:18:49.668351  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:49.675657 14289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:49.677333 14290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:49.683606  7076 server_base.cc:1061] running on GCE node
W20260709 13:18:49.683753 14292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:49.684315 14286 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33061
I20260709 13:18:49.684808 14286 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:49.685081  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:49.685365  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:49.685657  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603129685638 us; error 0 us; skew 500 ppm
I20260709 13:18:49.685734 14286 heartbeater.cc:507] Master 127.6.233.62:33061 requested a full tablet report, sending...
I20260709 13:18:49.686452  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:49.688202 14010 ts_manager.cc:194] Registered new tserver with Master: c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:49.689303  7076 webserver.cc:533] Webserver started at http://127.6.233.4:42381/ using document root <none> and password file <none>
I20260709 13:18:49.689967  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:49.690059 14010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36696
I20260709 13:18:49.690222  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:49.690614  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:49.691996  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-3-root/instance:
uuid: "0646b0acb9c943b59389eace852a5215"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.696820  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:18:49.699849 14297 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.700644  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:49.700907  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-3-root
uuid: "0646b0acb9c943b59389eace852a5215"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:18:49.701175  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:49.739886  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:49.741207  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:49.743078  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:49.745508  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:49.745747  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.746068  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:49.746250  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:49.791702  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.4:40795
I20260709 13:18:49.792117 14359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.4:40795 every 8 connection(s)
I20260709 13:18:49.814785 14360 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33061
I20260709 13:18:49.815302 14360 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:49.815989 14360 heartbeater.cc:507] Master 127.6.233.62:33061 requested a full tablet report, sending...
I20260709 13:18:49.817899 14010 ts_manager.cc:194] Registered new tserver with Master: 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:49.818888  7076 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.023420676s
I20260709 13:18:49.819288 14010 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36706
I20260709 13:18:49.844666 14010 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36708:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:18:50.109179 14177 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccef079cb964f8a83bfcafbe3f15e74 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:50.109218 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 63a98c83dfc34effa3050c2c8c0121f9 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:50.110802 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccef079cb964f8a83bfcafbe3f15e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.111465 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a98c83dfc34effa3050c2c8c0121f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.113319 14176 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5acb16ea44ef882abb6d9013b2848 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:50.114675 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5acb16ea44ef882abb6d9013b2848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.121493 14174 tablet_service.cc:1511] Processing CreateTablet for tablet 44db1fb7c007438398ce78e1bf686291 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:50.122905 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44db1fb7c007438398ce78e1bf686291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.127223 14102 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccef079cb964f8a83bfcafbe3f15e74 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:50.127988 14173 tablet_service.cc:1511] Processing CreateTablet for tablet ed9afc388a1546c28fcf9777a5e31674 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:50.128837 14102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccef079cb964f8a83bfcafbe3f15e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.129343 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9afc388a1546c28fcf9777a5e31674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.133817 14251 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5acb16ea44ef882abb6d9013b2848 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:50.134613 14249 tablet_service.cc:1511] Processing CreateTablet for tablet d4848588d16a4c4f89e884a9f15ff4a7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:50.135284 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5acb16ea44ef882abb6d9013b2848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.117261 14175 tablet_service.cc:1511] Processing CreateTablet for tablet d4848588d16a4c4f89e884a9f15ff4a7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:50.137064 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4848588d16a4c4f89e884a9f15ff4a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.137425 14250 tablet_service.cc:1511] Processing CreateTablet for tablet 3935d54132d142e595008d4783fa0ab6 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:50.141170 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 44db1fb7c007438398ce78e1bf686291 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:50.141649 14171 tablet_service.cc:1511] Processing CreateTablet for tablet f7ca8839d60a4089a7ff40ba299f1b71 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:50.142969 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ca8839d60a4089a7ff40ba299f1b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.145193 14170 tablet_service.cc:1511] Processing CreateTablet for tablet d3d4f8d14e954ef5af8eb1736629b53b (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:50.146543 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d4f8d14e954ef5af8eb1736629b53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.149215 14169 tablet_service.cc:1511] Processing CreateTablet for tablet 190dd92193fb44399a0922353ce78a02 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:50.150612 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190dd92193fb44399a0922353ce78a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.150360 14245 tablet_service.cc:1511] Processing CreateTablet for tablet f7ca8839d60a4089a7ff40ba299f1b71 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:50.152724 14244 tablet_service.cc:1511] Processing CreateTablet for tablet e96808d860d8457caea08dbac23516b3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:50.153213 14168 tablet_service.cc:1511] Processing CreateTablet for tablet f1f2f59055e248e889af1b4a2e30f27a (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:50.154549 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f2f59055e248e889af1b4a2e30f27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.155109 14243 tablet_service.cc:1511] Processing CreateTablet for tablet 190dd92193fb44399a0922353ce78a02 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:50.161263 14242 tablet_service.cc:1511] Processing CreateTablet for tablet f1f2f59055e248e889af1b4a2e30f27a (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:50.149215 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 63a98c83dfc34effa3050c2c8c0121f9 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:50.143519 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1e37d29fe1480da8cf0ccc966e8f5c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:50.135972 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4848588d16a4c4f89e884a9f15ff4a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.172412 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44db1fb7c007438398ce78e1bf686291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.173065 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3935d54132d142e595008d4783fa0ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.173838 14244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96808d860d8457caea08dbac23516b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.180536 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1e37d29fe1480da8cf0ccc966e8f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.188442 14242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f2f59055e248e889af1b4a2e30f27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.189925 14245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ca8839d60a4089a7ff40ba299f1b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.191896 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a98c83dfc34effa3050c2c8c0121f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.196472 14243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190dd92193fb44399a0922353ce78a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.204303 14101 tablet_service.cc:1511] Processing CreateTablet for tablet 5fc5acb16ea44ef882abb6d9013b2848 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:50.205760 14101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fc5acb16ea44ef882abb6d9013b2848. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.209143 14100 tablet_service.cc:1511] Processing CreateTablet for tablet 3935d54132d142e595008d4783fa0ab6 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:50.210521 14100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3935d54132d142e595008d4783fa0ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.213266 14098 tablet_service.cc:1511] Processing CreateTablet for tablet ed9afc388a1546c28fcf9777a5e31674 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:50.213395 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 44db1fb7c007438398ce78e1bf686291 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:50.214699 14098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9afc388a1546c28fcf9777a5e31674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.217257 14097 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1e37d29fe1480da8cf0ccc966e8f5c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:50.218689 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1e37d29fe1480da8cf0ccc966e8f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.220468 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44db1fb7c007438398ce78e1bf686291. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.221221 14096 tablet_service.cc:1511] Processing CreateTablet for tablet f7ca8839d60a4089a7ff40ba299f1b71 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:50.222584 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7ca8839d60a4089a7ff40ba299f1b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.225637 14095 tablet_service.cc:1511] Processing CreateTablet for tablet d3d4f8d14e954ef5af8eb1736629b53b (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:50.226966 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d4f8d14e954ef5af8eb1736629b53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.229619 14094 tablet_service.cc:1511] Processing CreateTablet for tablet e96808d860d8457caea08dbac23516b3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:50.232234 14093 tablet_service.cc:1511] Processing CreateTablet for tablet f1f2f59055e248e889af1b4a2e30f27a (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:50.240409 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f2f59055e248e889af1b4a2e30f27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.242347 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96808d860d8457caea08dbac23516b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.260805 14174 tablet_service.cc:1511] Processing CreateTablet for tablet 847793586a524d1e9df7a07c31f2d186 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:50.262547 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847793586a524d1e9df7a07c31f2d186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.270345 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 3ccef079cb964f8a83bfcafbe3f15e74 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:50.273270 14324 tablet_service.cc:1511] Processing CreateTablet for tablet 3935d54132d142e595008d4783fa0ab6 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:50.273638 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1e37d29fe1480da8cf0ccc966e8f5c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:50.271903 14322 tablet_service.cc:1511] Processing CreateTablet for tablet ed9afc388a1546c28fcf9777a5e31674 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:50.276638 14320 tablet_service.cc:1511] Processing CreateTablet for tablet 63a98c83dfc34effa3050c2c8c0121f9 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:50.275719 14323 tablet_service.cc:1511] Processing CreateTablet for tablet d4848588d16a4c4f89e884a9f15ff4a7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:50.271898 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ccef079cb964f8a83bfcafbe3f15e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.279824 14319 tablet_service.cc:1511] Processing CreateTablet for tablet d3d4f8d14e954ef5af8eb1736629b53b (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:50.281277 14319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d4f8d14e954ef5af8eb1736629b53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.288394 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3935d54132d142e595008d4783fa0ab6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.289098 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1e37d29fe1480da8cf0ccc966e8f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.289733 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a98c83dfc34effa3050c2c8c0121f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.292394 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4848588d16a4c4f89e884a9f15ff4a7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:50.295851 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:50.312511 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9afc388a1546c28fcf9777a5e31674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.331560 14173 tablet_service.cc:1511] Processing CreateTablet for tablet e9e2af9154cf4749976dc55b506018e5 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:50.333467 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e2af9154cf4749976dc55b506018e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.335069 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 14767c1f0196445ea4a179965d06965f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:50.347086 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14767c1f0196445ea4a179965d06965f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.355624 14382 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:50.359747 14175 tablet_service.cc:1511] Processing CreateTablet for tablet fb043e88ddb1409188b19489adb77959 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:50.361058 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb043e88ddb1409188b19489adb77959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.362758 14172 tablet_service.cc:1511] Processing CreateTablet for tablet fa77825c4a1b4199b0876c76e8ed77aa (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:50.364017 14249 tablet_service.cc:1511] Processing CreateTablet for tablet e9e2af9154cf4749976dc55b506018e5 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:50.367259 14246 tablet_service.cc:1511] Processing CreateTablet for tablet fb043e88ddb1409188b19489adb77959 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:50.378515 14383 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:50.384562 14381 tablet_bootstrap.cc:492] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:50.391644 14382 tablet_bootstrap.cc:654] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:50.391826 14381 tablet_bootstrap.cc:654] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:50.399642 14383 tablet_bootstrap.cc:654] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:50.407178 14384 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:50.365128 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 39f9212333fa40979fd9596511ba43b7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:50.470852 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f9212333fa40979fd9596511ba43b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.473906 14170 tablet_service.cc:1511] Processing CreateTablet for tablet d0dc0a81dec54a3496bdc7a82d00614c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:50.466984 14242 tablet_service.cc:1511] Processing CreateTablet for tablet 39f9212333fa40979fd9596511ba43b7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:50.475769 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa77825c4a1b4199b0876c76e8ed77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.485639 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0dc0a81dec54a3496bdc7a82d00614c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.465755 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb043e88ddb1409188b19489adb77959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.493208 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e2af9154cf4749976dc55b506018e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.496685 14242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f9212333fa40979fd9596511ba43b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.497713 14137 heartbeater.cc:499] Master 127.6.233.62:33061 was elected leader, sending a full tablet report...
I20260709 13:18:50.504590 14100 tablet_service.cc:1511] Processing CreateTablet for tablet 14767c1f0196445ea4a179965d06965f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:50.505069 14244 tablet_service.cc:1511] Processing CreateTablet for tablet 965959c6060c4e31872a4d63bb4cc3d8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:50.506651 14244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965959c6060c4e31872a4d63bb4cc3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.507076 14100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14767c1f0196445ea4a179965d06965f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.539856 14177 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac90eaea6aa409d802a00c504d1c104 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:50.549317 14382 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:50.545143 14381 tablet_bootstrap.cc:492] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:50.552188 14319 tablet_service.cc:1511] Processing CreateTablet for tablet e96808d860d8457caea08dbac23516b3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:50.559134 14319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96808d860d8457caea08dbac23516b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.554502 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 190dd92193fb44399a0922353ce78a02 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:50.555928 14322 tablet_service.cc:1511] Processing CreateTablet for tablet 847793586a524d1e9df7a07c31f2d186 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:50.557228 14381 ts_tablet_manager.cc:1403] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.173s	user 0.013s	sys 0.005s
I20260709 13:18:50.557104 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 14767c1f0196445ea4a179965d06965f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:50.557878 14382 ts_tablet_manager.cc:1403] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.203s	user 0.012s	sys 0.005s
I20260709 13:18:50.566237 14382 raft_consensus.cc:359] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:50.567365 14382 raft_consensus.cc:385] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:50.559181 14323 tablet_service.cc:1511] Processing CreateTablet for tablet e9e2af9154cf4749976dc55b506018e5 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:50.574607 14383 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:50.575248 14383 ts_tablet_manager.cc:1403] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.197s	user 0.014s	sys 0.000s
I20260709 13:18:50.575754 14243 tablet_service.cc:1511] Processing CreateTablet for tablet d0dc0a81dec54a3496bdc7a82d00614c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:50.579144 14383 raft_consensus.cc:359] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:50.579950 14383 raft_consensus.cc:385] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:50.582262 14320 tablet_service.cc:1511] Processing CreateTablet for tablet fa77825c4a1b4199b0876c76e8ed77aa (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:50.592998 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa77825c4a1b4199b0876c76e8ed77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.594664 14384 tablet_bootstrap.cc:654] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:50.595568 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190dd92193fb44399a0922353ce78a02. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:50.580591 13997 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 90177.6us
I20260709 13:18:50.582592 14318 tablet_service.cc:1511] Processing CreateTablet for tablet 965959c6060c4e31872a4d63bb4cc3d8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:50.584888 14317 tablet_service.cc:1511] Processing CreateTablet for tablet 39f9212333fa40979fd9596511ba43b7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:50.597971 14318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965959c6060c4e31872a4d63bb4cc3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.598322 14212 heartbeater.cc:499] Master 127.6.233.62:33061 was elected leader, sending a full tablet report...
I20260709 13:18:50.600821 14317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f9212333fa40979fd9596511ba43b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.604420 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9e2af9154cf4749976dc55b506018e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.604825 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac90eaea6aa409d802a00c504d1c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.607689 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847793586a524d1e9df7a07c31f2d186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.610531 14176 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd224c5b12246cf83abcd8530f9e091 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:50.611927 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd224c5b12246cf83abcd8530f9e091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.611853 14251 tablet_service.cc:1511] Processing CreateTablet for tablet 0464e1aacb18475980f90e52a22f5c55 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:50.613240 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0464e1aacb18475980f90e52a22f5c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.567747 14382 raft_consensus.cc:740] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.587212 14316 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac90eaea6aa409d802a00c504d1c104 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:50.586961 14099 tablet_service.cc:1511] Processing CreateTablet for tablet fb043e88ddb1409188b19489adb77959 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:50.622004 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14767c1f0196445ea4a179965d06965f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.622352 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb043e88ddb1409188b19489adb77959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.624210 14316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac90eaea6aa409d802a00c504d1c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.545147 14102 tablet_service.cc:1511] Processing CreateTablet for tablet 847793586a524d1e9df7a07c31f2d186 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:50.625382 14102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847793586a524d1e9df7a07c31f2d186. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.625540 14243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0dc0a81dec54a3496bdc7a82d00614c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:50.627529 13996 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 93995.4us
I20260709 13:18:50.571563 14381 raft_consensus.cc:359] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:50.608948 14383 raft_consensus.cc:740] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.646270 14383 consensus_queue.cc:260] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:50.633653 14381 raft_consensus.cc:385] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:50.648324 14381 raft_consensus.cc:740] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.649145 14097 tablet_service.cc:1511] Processing CreateTablet for tablet 965959c6060c4e31872a4d63bb4cc3d8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:50.653429 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965959c6060c4e31872a4d63bb4cc3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.608572 14168 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9282e9c78a46a6a3bba23269e7adc7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:50.652076 14094 tablet_service.cc:1511] Processing CreateTablet for tablet fa77825c4a1b4199b0876c76e8ed77aa (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:50.649295 14381 consensus_queue.cc:260] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:50.674772 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd224c5b12246cf83abcd8530f9e091 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:50.676240 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd224c5b12246cf83abcd8530f9e091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.692106 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9282e9c78a46a6a3bba23269e7adc7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:50.692304 13996 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 46578.3us
I20260709 13:18:50.695727 14286 heartbeater.cc:499] Master 127.6.233.62:33061 was elected leader, sending a full tablet report...
I20260709 13:18:50.659546 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 0464e1aacb18475980f90e52a22f5c55 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:50.696172 14245 tablet_service.cc:1511] Processing CreateTablet for tablet e833ae6b3ffa414fb4f0f04c981b4e44 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:50.697109 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0464e1aacb18475980f90e52a22f5c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.697580 14245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e833ae6b3ffa414fb4f0f04c981b4e44. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:50.708178 13995 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 168210us
I20260709 13:18:50.711107 14383 ts_tablet_manager.cc:1434] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.026s
I20260709 13:18:50.683802 14382 consensus_queue.cc:260] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:50.717973 14243 tablet_service.cc:1511] Processing CreateTablet for tablet fc372b890581484a9c147f584264c31f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:50.721212 14243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc372b890581484a9c147f584264c31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.728320 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9282e9c78a46a6a3bba23269e7adc7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:50.729712 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9282e9c78a46a6a3bba23269e7adc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.729787 14381 ts_tablet_manager.cc:1434] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.162s	user 0.010s	sys 0.005s
I20260709 13:18:50.731029 14381 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
W20260709 13:18:50.740926 14138 tablet.cc:2406] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:50.752825 14095 tablet_service.cc:1511] Processing CreateTablet for tablet d0dc0a81dec54a3496bdc7a82d00614c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:50.753299 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac90eaea6aa409d802a00c504d1c104 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 13:18:50.756371 13995 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 47286.1us
I20260709 13:18:50.756687 14383 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:50.759023 14101 tablet_service.cc:1511] Processing CreateTablet for tablet 0464e1aacb18475980f90e52a22f5c55 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:50.762319 14324 tablet_service.cc:1511] Processing CreateTablet for tablet 8e519b3fde754be785619f806259cbcb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:50.763688 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e519b3fde754be785619f806259cbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.707679 14250 tablet_service.cc:1511] Processing CreateTablet for tablet 2f560b8d81584651b4720691469eca98 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:50.777470 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f560b8d81584651b4720691469eca98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.782009 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa77825c4a1b4199b0876c76e8ed77aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.794087 14169 tablet_service.cc:1511] Processing CreateTablet for tablet 2f560b8d81584651b4720691469eca98 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:50.796151 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f560b8d81584651b4720691469eca98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.798153 14172 tablet_service.cc:1511] Processing CreateTablet for tablet fc372b890581484a9c147f584264c31f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:18:50.805454 13996 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 60808.2us
I20260709 13:18:50.808300 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac90eaea6aa409d802a00c504d1c104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.808938 14101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0464e1aacb18475980f90e52a22f5c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.811538 14384 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:50.812157 14384 ts_tablet_manager.cc:1403] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.405s	user 0.023s	sys 0.025s
I20260709 13:18:50.812265 14321 tablet_service.cc:1511] Processing CreateTablet for tablet e833ae6b3ffa414fb4f0f04c981b4e44 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:50.813794 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e833ae6b3ffa414fb4f0f04c981b4e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.817028 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0dc0a81dec54a3496bdc7a82d00614c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.818532 14249 tablet_service.cc:1511] Processing CreateTablet for tablet fa413bb6214043609003b441decca56f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:50.819628 14381 tablet_bootstrap.cc:654] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:50.819857 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa413bb6214043609003b441decca56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.822111 14360 heartbeater.cc:499] Master 127.6.233.62:33061 was elected leader, sending a full tablet report...
I20260709 13:18:50.799115 14175 tablet_service.cc:1511] Processing CreateTablet for tablet 8e519b3fde754be785619f806259cbcb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:50.802420 14100 tablet_service.cc:1511] Processing CreateTablet for tablet e833ae6b3ffa414fb4f0f04c981b4e44 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:50.836750 14102 tablet_service.cc:1511] Processing CreateTablet for tablet fc372b890581484a9c147f584264c31f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:50.849002 14174 tablet_service.cc:1511] Processing CreateTablet for tablet b9141f0570cd47eeb0583a4a7ca21ea0 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:50.851835 14098 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd224c5b12246cf83abcd8530f9e091 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:50.856173 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 8e519b3fde754be785619f806259cbcb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:50.798200 14171 tablet_service.cc:1511] Processing CreateTablet for tablet a7b2ad2ed67144c6b9baffea26c9ae16 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:50.870779 14383 tablet_bootstrap.cc:654] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:50.873366 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 6dfb3a603d584bcabbf0c9f0d3594ff7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:50.875195 14251 tablet_service.cc:1511] Processing CreateTablet for tablet b9141f0570cd47eeb0583a4a7ca21ea0 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:50.893198 14318 tablet_service.cc:1511] Processing CreateTablet for tablet a7b2ad2ed67144c6b9baffea26c9ae16 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:50.922070 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9141f0570cd47eeb0583a4a7ca21ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.923004 14318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b2ad2ed67144c6b9baffea26c9ae16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.876885 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e519b3fde754be785619f806259cbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.878561 14100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e833ae6b3ffa414fb4f0f04c981b4e44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.928647 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dfb3a603d584bcabbf0c9f0d3594ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.878897 14242 tablet_service.cc:1511] Processing CreateTablet for tablet 6dfb3a603d584bcabbf0c9f0d3594ff7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:50.932358 14102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc372b890581484a9c147f584264c31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.933131 14242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dfb3a603d584bcabbf0c9f0d3594ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.935073 14101 tablet_service.cc:1511] Processing CreateTablet for tablet fa413bb6214043609003b441decca56f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:50.891202 14316 tablet_service.cc:1511] Processing CreateTablet for tablet 2f560b8d81584651b4720691469eca98 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:50.973029 14316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f560b8d81584651b4720691469eca98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.893133 14322 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9282e9c78a46a6a3bba23269e7adc7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:50.897243 14170 tablet_service.cc:1511] Processing CreateTablet for tablet 183a076c0e614a54b0a8875f351528a3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:50.905143 14382 ts_tablet_manager.cc:1434] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.343s	user 0.007s	sys 0.012s
I20260709 13:18:50.908115 14381 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:50.977449 14381 ts_tablet_manager.cc:1403] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.247s	user 0.038s	sys 0.049s
I20260709 13:18:50.978015 14382 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:50.978456 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 6a68e63a39ca44319695c6f4e9937912 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:50.979768 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a68e63a39ca44319695c6f4e9937912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.980784 14381 raft_consensus.cc:359] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:50.981614 14381 raft_consensus.cc:385] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:50.981956 14381 raft_consensus.cc:740] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:50.908514 14317 tablet_service.cc:1511] Processing CreateTablet for tablet fa413bb6214043609003b441decca56f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:50.907603 14392 raft_consensus.cc:493] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.982753 14392 raft_consensus.cc:515] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:50.982918 14381 consensus_queue.cc:260] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:50.985675 14381 ts_tablet_manager.cc:1434] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:50.987172 14381 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:50.988015 14390 raft_consensus.cc:493] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.988517 14390 raft_consensus.cc:515] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:50.990324 14392 leader_election.cc:290] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:50.991914 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 6dfb3a603d584bcabbf0c9f0d3594ff7 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:50.996805 14095 tablet_service.cc:1511] Processing CreateTablet for tablet 29a259ed126849a0a6653f5d96884b87 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:50.998312 14097 tablet_service.cc:1511] Processing CreateTablet for tablet 183a076c0e614a54b0a8875f351528a3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:51.000914 14169 tablet_service.cc:1511] Processing CreateTablet for tablet 9b052613656f42f19ebcb9c59686e9a3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:50.882010 14093 tablet_service.cc:1511] Processing CreateTablet for tablet a7b2ad2ed67144c6b9baffea26c9ae16 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:50.815680 14384 raft_consensus.cc:359] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:51.017495 14384 raft_consensus.cc:385] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:51.017946 14384 raft_consensus.cc:740] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:51.018916 14384 consensus_queue.cc:260] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:51.023623 14390 leader_election.cc:290] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:50.941291 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 29a259ed126849a0a6653f5d96884b87 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:50.943372 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b2ad2ed67144c6b9baffea26c9ae16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.951889 14320 tablet_service.cc:1511] Processing CreateTablet for tablet 183a076c0e614a54b0a8875f351528a3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:50.957309 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 29a259ed126849a0a6653f5d96884b87 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:50.961578 14098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd224c5b12246cf83abcd8530f9e091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.969522 14176 tablet_service.cc:1511] Processing CreateTablet for tablet 6a68e63a39ca44319695c6f4e9937912 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:50.971140 14319 tablet_service.cc:1511] Processing CreateTablet for tablet 6a68e63a39ca44319695c6f4e9937912 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:50.976795 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9282e9c78a46a6a3bba23269e7adc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.911688 14323 tablet_service.cc:1511] Processing CreateTablet for tablet b9141f0570cd47eeb0583a4a7ca21ea0 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:51.065960 14101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa413bb6214043609003b441decca56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.069710 14317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa413bb6214043609003b441decca56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.071674 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b052613656f42f19ebcb9c59686e9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.077076 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a259ed126849a0a6653f5d96884b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.087611 14324 tablet_service.cc:1511] Processing CreateTablet for tablet df25294a6ce4432cbffe41a0bee4c8b8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:51.097079 14102 tablet_service.cc:1511] Processing CreateTablet for tablet df25294a6ce4432cbffe41a0bee4c8b8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:51.098739 14102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df25294a6ce4432cbffe41a0bee4c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.110194 14389 raft_consensus.cc:493] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.110751 14389 raft_consensus.cc:515] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:51.123805 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:51.125792 14226 leader_election.cc:343] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.125942 14389 leader_election.cc:290] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:51.159994 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dfb3a603d584bcabbf0c9f0d3594ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.165359 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a259ed126849a0a6653f5d96884b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.094532 14094 tablet_service.cc:1511] Processing CreateTablet for tablet 9b052613656f42f19ebcb9c59686e9a3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:51.144501 14382 tablet_bootstrap.cc:700] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6: Time spent opening tablet: real 0.161s	user 0.005s	sys 0.000s
I20260709 13:18:51.166622 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df25294a6ce4432cbffe41a0bee4c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.180927 14249 tablet_service.cc:1511] Processing CreateTablet for tablet 9b052613656f42f19ebcb9c59686e9a3 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:51.182382 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b052613656f42f19ebcb9c59686e9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.188951 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9141f0570cd47eeb0583a4a7ca21ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.205072 14168 tablet_service.cc:1511] Processing CreateTablet for tablet df25294a6ce4432cbffe41a0bee4c8b8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:51.206877 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df25294a6ce4432cbffe41a0bee4c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.187690 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e519b3fde754be785619f806259cbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.224018 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a68e63a39ca44319695c6f4e9937912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.224352 14404 raft_consensus.cc:493] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.224874 14404 raft_consensus.cc:515] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:51.225761 14390 raft_consensus.cc:493] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.226281 14390 raft_consensus.cc:515] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:51.228680 14390 leader_election.cc:290] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:51.234361 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc372b890581484a9c147f584264c31f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.207633 14102 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfcde74e8344c17a4afcd878be63bbb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:51.237779 14319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a68e63a39ca44319695c6f4e9937912. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.253557 14245 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfcde74e8344c17a4afcd878be63bbb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:51.265662 14175 tablet_service.cc:1511] Processing CreateTablet for tablet 374a720a9f0d4319a36fe8b4b060a5d8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:51.273070 14383 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:51.273743 14383 ts_tablet_manager.cc:1403] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.517s	user 0.056s	sys 0.043s
I20260709 13:18:51.276618 14404 leader_election.cc:290] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:51.261572 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b2ad2ed67144c6b9baffea26c9ae16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.263548 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183a076c0e614a54b0a8875f351528a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.313053 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9141f0570cd47eeb0583a4a7ca21ea0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:51.323128 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:51.329591 14177 tablet_service.cc:1511] Processing CreateTablet for tablet 82c6d6688efe44588062121fe1de87d2 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:51.329993 14250 tablet_service.cc:1511] Processing CreateTablet for tablet 374a720a9f0d4319a36fe8b4b060a5d8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:51.328088 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374a720a9f0d4319a36fe8b4b060a5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.325495 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183a076c0e614a54b0a8875f351528a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.326114 14245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfcde74e8344c17a4afcd878be63bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.343045 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183a076c0e614a54b0a8875f351528a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.343940 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c6d6688efe44588062121fe1de87d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.344515 14244 tablet_service.cc:1511] Processing CreateTablet for tablet 82c6d6688efe44588062121fe1de87d2 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:51.306502 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 3dfcde74e8344c17a4afcd878be63bbb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:51.359472 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfcde74e8344c17a4afcd878be63bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.338711 14382 tablet_bootstrap.cc:654] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:51.369432 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a259ed126849a0a6653f5d96884b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.369993 14244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c6d6688efe44588062121fe1de87d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.372572 14384 ts_tablet_manager.cc:1434] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.560s	user 0.028s	sys 0.057s
W20260709 13:18:51.372920 14384 ts_tablet_manager.cc:1467] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215: Tablet startup took 560ms
I20260709 13:18:51.373963 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374a720a9f0d4319a36fe8b4b060a5d8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:51.373238 14384 ts_tablet_manager.cc:1469] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215: Trace:
0709 13:18:50.272360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.272540 (+   180us) service_pool.cc:224] Handling call
0709 13:18:50.274424 (+  1884us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:50.274518 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:50.298350 (+ 23832us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:50.384252 (+ 85902us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:50.406691 (+ 22439us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:50.407530 (+   839us) inbound_call.cc:177] Queueing success response
0709 13:18:50.812468 (+404938us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:50.813050 (+   582us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:50.813638 (+   588us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":203866,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"tablet-open.queue_time_us":22048,"thread_start_us":192249,"threads_started":2}
I20260709 13:18:51.391280 14384 tablet_bootstrap.cc:492] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:51.400035 14316 tablet_service.cc:1511] Processing CreateTablet for tablet 374a720a9f0d4319a36fe8b4b060a5d8 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:51.400620 14383 raft_consensus.cc:359] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:51.401443 14383 raft_consensus.cc:385] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:51.401559 14316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374a720a9f0d4319a36fe8b4b060a5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.401793 14383 raft_consensus.cc:740] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:51.402812 14383 consensus_queue.cc:260] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:51.405546 14243 tablet_service.cc:1511] Processing CreateTablet for tablet 8465239326774a1386ddba99f9e50efb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:51.406932 14243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8465239326774a1386ddba99f9e50efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.406749 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 183f0c224f074c99903307d0678a8ccf (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:51.412237 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:51.409883 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183f0c224f074c99903307d0678a8ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.420351 14381 tablet_bootstrap.cc:654] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:51.424175 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4848588d16a4c4f89e884a9f15ff4a7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:51.425228 14098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 18) took 1189 ms. Trace:
W20260709 13:18:51.426184 14153 leader_election.cc:343] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.433887 14100 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 20) took 1168 ms. Trace:
I20260709 13:18:51.434422 14100 rpcz_store.cc:276] 0709 13:18:50.265299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.801473 (+536174us) service_pool.cc:224] Handling call
0709 13:18:50.878053 (+ 76580us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:50.878159 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:51.128882 (+250723us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:51.433306 (+304424us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:51.433820 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.437458 14100 tablet_service.cc:1511] Processing CreateTablet for tablet 82c6d6688efe44588062121fe1de87d2 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:51.447579 14246 tablet_service.cc:1511] Processing CreateTablet for tablet c9aa82f67f724a9789d4486481fc7f6a (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:51.449064 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9aa82f67f724a9789d4486481fc7f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.447641 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1e37d29fe1480da8cf0ccc966e8f5c" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:51.456568 14225 leader_election.cc:343] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.457064 14225 leader_election.cc:304] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:51.457890 14392 raft_consensus.cc:2749] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:51.460215 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:51.464576 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4848588d16a4c4f89e884a9f15ff4a7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:51.468164 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 9490553a32884f388ba3fcdc7ae7ac6e (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:51.469086 14318 tablet_service.cc:1511] Processing CreateTablet for tablet 9490553a32884f388ba3fcdc7ae7ac6e (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:51.469409 14171 tablet_service.cc:1511] Processing CreateTablet for tablet f71afc145d3844248a07bbf2114fbd5f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:51.470477 14318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9490553a32884f388ba3fcdc7ae7ac6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.472162 14102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dfcde74e8344c17a4afcd878be63bbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.469524 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9490553a32884f388ba3fcdc7ae7ac6e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:51.477749 14300 leader_election.cc:343] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.481303 14383 ts_tablet_manager.cc:1434] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.207s	user 0.009s	sys 0.001s
I20260709 13:18:51.425740 14098 rpcz_store.cc:276] 0709 13:18:50.236024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.762569 (+526545us) service_pool.cc:224] Handling call
0709 13:18:50.916965 (+154396us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:50.917071 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:51.212035 (+294964us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:51.424762 (+212727us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:51.425173 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.486269 14098 tablet_service.cc:1511] Processing CreateTablet for tablet 9490553a32884f388ba3fcdc7ae7ac6e (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:51.487393 14100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c6d6688efe44588062121fe1de87d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.490486 14322 tablet_service.cc:1511] Processing CreateTablet for tablet 8465239326774a1386ddba99f9e50efb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:18:51.492908 14152 leader_election.cc:343] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:51.493830 14152 leader_election.cc:343] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.494374 14152 leader_election.cc:304] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:51.495419 14390 raft_consensus.cc:2749] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:51.497946 14383 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:51.507670 14319 tablet_service.cc:1511] Processing CreateTablet for tablet 183f0c224f074c99903307d0678a8ccf (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:51.521126 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:51.525555 14151 leader_election.cc:343] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.526165 14151 leader_election.cc:304] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:51.527256 14390 raft_consensus.cc:2749] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:51.529143 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8465239326774a1386ddba99f9e50efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.532771 14384 tablet_bootstrap.cc:654] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:51.546056 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:51.587044 14077 leader_election.cc:343] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.596266 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
W20260709 13:18:51.598188 14078 leader_election.cc:343] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.598680 14078 leader_election.cc:304] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:51.599972 14389 raft_consensus.cc:2749] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:51.548373 14101 tablet_service.cc:1511] Processing CreateTablet for tablet 8465239326774a1386ddba99f9e50efb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:18:51.528770 13995 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 45657.6us
I20260709 13:18:51.841076 14169 tablet_service.cc:1511] Processing CreateTablet for tablet c9aa82f67f724a9789d4486481fc7f6a (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:18:51.604281 13997 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 114728us
I20260709 13:18:51.604344 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71afc145d3844248a07bbf2114fbd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.622210 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1e37d29fe1480da8cf0ccc966e8f5c" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:51.888970 14316 tablet_service.cc:1511] Processing CreateTablet for tablet f4709c305db34d068e37448bc1462f47 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:18:51.610564 13996 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 114627us
I20260709 13:18:51.891656 14322 tablet_service.cc:1511] Processing CreateTablet for tablet a95255a6465943e199a2aa0b7601bf32 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:51.892889 14176 tablet_service.cc:1511] Processing CreateTablet for tablet 3c732e8e709f497eaee427bcad377540 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:51.893122 14175 tablet_service.cc:1511] Processing CreateTablet for tablet f4709c305db34d068e37448bc1462f47 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:18:51.893608 14299 leader_election.cc:343] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.626282 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 2d48bba4064b47cca8fada00e303488c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:51.895488 14245 tablet_service.cc:1511] Processing CreateTablet for tablet f4709c305db34d068e37448bc1462f47 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:51.616385 14319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183f0c224f074c99903307d0678a8ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.897177 14170 tablet_service.cc:1511] Processing CreateTablet for tablet cf2074eb6b644c7f926c78e9ded22c1c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:51.897677 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95255a6465943e199a2aa0b7601bf32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.631965 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 27f20266f4854ae8ae019ba0cb907c7c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:51.899359 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f20266f4854ae8ae019ba0cb907c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.899190 14168 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f8d4bb28b4564a44774231b92f8c9 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:51.624199 14249 tablet_service.cc:1511] Processing CreateTablet for tablet 27f20266f4854ae8ae019ba0cb907c7c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:51.637759 14323 tablet_service.cc:1511] Processing CreateTablet for tablet 3c732e8e709f497eaee427bcad377540 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:51.902518 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c732e8e709f497eaee427bcad377540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.661187 14324 tablet_service.cc:1511] Processing CreateTablet for tablet f71afc145d3844248a07bbf2114fbd5f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:51.905296 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71afc145d3844248a07bbf2114fbd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.630100 14381 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:51.909299 14381 ts_tablet_manager.cc:1403] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.922s	user 0.035s	sys 0.034s
I20260709 13:18:51.910043 14246 tablet_service.cc:1511] Processing CreateTablet for tablet cf2074eb6b644c7f926c78e9ded22c1c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:51.664984 14384 tablet_bootstrap.cc:492] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:51.911675 14384 ts_tablet_manager.cc:1403] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.521s	user 0.015s	sys 0.014s
I20260709 13:18:51.912142 14247 tablet_service.cc:1511] Processing CreateTablet for tablet a95255a6465943e199a2aa0b7601bf32 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:51.914803 14384 raft_consensus.cc:359] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:51.915553 14384 raft_consensus.cc:385] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:51.662267 14389 raft_consensus.cc:493] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.918385 14389 raft_consensus.cc:515] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:51.657829 14382 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:51.920964 14382 ts_tablet_manager.cc:1403] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.943s	user 0.024s	sys 0.038s
I20260709 13:18:51.923413 14242 tablet_service.cc:1511] Processing CreateTablet for tablet 80d51f9492d6490eb3724b897994f107 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:51.676159 14383 tablet_bootstrap.cc:654] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:51.769037 14098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9490553a32884f388ba3fcdc7ae7ac6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.735437 14100 tablet_service.cc:1511] Processing CreateTablet for tablet f71afc145d3844248a07bbf2114fbd5f (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:51.775024 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 2d48bba4064b47cca8fada00e303488c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:51.804394 14172 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39308 (request call id 21) took 1515 ms. Trace:
I20260709 13:18:51.805920 14093 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 22) took 1044 ms. Trace:
I20260709 13:18:51.817358 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 54d9e8510eb240098e1916592b497767 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:51.830725 14095 tablet_service.cc:1511] Processing CreateTablet for tablet 54d9e8510eb240098e1916592b497767 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:51.831619 14177 tablet_service.cc:1511] Processing CreateTablet for tablet 183f0c224f074c99903307d0678a8ccf (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:51.832165 14096 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 19) took 1567 ms. Trace:
I20260709 13:18:51.833654 14102 tablet_service.cc:1511] Processing CreateTablet for tablet 2d48bba4064b47cca8fada00e303488c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:51.837105 14099 tablet_service.cc:1511] Processing CreateTablet for tablet c9aa82f67f724a9789d4486481fc7f6a (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:51.879320 14097 tablet_service.cc:1511] Processing CreateTablet for tablet 3c732e8e709f497eaee427bcad377540 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:51.887971 14320 tablet_service.cc:1511] Processing CreateTablet for tablet cb81836efc194afea3e9a9b0a1e5d000 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:51.888990 14318 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f8d4bb28b4564a44774231b92f8c9 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:51.926796 14093 rpcz_store.cc:276] 0709 13:18:50.761418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.880966 (+119548us) service_pool.cc:224] Handling call
0709 13:18:51.043577 (+162611us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.050595 (+  7018us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:51.552950 (+502355us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:51.805394 (+252444us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:51.805858 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.928704 14096 rpcz_store.cc:276] 0709 13:18:50.264941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.770625 (+505684us) service_pool.cc:224] Handling call
0709 13:18:50.962177 (+191552us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:50.962338 (+   161us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:51.449613 (+487275us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:51.831573 (+381960us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:51.832090 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103}
I20260709 13:18:51.932770 14093 tablet_service.cc:1511] Processing CreateTablet for tablet cb81836efc194afea3e9a9b0a1e5d000 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:51.569061 14251 tablet_service.cc:1511] Processing CreateTablet for tablet 54d9e8510eb240098e1916592b497767 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:51.894130 14299 leader_election.cc:304] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:51.895988 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d48bba4064b47cca8fada00e303488c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.926678 14172 rpcz_store.cc:276] 0709 13:18:50.288822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.797115 (+508293us) service_pool.cc:224] Handling call
0709 13:18:50.805450 (+  8335us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:50.805549 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:51.565398 (+759849us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:51.796679 (+231281us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:51.804325 (+  7646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.935144 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d9e8510eb240098e1916592b497767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.935798 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f20266f4854ae8ae019ba0cb907c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.908347 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c732e8e709f497eaee427bcad377540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.910705 14244 tablet_service.cc:1511] Processing CreateTablet for tablet ef01c7e413414a618fc490804422f834 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:51.916034 14243 tablet_service.cc:1511] Processing CreateTablet for tablet 876b3eb00a984f94a6d6df1d7472bedb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:51.939973 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95255a6465943e199a2aa0b7601bf32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.941026 14168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f8d4bb28b4564a44774231b92f8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.941649 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d48bba4064b47cca8fada00e303488c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.941860 14244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef01c7e413414a618fc490804422f834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.942442 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4709c305db34d068e37448bc1462f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.943761 14245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4709c305db34d068e37448bc1462f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.947805 14243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876b3eb00a984f94a6d6df1d7472bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.947929 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 183f0c224f074c99903307d0678a8ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.954579 14381 raft_consensus.cc:359] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:51.955353 14381 raft_consensus.cc:385] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:51.955658 14381 raft_consensus.cc:740] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:51.957268 14389 leader_election.cc:290] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:51.957506 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:51.919924 14322 tablet_service.cc:1511] Processing CreateTablet for tablet ef01c7e413414a618fc490804422f834 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:51.775099 14174 tablet_service.cc:1511] Processing CreateTablet for tablet 27f20266f4854ae8ae019ba0cb907c7c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:51.915836 14384 raft_consensus.cc:740] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:51.889436 14317 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54150 (request call id 22) took 1064 ms. Trace:
I20260709 13:18:51.936416 14172 tablet_service.cc:1511] Processing CreateTablet for tablet ef01c7e413414a618fc490804422f834 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:18:51.960355 14078 leader_election.cc:343] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:51.933384 14096 tablet_service.cc:1511] Processing CreateTablet for tablet cf2074eb6b644c7f926c78e9ded22c1c (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:51.968705 14382 raft_consensus.cc:359] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:51.968848 14384 consensus_queue.cc:260] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:51.969671 14382 raft_consensus.cc:385] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:51.970077 14382 raft_consensus.cc:740] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:51.970923 14382 consensus_queue.cc:260] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:51.962201 14317 rpcz_store.cc:276] 0709 13:18:50.824812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.906437 (+ 81625us) service_pool.cc:224] Handling call
0709 13:18:50.993557 (+ 87120us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:50.993645 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:51.338253 (+344608us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:51.791226 (+452973us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:51.889380 (+ 98154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99772}
I20260709 13:18:51.981710 14317 tablet_service.cc:1511] Processing CreateTablet for tablet 34dc4074ff05452dbda3ce53bbc859f1 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:51.968289 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f20266f4854ae8ae019ba0cb907c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.984419 14170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2074eb6b644c7f926c78e9ded22c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.962828 14242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d51f9492d6490eb3724b897994f107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.986529 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef01c7e413414a618fc490804422f834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.995162 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2074eb6b644c7f926c78e9ded22c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.972831 14250 tablet_service.cc:1511] Processing CreateTablet for tablet cb81836efc194afea3e9a9b0a1e5d000 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:51.961820 14101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8465239326774a1386ddba99f9e50efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.004483 14102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d48bba4064b47cca8fada00e303488c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.005244 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9aa82f67f724a9789d4486481fc7f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.005998 14093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb81836efc194afea3e9a9b0a1e5d000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.006853 14100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71afc145d3844248a07bbf2114fbd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.007632 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d9e8510eb240098e1916592b497767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.008198 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9aa82f67f724a9789d4486481fc7f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.017989 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c732e8e709f497eaee427bcad377540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.019007 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb81836efc194afea3e9a9b0a1e5d000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:51.963028 14316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4709c305db34d068e37448bc1462f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.021178 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb81836efc194afea3e9a9b0a1e5d000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.021742 14094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b052613656f42f19ebcb9c59686e9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.023034 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2074eb6b644c7f926c78e9ded22c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.023047 14317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34dc4074ff05452dbda3ce53bbc859f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.031296 14416 raft_consensus.cc:2749] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:52.067348 14318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f8d4bb28b4564a44774231b92f8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.069180 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef01c7e413414a618fc490804422f834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.071272 14383 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:52.078104 14383 ts_tablet_manager.cc:1403] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.580s	user 0.011s	sys 0.015s
I20260709 13:18:52.083248 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d9e8510eb240098e1916592b497767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.087541 14383 raft_consensus.cc:359] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.088757 14383 raft_consensus.cc:385] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.089115 14383 raft_consensus.cc:740] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.090021 14383 consensus_queue.cc:260] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.096709 14383 ts_tablet_manager.cc:1434] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:18:52.097829 14383 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:52.099656 14381 consensus_queue.cc:260] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.163250 14422 raft_consensus.cc:493] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.167928 14381 ts_tablet_manager.cc:1434] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.258s	user 0.011s	sys 0.032s
I20260709 13:18:52.169100 14381 tablet_bootstrap.cc:492] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:52.177328 14381 tablet_bootstrap.cc:654] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.177913 14382 ts_tablet_manager.cc:1434] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.257s	user 0.016s	sys 0.013s
I20260709 13:18:52.183607 14382 tablet_bootstrap.cc:492] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:52.184358 14422 raft_consensus.cc:515] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.184964 14389 raft_consensus.cc:493] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.185604 14389 raft_consensus.cc:515] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.187603 14389 leader_election.cc:290] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:52.187780 14422 leader_election.cc:290] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:52.188455 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:52.189374 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:52.189976 14151 leader_election.cc:343] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.190582 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
W20260709 13:18:52.190698 14077 leader_election.cc:343] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:52.192135 14153 leader_election.cc:343] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.192608 14153 leader_election.cc:304] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:52.193704 14422 raft_consensus.cc:2749] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:52.215925 14317 tablet_service.cc:1511] Processing CreateTablet for tablet 876b3eb00a984f94a6d6df1d7472bedb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:52.217484 14317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876b3eb00a984f94a6d6df1d7472bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.233620 14319 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54150 (request call id 32) took 1104 ms. Trace:
I20260709 13:18:52.234272 14319 rpcz_store.cc:276] 0709 13:18:51.129563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.506328 (+376765us) service_pool.cc:224] Handling call
0709 13:18:51.508854 (+  2526us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.508972 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:51.915948 (+406976us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.232918 (+316970us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.233537 (+   619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.249495 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 34dc4074ff05452dbda3ce53bbc859f1 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:52.251446 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34dc4074ff05452dbda3ce53bbc859f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.257221 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 80d51f9492d6490eb3724b897994f107 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:52.260943 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d51f9492d6490eb3724b897994f107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.264361 14419 raft_consensus.cc:493] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.265043 14419 raft_consensus.cc:515] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.265915 14095 tablet_service.cc:1511] Processing CreateTablet for tablet cb9f8d4bb28b4564a44774231b92f8c9 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:52.268674 14095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9f8d4bb28b4564a44774231b92f8c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:52.277225 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 383602us
I20260709 13:18:52.294221 14419 leader_election.cc:290] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
W20260709 13:18:52.313474 13997 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 77556.6us
W20260709 13:18:52.315312 13996 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 64409.8us
I20260709 13:18:52.296607 14099 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 33) took 1165 ms. Trace:
I20260709 13:18:52.322219 14099 rpcz_store.cc:276] 0709 13:18:51.131659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.551371 (+419712us) service_pool.cc:224] Handling call
0709 13:18:51.941239 (+389868us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.941331 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.122127 (+180796us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.295982 (+173855us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.296541 (+   559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696768}
I20260709 13:18:52.324311 14099 tablet_service.cc:1511] Processing CreateTablet for tablet 80d51f9492d6490eb3724b897994f107 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:52.360832 14383 tablet_bootstrap.cc:654] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.413611 14420 raft_consensus.cc:493] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.414400 14420 raft_consensus.cc:515] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.431231 14097 tablet_service.cc:1511] Processing CreateTablet for tablet a95255a6465943e199a2aa0b7601bf32 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:52.452069 14382 tablet_bootstrap.cc:700] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent opening tablet: real 0.124s	user 0.008s	sys 0.008s
I20260709 13:18:52.455628 14251 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55560 (request call id 34) took 1050 ms. Trace:
I20260709 13:18:52.456502 14099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d51f9492d6490eb3724b897994f107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.458736 14381 tablet_bootstrap.cc:492] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
W20260709 13:18:52.459841 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:52.478529 14381 ts_tablet_manager.cc:1403] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.310s	user 0.069s	sys 0.059s
I20260709 13:18:52.481712 14381 raft_consensus.cc:359] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.482453 14381 raft_consensus.cc:385] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.482746 14381 raft_consensus.cc:740] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.483598 14381 consensus_queue.cc:260] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.464926 14323 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54150 (request call id 36) took 1016 ms. Trace:
I20260709 13:18:52.466717 14098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 31) took 1359 ms. Trace:
I20260709 13:18:52.467803 14324 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54150 (request call id 33) took 1148 ms. Trace:
I20260709 13:18:52.490774 14324 rpcz_store.cc:276] 0709 13:18:51.319843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.617214 (+297371us) service_pool.cc:224] Handling call
0709 13:18:51.904863 (+287649us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.904954 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.001753 (+ 96799us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.467344 (+465591us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.467746 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.489033 14098 rpcz_store.cc:276] 0709 13:18:51.106985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.484999 (+378014us) service_pool.cc:224] Handling call
0709 13:18:51.487166 (+  2167us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.487250 (+    84us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.193880 (+706630us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.466258 (+272378us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.466659 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.493980 14098 tablet_service.cc:1511] Processing CreateTablet for tablet 876b3eb00a984f94a6d6df1d7472bedb (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:52.472891 14384 ts_tablet_manager.cc:1434] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.561s	user 0.015s	sys 0.015s
I20260709 13:18:52.471647 14325 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54150 (request call id 34) took 1120 ms. Trace:
I20260709 13:18:52.490423 14382 tablet_bootstrap.cc:654] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.504321 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:52.505234 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:52.516294 14384 ts_tablet_manager.cc:1467] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215: Tablet startup took 601ms
I20260709 13:18:52.518599 14177 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39308 (request call id 32) took 1062 ms. Trace:
I20260709 13:18:52.531709 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4848588d16a4c4f89e884a9f15ff4a7" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:52.532877 14186 raft_consensus.cc:2468] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:52.534291 14077 leader_election.cc:304] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:52.535389 14389 raft_consensus.cc:2804] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:52.535766 14389 raft_consensus.cc:493] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.536095 14389 raft_consensus.cc:3060] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.488363 14323 rpcz_store.cc:276] 0709 13:18:51.448393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.636645 (+188252us) service_pool.cc:224] Handling call
0709 13:18:51.902109 (+265464us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.902192 (+    83us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.002670 (+100478us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.464434 (+461764us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.464870 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.527408 14177 rpcz_store.cc:276] 0709 13:18:51.456327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.551755 (+ 95428us) service_pool.cc:224] Handling call
0709 13:18:51.928994 (+377239us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.930672 (+  1678us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.478500 (+547828us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.518090 (+ 39590us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.518538 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:52.542553 14077 leader_election.cc:343] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.543001 14077 leader_election.cc:304] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:52.487353 14251 rpcz_store.cc:276] 0709 13:18:51.405414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.420007 (+ 14593us) service_pool.cc:224] Handling call
0709 13:18:51.934701 (+514694us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.934790 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.151893 (+217103us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.455120 (+303227us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.455565 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.521929 14325 rpcz_store.cc:276] 0709 13:18:51.351298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.615915 (+264617us) service_pool.cc:224] Handling call
0709 13:18:51.928995 (+313080us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.929785 (+   790us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.298695 (+368910us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.471032 (+172337us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.471569 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.547307 14097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95255a6465943e199a2aa0b7601bf32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.555910 14098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876b3eb00a984f94a6d6df1d7472bedb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.557310 14381 ts_tablet_manager.cc:1434] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:18:52.558503 14174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39308 (request call id 35) took 1101 ms. Trace:
I20260709 13:18:52.558933 14174 rpcz_store.cc:276] 0709 13:18:51.457300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.774085 (+316785us) service_pool.cc:224] Handling call
0709 13:18:51.960537 (+186452us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.961275 (+   738us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:51.999351 (+ 38076us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.522217 (+522866us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.558443 (+ 36226us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:52.543625 14300 leader_election.cc:343] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.576568 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1e37d29fe1480da8cf0ccc966e8f5c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:52.579092 14381 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
W20260709 13:18:52.584470 14225 leader_election.cc:343] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.585531 14101 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 32) took 1465 ms. Trace:
I20260709 13:18:52.586072 14101 rpcz_store.cc:276] 0709 13:18:51.120597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.547265 (+426668us) service_pool.cc:224] Handling call
0709 13:18:51.839580 (+292315us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.839687 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.496387 (+656700us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.545691 (+ 49304us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.585457 (+ 39766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.598533 14096 tablet_service.cc:1511] Processing CreateTablet for tablet 34dc4074ff05452dbda3ce53bbc859f1 (DEFAULT_TABLE table=test-workload [id=3af6bd4d0e764aa2b2f5940ef749eb5f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:52.599347 14383 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:52.599910 14383 ts_tablet_manager.cc:1403] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.502s	user 0.036s	sys 0.060s
I20260709 13:18:52.600083 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34dc4074ff05452dbda3ce53bbc859f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:52.602628 14100 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 34) took 1272 ms. Trace:
I20260709 13:18:52.603295 14383 raft_consensus.cc:359] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.604137 14383 raft_consensus.cc:385] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.604775 14383 raft_consensus.cc:740] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
W20260709 13:18:52.603571 14077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 61070.4us
I20260709 13:18:52.605882 14169 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:39308 (request call id 33) took 1149 ms. Trace:
I20260709 13:18:52.605650 14383 consensus_queue.cc:260] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.603036 14100 rpcz_store.cc:276] 0709 13:18:51.329773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.734438 (+404665us) service_pool.cc:224] Handling call
0709 13:18:51.927905 (+193467us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.928561 (+   656us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.499036 (+570475us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.602137 (+103101us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.602566 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.606525 14169 rpcz_store.cc:276] 0709 13:18:51.456682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.606469 (+149787us) service_pool.cc:224] Handling call
0709 13:18:51.841915 (+235446us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.842005 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.522116 (+680111us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.605397 (+ 83281us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.605824 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:52.589941 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 46354.3us
I20260709 13:18:52.612287 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4848588d16a4c4f89e884a9f15ff4a7" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:52.612914 14187 raft_consensus.cc:2468] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:52.614255 14300 leader_election.cc:304] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:52.615078 14419 raft_consensus.cc:2804] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:52.615435 14419 raft_consensus.cc:493] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.615756 14419 raft_consensus.cc:3060] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:52.527226 14384 ts_tablet_manager.cc:1469] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215: Trace:
0709 13:18:50.270063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.274601 (+  4538us) service_pool.cc:224] Handling call
0709 13:18:50.277820 (+  3219us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:50.277921 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:50.378658 (+100737us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:50.399474 (+ 20816us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:50.400024 (+   550us) inbound_call.cc:177] Queueing success response
0709 13:18:51.390869 (+990845us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:51.911976 (+521107us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:51.912502 (+   526us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:51.913103 (+   601us) tablet_replica.cc:280] Starting consensus
0709 13:18:52.335528 (+422425us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b180031e1c0. stack: 00007f31fa2f2343 00007f31fa2f2240 00007f31f9c811d4 00007f32039bf304 00007f32039bf299 00007f32031ecde1 00007f32031f95b1 00007f31fcfb94bc 00007f31fa30748b 00007f3203161ab9 00007f31fa32369b 00007f31fa32193f 00007f31fa321455 00007f31fd409060 00007f31fd406d71 00007f3200e03b2e
Metrics: {"mutex_wait_us":33,"raft.queue_time_us":103591,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":3483,"spinlock_wait_cycles":47645952,"tablet-open.queue_time_us":990896,"thread_start_us":111124,"threads_started":1}
I20260709 13:18:52.574469 14420 leader_election.cc:290] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:52.631242 14384 tablet_bootstrap.cc:492] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:52.632107 14381 tablet_bootstrap.cc:654] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.635212 14430 raft_consensus.cc:2749] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:52.639441 14384 tablet_bootstrap.cc:654] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.648177 14102 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 36) took 1286 ms. Trace:
I20260709 13:18:52.648754 14102 rpcz_store.cc:276] 0709 13:18:51.361603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.832699 (+471096us) service_pool.cc:224] Handling call
0709 13:18:51.930726 (+ 98027us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.930838 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.483268 (+552430us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.635463 (+152195us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.648111 (+ 12648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505024}
I20260709 13:18:52.653812 14389 raft_consensus.cc:515] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.656946 14382 tablet_bootstrap.cc:492] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:52.657672 14094 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54288 (request call id 27) took 1670 ms. Trace:
I20260709 13:18:52.662935 14382 ts_tablet_manager.cc:1403] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.480s	user 0.028s	sys 0.015s
I20260709 13:18:52.667862 14382 raft_consensus.cc:359] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.668664 14382 raft_consensus.cc:385] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.668949 14382 raft_consensus.cc:740] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.669952 14382 consensus_queue.cc:260] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.670715 14419 raft_consensus.cc:515] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.671612 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:52.673013 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:52.673611 14422 raft_consensus.cc:493] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.674206 14422 raft_consensus.cc:515] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.674666 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4848588d16a4c4f89e884a9f15ff4a7" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:52.661979 14094 rpcz_store.cc:276] 0709 13:18:50.987729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.093645 (+105916us) service_pool.cc:224] Handling call
0709 13:18:51.184878 (+ 91233us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:18:51.189617 (+  4739us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:18:52.488526 (+1298909us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:52.656948 (+168422us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:52.657593 (+   645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.675340 14186 raft_consensus.cc:3060] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.673226 14419 leader_election.cc:290] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:52.676262 14383 ts_tablet_manager.cc:1434] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.076s	user 0.026s	sys 0.031s
I20260709 13:18:52.677434 14383 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:52.677798 14422 leader_election.cc:290] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:52.678990 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:52.679845 14041 debug-util.cc:398] Leaking SignalData structure 0x7b0800383100 after lost signal to thread 7079
W20260709 13:18:52.681142 14041 debug-util.cc:398] Leaking SignalData structure 0x7b0800046a40 after lost signal to thread 14044
W20260709 13:18:52.682535 14041 debug-util.cc:398] Leaking SignalData structure 0x7b0800151b00 after lost signal to thread 14136
I20260709 13:18:52.683894 14383 tablet_bootstrap.cc:654] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:52.686161 14041 debug-util.cc:398] Leaking SignalData structure 0x7b0800253c80 after lost signal to thread 14285
W20260709 13:18:52.687273 14152 leader_election.cc:343] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:52.689657 14077 leader_election.cc:343] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.687163 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:52.672292 14187 raft_consensus.cc:3060] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:52.692410 14153 leader_election.cc:343] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.693019 14153 leader_election.cc:304] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:52.694480 14422 raft_consensus.cc:2749] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:52.695827 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4848588d16a4c4f89e884a9f15ff4a7" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:52.696568 14261 raft_consensus.cc:3060] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.697564 14186 raft_consensus.cc:2468] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:52.698908 14300 leader_election.cc:304] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:52.699870 14419 raft_consensus.cc:2804] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:52.669406 14389 leader_election.cc:290] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:52.672297 14382 ts_tablet_manager.cc:1434] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:18:52.710263 14384 tablet_bootstrap.cc:492] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:52.724714 14384 ts_tablet_manager.cc:1403] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.003s
I20260709 13:18:52.728754 14384 raft_consensus.cc:359] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.729351 14384 raft_consensus.cc:385] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.729663 14384 raft_consensus.cc:740] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.730249 14419 raft_consensus.cc:697] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:52.723048 14187 raft_consensus.cc:2468] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:52.731321 14383 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:52.731321 14419 consensus_queue.cc:237] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.732951 14383 ts_tablet_manager.cc:1403] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.028s
I20260709 13:18:52.733134 14381 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:52.733217 14077 leader_election.cc:304] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:52.733843 14381 ts_tablet_manager.cc:1403] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.005s
I20260709 13:18:52.734684 14389 raft_consensus.cc:2804] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:52.735193 14389 raft_consensus.cc:697] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:52.736034 14389 consensus_queue.cc:237] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.739996 14383 raft_consensus.cc:359] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.740962 14383 raft_consensus.cc:385] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.741304 14383 raft_consensus.cc:740] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.742866 14261 raft_consensus.cc:2468] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:52.724785 14382 tablet_bootstrap.cc:492] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:52.736690 14384 consensus_queue.cc:260] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.750806 14382 tablet_bootstrap.cc:654] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.752374 14381 raft_consensus.cc:359] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.781252 14381 raft_consensus.cc:385] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.780895 14383 consensus_queue.cc:260] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.781610 14381 raft_consensus.cc:740] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.781711 14435 raft_consensus.cc:493] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.782224 14435 raft_consensus.cc:515] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.782593 14381 consensus_queue.cc:260] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.783461 14383 ts_tablet_manager.cc:1434] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.014s
I20260709 13:18:52.788399 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1e37d29fe1480da8cf0ccc966e8f5c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:52.789000 14435 leader_election.cc:290] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:52.789096 14335 raft_consensus.cc:2468] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:52.790700 14227 leader_election.cc:304] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:52.791646 14420 raft_consensus.cc:2804] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:52.787329 14384 ts_tablet_manager.cc:1434] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.011s
I20260709 13:18:52.792193 14420 raft_consensus.cc:493] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.792428 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:52.792737 14420 raft_consensus.cc:3060] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.793201 14187 raft_consensus.cc:2468] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:52.793421 14384 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:52.796916 14381 ts_tablet_manager.cc:1434] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.063s	user 0.011s	sys 0.002s
I20260709 13:18:52.796679 14300 leader_election.cc:304] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:52.798082 14381 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:52.798121 14436 raft_consensus.cc:2804] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:52.798837 14436 raft_consensus.cc:493] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.799273 14436 raft_consensus.cc:3060] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.800411 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:52.801723 14383 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:18:52.801999 14300 leader_election.cc:343] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.811563 14420 raft_consensus.cc:515] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.818181 14381 tablet_bootstrap.cc:654] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.820744 14436 raft_consensus.cc:515] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.822592 14383 tablet_bootstrap.cc:654] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.826686 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1e37d29fe1480da8cf0ccc966e8f5c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:52.826213 14009 catalog_manager.cc:5697] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.827310 14112 raft_consensus.cc:3060] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.823689 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:52.824666 14008 catalog_manager.cc:5697] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:52.825584 14420 leader_election.cc:290] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:52.828934 14187 raft_consensus.cc:3060] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.828346 14384 tablet_bootstrap.cc:654] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.829046 14436 leader_election.cc:290] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:52.836476 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
W20260709 13:18:52.837934 14300 leader_election.cc:343] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.842736 14389 raft_consensus.cc:493] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.842896 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1e37d29fe1480da8cf0ccc966e8f5c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:52.843565 14335 raft_consensus.cc:3060] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.844805 14383 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:52.845314 14383 ts_tablet_manager.cc:1403] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.002s
I20260709 13:18:52.843304 14389 raft_consensus.cc:515] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.848796 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96808d860d8457caea08dbac23516b3" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:52.849587 14389 leader_election.cc:290] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:52.850627 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96808d860d8457caea08dbac23516b3" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:52.851822 14381 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:52.852381 14381 ts_tablet_manager.cc:1403] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.010s
W20260709 13:18:52.851852 14077 leader_election.cc:343] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:52.853252 14078 leader_election.cc:343] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.853705 14078 leader_election.cc:304] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:52.854605 14431 raft_consensus.cc:2749] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:52.856983 14383 raft_consensus.cc:359] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.857798 14383 raft_consensus.cc:385] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.858104 14383 raft_consensus.cc:740] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.848863 14187 raft_consensus.cc:2468] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:52.859666 14300 leader_election.cc:304] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:52.855913 14335 raft_consensus.cc:2468] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:52.860379 14112 raft_consensus.cc:2468] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:52.861228 14436 raft_consensus.cc:2804] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:52.861414 14227 leader_election.cc:304] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:52.861938 14436 raft_consensus.cc:697] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:52.862187 14381 raft_consensus.cc:359] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.862937 14381 raft_consensus.cc:385] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.862498 14420 raft_consensus.cc:2804] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:52.862890 14436 consensus_queue.cc:237] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.859495 14383 consensus_queue.cc:260] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.863422 14381 raft_consensus.cc:740] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.867693 14383 ts_tablet_manager.cc:1434] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:18:52.867409 14381 consensus_queue.cc:260] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.870527 14381 ts_tablet_manager.cc:1434] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:18:52.868463 14420 raft_consensus.cc:697] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:18:52.872344 14420 consensus_queue.cc:237] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.874117 14381 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:52.877911 14382 tablet_bootstrap.cc:492] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:52.878477 14382 ts_tablet_manager.cc:1403] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.154s	user 0.010s	sys 0.012s
I20260709 13:18:52.881788 14382 raft_consensus.cc:359] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.883563 14383 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:52.884529 14389 raft_consensus.cc:493] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.885075 14389 raft_consensus.cc:515] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.888921 14381 tablet_bootstrap.cc:654] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.890275 14007 catalog_manager.cc:5697] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:52.891947 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:52.895761 14187 raft_consensus.cc:2468] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:52.893708 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:52.898291 14077 leader_election.cc:304] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:52.899272 14431 raft_consensus.cc:2804] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:52.899667 14431 raft_consensus.cc:493] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.882545 14382 raft_consensus.cc:385] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.900013 14431 raft_consensus.cc:3060] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.900394 14382 raft_consensus.cc:740] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.901698 14382 consensus_queue.cc:260] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.904019 14382 ts_tablet_manager.cc:1434] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:18:52.904206 14389 leader_election.cc:290] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
W20260709 13:18:52.906097 14078 leader_election.cc:343] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.909202 14382 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:52.909577 14384 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:52.910332 14384 ts_tablet_manager.cc:1403] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.007s
I20260709 13:18:52.910526 14431 raft_consensus.cc:515] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.923061 14382 tablet_bootstrap.cc:654] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.923169 14384 raft_consensus.cc:359] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.924029 14384 raft_consensus.cc:385] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.924077 14383 tablet_bootstrap.cc:654] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.924533 14384 raft_consensus.cc:740] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.925380 14384 consensus_queue.cc:260] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.926008 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:52.927531 14381 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:52.925644 14431 leader_election.cc:290] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:52.927898 14384 ts_tablet_manager.cc:1434] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
W20260709 13:18:52.928982 14078 leader_election.cc:343] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:52.929019 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:52.929761 14187 raft_consensus.cc:3060] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.934605 14187 raft_consensus.cc:2468] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:52.935762 14077 leader_election.cc:304] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215
I20260709 13:18:52.937011 14431 raft_consensus.cc:2804] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:52.937759 14431 raft_consensus.cc:697] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:52.939306 14431 consensus_queue.cc:237] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:52.928519 14381 ts_tablet_manager.cc:1403] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.009s
I20260709 13:18:52.938231 14384 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:52.948565 14420 raft_consensus.cc:493] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.949110 14420 raft_consensus.cc:515] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.951370 14420 leader_election.cc:290] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:52.952171 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:52.953019 14187 raft_consensus.cc:2393] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c19f7f4ddb074bd8997d01296c3080d6 in current term 1: Already voted for candidate 0646b0acb9c943b59389eace852a5215 in this term.
I20260709 13:18:52.953044 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:52.954854 14227 leader_election.cc:304] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:52.956308 14420 raft_consensus.cc:3060] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:52.956152 14381 raft_consensus.cc:359] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.957228 14381 raft_consensus.cc:385] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.957580 14381 raft_consensus.cc:740] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.958482 14381 consensus_queue.cc:260] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:52.961470 14384 tablet_bootstrap.cc:654] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.962453 14381 ts_tablet_manager.cc:1434] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:18:52.964371 14420 raft_consensus.cc:2749] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:52.966198 14383 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:52.966706 14383 ts_tablet_manager.cc:1403] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.007s
I20260709 13:18:52.967695 14382 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:52.968206 14382 ts_tablet_manager.cc:1403] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.001s
I20260709 13:18:52.969832 14383 raft_consensus.cc:359] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.970570 14383 raft_consensus.cc:385] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.970844 14383 raft_consensus.cc:740] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.971251 14382 raft_consensus.cc:359] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.971963 14382 raft_consensus.cc:385] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:52.972501 14382 raft_consensus.cc:740] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:52.972914 14381 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:52.972618 14383 consensus_queue.cc:260] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:52.973480 14382 consensus_queue.cc:260] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:52.976769 14383 ts_tablet_manager.cc:1434] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:18:52.976902 14382 ts_tablet_manager.cc:1434] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:18:52.977948 14383 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:52.978123 14382 tablet_bootstrap.cc:492] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:52.981729 14381 tablet_bootstrap.cc:654] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.996981 14382 tablet_bootstrap.cc:654] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:52.997752 14384 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:52.998334 14384 ts_tablet_manager.cc:1403] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.002s
I20260709 13:18:53.001976 14384 raft_consensus.cc:359] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.003010 14384 raft_consensus.cc:385] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.003443 14384 raft_consensus.cc:740] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.004638 14383 tablet_bootstrap.cc:654] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.008008 14384 consensus_queue.cc:260] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.011183 14384 ts_tablet_manager.cc:1434] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:18:53.012252 14384 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:53.010960 14009 catalog_manager.cc:5697] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.013365 14382 tablet_bootstrap.cc:492] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:53.013911 14382 ts_tablet_manager.cc:1403] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.015s
I20260709 13:18:53.017549 14382 raft_consensus.cc:359] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.018505 14382 raft_consensus.cc:385] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.018898 14382 raft_consensus.cc:740] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.020576 14382 consensus_queue.cc:260] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.023063 14382 ts_tablet_manager.cc:1434] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:18:53.024155 14382 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:53.025800 14384 tablet_bootstrap.cc:654] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.030025 14383 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:53.030519 14383 ts_tablet_manager.cc:1403] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.001s
I20260709 13:18:53.030921 14382 tablet_bootstrap.cc:654] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.033404 14383 raft_consensus.cc:359] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.034301 14383 raft_consensus.cc:385] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.034646 14383 raft_consensus.cc:740] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.035676 14383 consensus_queue.cc:260] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.038422 14383 ts_tablet_manager.cc:1434] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:53.040200 14383 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:53.042752 14382 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:53.043421 14382 ts_tablet_manager.cc:1403] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:18:53.046635 14382 raft_consensus.cc:359] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.047657 14382 raft_consensus.cc:385] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.046164 14383 tablet_bootstrap.cc:654] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.049193 14381 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:53.049288 14382 raft_consensus.cc:740] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.049783 14381 ts_tablet_manager.cc:1403] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.011s
I20260709 13:18:53.050698 14384 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:53.050383 14382 consensus_queue.cc:260] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.051231 14384 ts_tablet_manager.cc:1403] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.004s
I20260709 13:18:53.052706 14422 raft_consensus.cc:493] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.053124 14382 ts_tablet_manager.cc:1434] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:53.052775 14381 raft_consensus.cc:359] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.053604 14381 raft_consensus.cc:385] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.053387 14422 raft_consensus.cc:515] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.053884 14381 raft_consensus.cc:740] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.054201 14382 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:53.054674 14381 consensus_queue.cc:260] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.054703 14384 raft_consensus.cc:359] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.057385 14384 raft_consensus.cc:385] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.057686 14384 raft_consensus.cc:740] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.057569 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ca8839d60a4089a7ff40ba299f1b71" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:53.059453 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ca8839d60a4089a7ff40ba299f1b71" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.059554 14384 consensus_queue.cc:260] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
W20260709 13:18:53.061161 14152 leader_election.cc:343] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.061928 14384 ts_tablet_manager.cc:1434] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
W20260709 13:18:53.062093 14151 leader_election.cc:343] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.062605 14151 leader_election.cc:304] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:53.062935 14384 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:53.055519 14422 leader_election.cc:290] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:53.063556 14382 tablet_bootstrap.cc:654] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.064381 14422 raft_consensus.cc:2749] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:53.071931 14436 raft_consensus.cc:493] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.072499 14436 raft_consensus.cc:515] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.073603 14384 tablet_bootstrap.cc:654] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.074775 14436 leader_election.cc:290] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:53.074896 14381 ts_tablet_manager.cc:1434] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:18:53.076233 14381 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:53.077627 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.078508 14187 raft_consensus.cc:2468] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:53.079450 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.080166 14300 leader_election.cc:304] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:53.080201 14112 raft_consensus.cc:2468] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:53.082634 14381 tablet_bootstrap.cc:654] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.084504 14436 raft_consensus.cc:2804] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.085042 14436 raft_consensus.cc:493] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.085482 14436 raft_consensus.cc:3060] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.092633 14383 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:53.093192 14383 ts_tablet_manager.cc:1403] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.000s
I20260709 13:18:53.094964 14382 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:53.095602 14382 ts_tablet_manager.cc:1403] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.011s
I20260709 13:18:53.096235 14381 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:53.096715 14381 ts_tablet_manager.cc:1403] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:18:53.097168 14436 raft_consensus.cc:515] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.096982 14008 catalog_manager.cc:5697] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.098363 14382 raft_consensus.cc:359] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.099026 14382 raft_consensus.cc:385] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.099285 14382 raft_consensus.cc:740] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.099958 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:53.100071 14382 consensus_queue.cc:260] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.100648 14187 raft_consensus.cc:3060] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.102483 14382 ts_tablet_manager.cc:1434] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:53.103622 14382 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:53.108656 14383 raft_consensus.cc:359] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.109483 14382 tablet_bootstrap.cc:654] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.109637 14383 raft_consensus.cc:385] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.111047 14436 leader_election.cc:290] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:53.110077 14383 raft_consensus.cc:740] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.109496 14187 raft_consensus.cc:2468] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:53.113796 14300 leader_election.cc:304] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:53.115232 14436 raft_consensus.cc:2804] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.112448 14383 consensus_queue.cc:260] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.116549 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:53.117245 14112 raft_consensus.cc:3060] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.099411 14381 raft_consensus.cc:359] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.124637 14381 raft_consensus.cc:385] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.125018 14381 raft_consensus.cc:740] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.125540 14420 raft_consensus.cc:493] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.125837 14381 consensus_queue.cc:260] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.126266 14420 raft_consensus.cc:515] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.127691 14112 raft_consensus.cc:2468] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:53.129998 14420 leader_election.cc:290] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:53.129884 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96808d860d8457caea08dbac23516b3" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
W20260709 13:18:53.132398 14151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 70341.7us
I20260709 13:18:53.131184 14381 ts_tablet_manager.cc:1434] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:18:53.133783 14381 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
W20260709 13:18:53.133587 14227 leader_election.cc:343] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.132254 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96808d860d8457caea08dbac23516b3" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.135162 14111 raft_consensus.cc:2468] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:53.136957 14225 leader_election.cc:304] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215
I20260709 13:18:53.138190 14420 raft_consensus.cc:2804] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.138652 14420 raft_consensus.cc:493] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.139071 14420 raft_consensus.cc:3060] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.140517 14381 tablet_bootstrap.cc:654] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.145134 14463 raft_consensus.cc:493] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.146582 14463 raft_consensus.cc:515] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.117120 14436 raft_consensus.cc:697] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:53.156476 14382 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:53.157012 14382 ts_tablet_manager.cc:1403] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.054s	user 0.029s	sys 0.020s
I20260709 13:18:53.156813 14436 consensus_queue.cc:237] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.150204 14420 raft_consensus.cc:515] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.151729 14383 ts_tablet_manager.cc:1434] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:18:53.161168 14383 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:53.160889 14382 raft_consensus.cc:359] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.161527 14382 raft_consensus.cc:385] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.161789 14382 raft_consensus.cc:740] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.162227 14420 leader_election.cc:290] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:53.162446 14382 consensus_queue.cc:260] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.151914 14381 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:53.164398 14381 ts_tablet_manager.cc:1403] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 13:18:53.164811 14382 ts_tablet_manager.cc:1434] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:53.166477 14382 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:53.167011 14381 raft_consensus.cc:359] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.167678 14381 raft_consensus.cc:385] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.170487 14010 catalog_manager.cc:5697] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.172763 14382 tablet_bootstrap.cc:654] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.173115 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96808d860d8457caea08dbac23516b3" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:53.174345 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96808d860d8457caea08dbac23516b3" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:53.174925 14111 raft_consensus.cc:3060] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:53.180903 14227 leader_election.cc:343] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.154848 14384 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:53.182156 14384 ts_tablet_manager.cc:1403] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.002s
I20260709 13:18:53.184438 14420 raft_consensus.cc:493] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.185081 14420 raft_consensus.cc:515] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.185652 14463 leader_election.cc:290] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:53.186810 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:53.188668 14151 leader_election.cc:343] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.187727 14420 leader_election.cc:290] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:53.189363 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190dd92193fb44399a0922353ce78a02" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.189745 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:53.190433 14261 raft_consensus.cc:2468] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:53.190596 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190dd92193fb44399a0922353ce78a02" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
W20260709 13:18:53.190862 14226 leader_election.cc:343] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.191864 14152 leader_election.cc:304] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
W20260709 13:18:53.192216 14227 leader_election.cc:343] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.192852 14227 leader_election.cc:304] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:53.193261 14463 raft_consensus.cc:2804] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.193833 14463 raft_consensus.cc:493] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.194267 14463 raft_consensus.cc:3060] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.196439 14382 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:53.196942 14382 ts_tablet_manager.cc:1403] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.014s
I20260709 13:18:53.198268 14383 tablet_bootstrap.cc:654] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.199740 14382 raft_consensus.cc:359] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.200201 14420 raft_consensus.cc:2749] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:53.200472 14382 raft_consensus.cc:385] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.167932 14381 raft_consensus.cc:740] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.200778 14382 raft_consensus.cc:740] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.201483 14381 consensus_queue.cc:260] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.202484 14384 raft_consensus.cc:359] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.203193 14384 raft_consensus.cc:385] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.203471 14384 raft_consensus.cc:740] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.203969 14381 ts_tablet_manager.cc:1434] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:18:53.201484 14382 consensus_queue.cc:260] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.205273 14431 raft_consensus.cc:493] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.205727 14431 raft_consensus.cc:515] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.206276 14382 ts_tablet_manager.cc:1434] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:53.207204 14382 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:53.207674 14431 leader_election.cc:290] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.209839 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5acb16ea44ef882abb6d9013b2848" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:53.210642 14261 raft_consensus.cc:2468] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:53.212167 14077 leader_election.cc:304] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:53.212731 14381 tablet_bootstrap.cc:492] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:53.212952 14389 raft_consensus.cc:2804] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.213348 14389 raft_consensus.cc:493] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.213668 14389 raft_consensus.cc:3060] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.216192 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5acb16ea44ef882abb6d9013b2848" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.216835 14187 raft_consensus.cc:2468] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:53.219007 14381 tablet_bootstrap.cc:654] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.222572 14382 tablet_bootstrap.cc:654] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.223608 14389 raft_consensus.cc:515] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.226506 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5acb16ea44ef882abb6d9013b2848" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:53.227238 14261 raft_consensus.cc:3060] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.237987 14389 leader_election.cc:290] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.226511 14384 consensus_queue.cc:260] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.239260 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5acb16ea44ef882abb6d9013b2848" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:53.244937 14187 raft_consensus.cc:3060] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.245700 14463 raft_consensus.cc:515] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.248879 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
W20260709 13:18:53.250403 14151 leader_election.cc:343] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.252239 14436 raft_consensus.cc:493] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.252811 14436 raft_consensus.cc:515] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.255265 14435 consensus_queue.cc:1048] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:53.256832 14384 ts_tablet_manager.cc:1434] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.002s
I20260709 13:18:53.258980 14436 leader_election.cc:290] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:53.259905 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:53.260603 14261 raft_consensus.cc:2468] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:53.261292 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:53.262754 14299 leader_election.cc:343] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.264233 14187 raft_consensus.cc:2468] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
W20260709 13:18:53.264684 14300 leader_election.cc:343] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.265204 14300 leader_election.cc:304] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:53.265682 14077 leader_election.cc:304] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:53.266921 14443 raft_consensus.cc:493] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.243288 14111 raft_consensus.cc:2468] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:53.271062 14384 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:53.269870 14389 raft_consensus.cc:2804] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.267544 14443 raft_consensus.cc:515] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.272853 14389 raft_consensus.cc:697] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:53.273970 14389 consensus_queue.cc:237] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.274744 14443 leader_election.cc:290] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.275862 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.276692 14187 raft_consensus.cc:2393] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c19f7f4ddb074bd8997d01296c3080d6 in current term 1: Already voted for candidate 675788979b2e4a89be45b2af4fa3141a in this term.
I20260709 13:18:53.270545 14435 raft_consensus.cc:2749] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:53.269608 14463 leader_election.cc:290] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:53.295428 14259 raft_consensus.cc:3060] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.300004 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.303200 14383 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:53.312609 14383 ts_tablet_manager.cc:1403] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.000s
I20260709 13:18:53.314713 14381 tablet_bootstrap.cc:492] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:53.315219 14381 ts_tablet_manager.cc:1403] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.042s
I20260709 13:18:53.315774 14383 raft_consensus.cc:359] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.316531 14383 raft_consensus.cc:385] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.316809 14383 raft_consensus.cc:740] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.308363 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:53.318799 14225 leader_election.cc:304] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215
I20260709 13:18:53.320998 14435 consensus_queue.cc:1048] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:53.321825 14225 leader_election.cc:304] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:53.323606 14420 raft_consensus.cc:2804] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.324470 14420 raft_consensus.cc:697] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:18:53.324604 14381 raft_consensus.cc:359] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.325380 14381 raft_consensus.cc:385] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.325704 14381 raft_consensus.cc:740] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.325387 14420 consensus_queue.cc:237] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.325179 14008 catalog_manager.cc:5697] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.326505 14381 consensus_queue.cc:260] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.323103 14261 raft_consensus.cc:3060] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.328905 14383 consensus_queue.cc:260] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.334024 14381 ts_tablet_manager.cc:1434] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:18:53.345682 14384 tablet_bootstrap.cc:654] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.348131 14476 consensus_queue.cc:1048] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:53.352526 14383 ts_tablet_manager.cc:1434] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 13:18:53.352676 14475 consensus_queue.cc:1048] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:53.353358 14382 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:53.353835 14382 ts_tablet_manager.cc:1403] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.025s
I20260709 13:18:53.355957 14435 consensus_queue.cc:1048] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:53.358188 14381 tablet_bootstrap.cc:492] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:53.358409 14383 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:53.362865 14443 raft_consensus.cc:2749] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:53.368239 14261 raft_consensus.cc:2468] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:53.368496 14475 consensus_queue.cc:1048] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:53.365703 14382 raft_consensus.cc:359] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.376339 14382 raft_consensus.cc:385] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.376740 14382 raft_consensus.cc:740] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.382819 14382 consensus_queue.cc:260] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.378283 14475 raft_consensus.cc:493] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.386346 14152 leader_election.cc:304] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:53.394307 14382 ts_tablet_manager.cc:1434] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:18:53.395677 14463 raft_consensus.cc:2804] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.399989 14463 raft_consensus.cc:697] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:53.400842 14463 consensus_queue.cc:237] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.402680 14384 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:53.403172 14384 ts_tablet_manager.cc:1403] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.132s	user 0.004s	sys 0.010s
I20260709 13:18:53.406831 14382 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:53.416363 14476 consensus_queue.cc:1048] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:18:53.422149 14384 raft_consensus.cc:359] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.422899 14384 raft_consensus.cc:385] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.423182 14384 raft_consensus.cc:740] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.423938 14384 consensus_queue.cc:260] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.398012 14475 raft_consensus.cc:515] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.422122 14382 tablet_bootstrap.cc:654] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.424961 14383 tablet_bootstrap.cc:654] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.430033 14431 raft_consensus.cc:493] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.430546 14431 raft_consensus.cc:515] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.431797 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:53.433207 14261 raft_consensus.cc:2468] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:53.437044 14419 raft_consensus.cc:493] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.437517 14419 raft_consensus.cc:515] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.439369 14419 leader_election.cc:290] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.440574 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.441479 14186 raft_consensus.cc:2393] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0646b0acb9c943b59389eace852a5215 in current term 1: Already voted for candidate 675788979b2e4a89be45b2af4fa3141a in this term.
I20260709 13:18:53.441322 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb043e88ddb1409188b19489adb77959" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.441255 14077 leader_election.cc:304] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:53.442054 14185 raft_consensus.cc:2468] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:53.452349 14389 raft_consensus.cc:2804] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.452754 14389 raft_consensus.cc:493] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.453097 14389 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.435932 14431 leader_election.cc:290] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:53.457165 14384 ts_tablet_manager.cc:1434] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.003s
I20260709 13:18:53.457960 14384 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:53.460407 14334 raft_consensus.cc:3060] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.462579 14475 leader_election.cc:290] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:53.463251 14476 raft_consensus.cc:493] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.463721 14476 raft_consensus.cc:515] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.465883 14476 leader_election.cc:290] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.467365 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ca8839d60a4089a7ff40ba299f1b71" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.468057 14111 raft_consensus.cc:2468] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:53.469849 14436 raft_consensus.cc:493] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.470386 14436 raft_consensus.cc:515] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.471047 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ca8839d60a4089a7ff40ba299f1b71" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.471356 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:53.471738 14185 raft_consensus.cc:2468] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:53.473384 14225 leader_election.cc:304] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
W20260709 13:18:53.483217 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:53.474081 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb043e88ddb1409188b19489adb77959" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:53.477649 14476 raft_consensus.cc:2804] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.489480 14389 raft_consensus.cc:515] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.489786 14489 consensus_queue.cc:1048] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:53.490581 14078 leader_election.cc:343] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.493816 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.495316 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.467945 14009 catalog_manager.cc:5697] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.500368 14419 raft_consensus.cc:493] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.500550 14435 consensus_queue.cc:1048] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:53.500898 14419 raft_consensus.cc:515] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.492882 14436 leader_election.cc:290] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.502977 14419 leader_election.cc:290] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.490808 14476 raft_consensus.cc:493] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.503654 14476 raft_consensus.cc:3060] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.501101 14185 raft_consensus.cc:2468] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:53.505450 14300 leader_election.cc:304] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:53.505815 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847793586a524d1e9df7a07c31f2d186" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:53.506289 14419 raft_consensus.cc:2804] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.506629 14419 raft_consensus.cc:493] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.506984 14419 raft_consensus.cc:3060] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:53.507206 14300 leader_election.cc:343] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.491926 14260 raft_consensus.cc:2468] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:53.529384 14299 leader_election.cc:304] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:53.530301 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.530994 14111 raft_consensus.cc:2468] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:53.533054 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847793586a524d1e9df7a07c31f2d186" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:53.534255 14299 leader_election.cc:343] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.534297 14389 leader_election.cc:290] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:53.534478 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:53.534842 14299 leader_election.cc:304] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:53.535643 14436 raft_consensus.cc:2749] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:53.536464 14078 leader_election.cc:343] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.487468 14077 leader_election.cc:304] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:53.546896 14381 tablet_bootstrap.cc:654] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.549106 14463 raft_consensus.cc:493] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.549644 14463 raft_consensus.cc:515] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.554235 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190dd92193fb44399a0922353ce78a02" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:53.543915 14077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 58177.3us
I20260709 13:18:53.554957 14260 raft_consensus.cc:2468] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:53.545408 14431 raft_consensus.cc:2804] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.551806 14463 leader_election.cc:290] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:53.557385 14431 raft_consensus.cc:493] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.557561 14435 raft_consensus.cc:2749] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:53.560099 14431 raft_consensus.cc:3060] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.558210 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190dd92193fb44399a0922353ce78a02" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:53.561570 14152 leader_election.cc:304] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
W20260709 13:18:53.563308 14153 leader_election.cc:343] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.565439 14422 raft_consensus.cc:2804] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:53.565898 14422 raft_consensus.cc:493] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.566238 14422 raft_consensus.cc:3060] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.578100 14419 raft_consensus.cc:515] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.583029 14422 raft_consensus.cc:515] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.587628 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190dd92193fb44399a0922353ce78a02" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:53.588450 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:53.589133 14112 raft_consensus.cc:3060] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.590605 14384 tablet_bootstrap.cc:654] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.588487 14260 raft_consensus.cc:3060] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.598546 14383 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:53.599056 14383 ts_tablet_manager.cc:1403] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.241s	user 0.010s	sys 0.012s
I20260709 13:18:53.602330 14008 catalog_manager.cc:5697] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.605806 14112 raft_consensus.cc:2468] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:53.606959 14383 raft_consensus.cc:359] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.608661 14383 raft_consensus.cc:385] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.608956 14383 raft_consensus.cc:740] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.609800 14383 consensus_queue.cc:260] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.613111 14383 ts_tablet_manager.cc:1434] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:18:53.614598 14383 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:53.616540 14419 leader_election.cc:290] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.617103 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:53.617794 14187 raft_consensus.cc:3060] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.626955 14187 raft_consensus.cc:2468] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:53.628662 14300 leader_election.cc:304] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:53.629909 14435 raft_consensus.cc:2804] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.630523 14435 raft_consensus.cc:697] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:53.631592 14435 consensus_queue.cc:237] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.638972 14260 raft_consensus.cc:2468] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:53.640450 14152 leader_election.cc:304] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:53.641707 14463 raft_consensus.cc:2804] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.641836 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190dd92193fb44399a0922353ce78a02" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:53.642506 14463 raft_consensus.cc:697] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
W20260709 13:18:53.643338 14153 leader_election.cc:343] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.643950 14422 leader_election.cc:290] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:53.643635 14463 consensus_queue.cc:237] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.666939 14476 raft_consensus.cc:515] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.676826 14431 raft_consensus.cc:515] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.678459 14383 tablet_bootstrap.cc:654] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.678959 14431 leader_election.cc:290] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:53.679977 14476 leader_election.cc:290] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.681237 14382 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:53.681753 14382 ts_tablet_manager.cc:1403] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.275s	user 0.021s	sys 0.020s
I20260709 13:18:53.684784 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ca8839d60a4089a7ff40ba299f1b71" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:53.684984 14382 raft_consensus.cc:359] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.685635 14382 raft_consensus.cc:385] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.685480 14186 raft_consensus.cc:3060] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.685992 14382 raft_consensus.cc:740] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.686782 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:53.686847 14382 consensus_queue.cc:260] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.685652 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7ca8839d60a4089a7ff40ba299f1b71" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:53.689519 14112 raft_consensus.cc:3060] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.687502 14260 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:53.691507 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 44369.7us
I20260709 13:18:53.694169 14382 ts_tablet_manager.cc:1434] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:18:53.699110 14384 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:53.699810 14384 ts_tablet_manager.cc:1403] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.242s	user 0.005s	sys 0.012s
I20260709 13:18:53.728119 14186 raft_consensus.cc:2468] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:53.729599 14226 leader_election.cc:304] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:53.730456 14476 raft_consensus.cc:2804] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.730914 14476 raft_consensus.cc:697] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:18:53.731112 14384 raft_consensus.cc:359] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.731837 14384 raft_consensus.cc:385] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.732215 14384 raft_consensus.cc:740] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.697969 14435 consensus_queue.cc:1048] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:18:53.734580 14384 consensus_queue.cc:260] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.740150 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb043e88ddb1409188b19489adb77959" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:53.740813 14258 raft_consensus.cc:3060] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.731757 14476 consensus_queue.cc:237] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.746975 14382 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:53.697253 14431 consensus_queue.cc:1048] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:18:53.748603 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb043e88ddb1409188b19489adb77959" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:53.754738 14187 raft_consensus.cc:3060] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.743005 14112 raft_consensus.cc:2468] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:53.766808 14503 consensus_queue.cc:1048] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:53.767704 14381 tablet_bootstrap.cc:492] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:53.768242 14381 ts_tablet_manager.cc:1403] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.422s	user 0.013s	sys 0.006s
I20260709 13:18:53.773350 14384 ts_tablet_manager.cc:1434] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.069s	user 0.001s	sys 0.009s
W20260709 13:18:53.744946 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 80099.6us
I20260709 13:18:53.774837 14384 tablet_bootstrap.cc:492] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:53.784255 14381 raft_consensus.cc:359] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.786608 14381 raft_consensus.cc:385] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:18:53.787616 14227 consensus_peers.cc:597] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Couldn't send request to peer 0646b0acb9c943b59389eace852a5215. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:53.786895 14381 raft_consensus.cc:740] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.798221 14384 tablet_bootstrap.cc:654] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.798200 14260 raft_consensus.cc:2468] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:53.803107 14381 consensus_queue.cc:260] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.813022 14077 leader_election.cc:304] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215
I20260709 13:18:53.814548 14431 raft_consensus.cc:2804] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.815140 14431 raft_consensus.cc:697] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:53.816167 14431 consensus_queue.cc:237] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.806331 14187 raft_consensus.cc:2468] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:53.822189 14381 ts_tablet_manager.cc:1434] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:18:53.822279 14008 catalog_manager.cc:5697] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.823381 14381 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:53.825204 14077 leader_election.cc:304] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:53.826761 14443 consensus_queue.cc:1048] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:53.827705 14010 catalog_manager.cc:5697] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.831552 14007 catalog_manager.cc:5697] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.834888 14489 consensus_queue.cc:1048] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:53.836522 14489 raft_consensus.cc:2804] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:53.837023 14489 raft_consensus.cc:697] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:53.837909 14489 consensus_queue.cc:237] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.841949 14463 consensus_queue.cc:1048] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:53.850775 14382 tablet_bootstrap.cc:654] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.892414 14381 tablet_bootstrap.cc:654] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.909207 14383 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:53.910019 14383 ts_tablet_manager.cc:1403] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.296s	user 0.024s	sys 0.025s
I20260709 13:18:53.918547 14383 raft_consensus.cc:359] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.909158 14258 raft_consensus.cc:2468] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:53.919386 14383 raft_consensus.cc:385] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.921693 14383 raft_consensus.cc:740] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
W20260709 13:18:53.909950 14151 consensus_peers.cc:597] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:53.927299 14510 raft_consensus.cc:493] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.927902 14510 raft_consensus.cc:515] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.930190 14510 leader_election.cc:290] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:53.931835 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:53.932920 14260 raft_consensus.cc:2393] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0646b0acb9c943b59389eace852a5215 in current term 1: Already voted for candidate 675788979b2e4a89be45b2af4fa3141a in this term.
I20260709 13:18:53.934676 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.937307 14299 leader_election.cc:304] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:53.938253 14383 consensus_queue.cc:260] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:53.938659 14510 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:53.944146 14382 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:53.944686 14382 ts_tablet_manager.cc:1403] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.199s	user 0.017s	sys 0.017s
I20260709 13:18:53.946467 14510 raft_consensus.cc:2749] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:53.949692 14384 tablet_bootstrap.cc:492] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:53.950256 14384 ts_tablet_manager.cc:1403] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.176s	user 0.014s	sys 0.007s
I20260709 13:18:53.953894 14489 consensus_queue.cc:1048] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:53.957253 14383 ts_tablet_manager.cc:1434] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:18:53.958444 14383 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:53.965430 14383 tablet_bootstrap.cc:654] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:53.969318 14382 raft_consensus.cc:359] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.956709 14007 catalog_manager.cc:5697] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:53.976511 14384 raft_consensus.cc:359] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.977545 14384 raft_consensus.cc:385] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.977870 14384 raft_consensus.cc:740] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.978915 14384 consensus_queue.cc:260] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:53.981925 14384 ts_tablet_manager.cc:1434] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:18:53.982928 14384 tablet_bootstrap.cc:492] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:53.970336 14382 raft_consensus.cc:385] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:53.984371 14382 raft_consensus.cc:740] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:53.985306 14382 consensus_queue.cc:260] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:53.989135 14420 raft_consensus.cc:493] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.989658 14420 raft_consensus.cc:515] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:53.991981 14420 leader_election.cc:290] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:53.992486 14382 ts_tablet_manager.cc:1434] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260709 13:18:53.992739 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:53.993469 14382 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:53.993220 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:53.994634 14225 leader_election.cc:343] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:53.995361 14226 leader_election.cc:343] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:53.995828 14226 leader_election.cc:304] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:53.996717 14420 raft_consensus.cc:2749] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:54.001824 14384 tablet_bootstrap.cc:654] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.008955 14382 tablet_bootstrap.cc:654] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.014524 14490 raft_consensus.cc:493] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.015118 14490 raft_consensus.cc:515] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.017699 14490 leader_election.cc:290] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.018002 14383 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:54.018569 14383 ts_tablet_manager.cc:1403] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.000s
I20260709 13:18:54.021952 14383 raft_consensus.cc:359] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.022353 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.022903 14383 raft_consensus.cc:385] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.023171 14335 raft_consensus.cc:2468] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:54.023312 14383 raft_consensus.cc:740] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.024524 14383 consensus_queue.cc:260] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.026531 14078 leader_election.cc:304] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:54.029508 14510 consensus_queue.cc:1048] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:54.033213 14009 catalog_manager.cc:5697] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.035391 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:54.042879 14259 raft_consensus.cc:2468] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:54.036082 14490 raft_consensus.cc:2804] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:54.045239 14490 raft_consensus.cc:493] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.045748 14490 raft_consensus.cc:3060] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.051167 14384 tablet_bootstrap.cc:492] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:54.051684 14384 ts_tablet_manager.cc:1403] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.009s
I20260709 13:18:54.052170 14335 raft_consensus.cc:3060] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.054468 14501 consensus_queue.cc:1048] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:54.054553 14384 raft_consensus.cc:359] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.055285 14384 raft_consensus.cc:385] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.055550 14384 raft_consensus.cc:740] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.039882 14383 ts_tablet_manager.cc:1434] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:18:54.086565 14383 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:54.087205 14381 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:54.087699 14381 ts_tablet_manager.cc:1403] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.265s	user 0.019s	sys 0.033s
I20260709 13:18:54.090487 14381 raft_consensus.cc:359] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.091187 14381 raft_consensus.cc:385] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.091451 14381 raft_consensus.cc:740] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.070077 14461 consensus_queue.cc:1048] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:54.092094 14381 consensus_queue.cc:260] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.094475 14381 ts_tablet_manager.cc:1434] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:18:54.063985 14384 consensus_queue.cc:260] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.078640 14490 raft_consensus.cc:515] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.096764 14384 ts_tablet_manager.cc:1434] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:18:54.098264 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:54.099967 14258 raft_consensus.cc:3060] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.100620 14384 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:54.100449 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:54.101325 14334 raft_consensus.cc:3060] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.102768 14490 leader_election.cc:290] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.110123 14334 raft_consensus.cc:2468] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:54.110684 14383 tablet_bootstrap.cc:654] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.095398 14381 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:54.114396 14078 leader_election.cc:304] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:54.116134 14489 raft_consensus.cc:2804] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:54.116607 14489 raft_consensus.cc:697] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:54.117404 14489 consensus_queue.cc:237] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.116148 14384 tablet_bootstrap.cc:654] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.124953 14461 consensus_queue.cc:1048] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:54.109135 14258 raft_consensus.cc:2468] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:54.099373 14382 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:54.141112 14382 ts_tablet_manager.cc:1403] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.148s	user 0.022s	sys 0.008s
I20260709 13:18:54.155553 14383 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:54.156143 14383 ts_tablet_manager.cc:1403] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.070s	user 0.030s	sys 0.015s
I20260709 13:18:54.156885 14382 raft_consensus.cc:359] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.157701 14382 raft_consensus.cc:385] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.157977 14382 raft_consensus.cc:740] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.141801 14381 tablet_bootstrap.cc:654] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.158833 14384 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:54.159334 14384 ts_tablet_manager.cc:1403] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.001s
I20260709 13:18:54.160555 14382 consensus_queue.cc:260] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.162125 14384 raft_consensus.cc:359] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.162863 14384 raft_consensus.cc:385] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.163136 14384 raft_consensus.cc:740] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.164116 14382 ts_tablet_manager.cc:1434] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:18:54.158865 14383 raft_consensus.cc:359] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.165297 14383 raft_consensus.cc:385] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.165568 14383 raft_consensus.cc:740] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.163857 14384 consensus_queue.cc:260] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.165597 14382 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:54.166385 14383 consensus_queue.cc:260] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.168998 14383 ts_tablet_manager.cc:1434] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:18:54.170003 14383 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:54.173508 14489 raft_consensus.cc:493] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.174254 14489 raft_consensus.cc:515] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.175930 14383 tablet_bootstrap.cc:654] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.178678 14461 raft_consensus.cc:493] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.178601 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:54.179430 14461 raft_consensus.cc:515] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.180792 14384 ts_tablet_manager.cc:1434] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:18:54.184942 14489 leader_election.cc:290] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:54.186466 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f9212333fa40979fd9596511ba43b7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:54.188362 14152 leader_election.cc:343] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.183423 14009 catalog_manager.cc:5697] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.189416 14384 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:54.192421 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f9212333fa40979fd9596511ba43b7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.193118 14335 raft_consensus.cc:2468] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:54.194677 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:54.195775 14384 tablet_bootstrap.cc:654] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.185909 14461 leader_election.cc:290] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.202574 14153 leader_election.cc:304] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:54.204470 14382 tablet_bootstrap.cc:654] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.208966 14461 raft_consensus.cc:2804] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:54.209497 14461 raft_consensus.cc:493] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.209213 14077 leader_election.cc:304] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:54.210032 14461 raft_consensus.cc:3060] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.211548 14490 raft_consensus.cc:2749] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:54.228832 14381 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:54.229398 14381 ts_tablet_manager.cc:1403] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.134s	user 0.017s	sys 0.038s
I20260709 13:18:54.232275 14381 raft_consensus.cc:359] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.232992 14381 raft_consensus.cc:385] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.233268 14381 raft_consensus.cc:740] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.234037 14381 consensus_queue.cc:260] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.234421 14461 raft_consensus.cc:515] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.236793 14461 leader_election.cc:290] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.237564 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f9212333fa40979fd9596511ba43b7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:54.239774 14384 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:54.240259 14384 ts_tablet_manager.cc:1403] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.008s
I20260709 13:18:54.240499 14381 ts_tablet_manager.cc:1434] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:18:54.241354 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f9212333fa40979fd9596511ba43b7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
W20260709 13:18:54.241261 14152 leader_election.cc:343] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.241663 14381 tablet_bootstrap.cc:492] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:54.242007 14335 raft_consensus.cc:3060] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.242937 14384 raft_consensus.cc:359] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.243592 14384 raft_consensus.cc:385] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.243837 14384 raft_consensus.cc:740] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.246274 14489 consensus_queue.cc:1048] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:54.243978 14383 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:54.247532 14383 ts_tablet_manager.cc:1403] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.010s
I20260709 13:18:54.266284 14384 consensus_queue.cc:260] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.268580 14384 ts_tablet_manager.cc:1434] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.028s	user 0.021s	sys 0.006s
I20260709 13:18:54.269583 14384 tablet_bootstrap.cc:492] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:54.274019 14381 tablet_bootstrap.cc:654] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.275235 14384 tablet_bootstrap.cc:654] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.276295 14383 raft_consensus.cc:359] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.277064 14383 raft_consensus.cc:385] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.277309 14383 raft_consensus.cc:740] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.278195 14383 consensus_queue.cc:260] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.281383 14383 ts_tablet_manager.cc:1434] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 13:18:54.282555 14383 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:54.286398 14384 tablet_bootstrap.cc:492] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:54.286936 14384 ts_tablet_manager.cc:1403] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.009s
I20260709 13:18:54.288314 14381 tablet_bootstrap.cc:492] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:54.288820 14381 ts_tablet_manager.cc:1403] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.003s
I20260709 13:18:54.289752 14384 raft_consensus.cc:359] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.290500 14384 raft_consensus.cc:385] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.290767 14384 raft_consensus.cc:740] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.291507 14384 consensus_queue.cc:260] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.291815 14381 raft_consensus.cc:359] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.292640 14381 raft_consensus.cc:385] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.292948 14381 raft_consensus.cc:740] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.293958 14384 ts_tablet_manager.cc:1434] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:54.293849 14381 consensus_queue.cc:260] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.294998 14384 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:54.296442 14381 ts_tablet_manager.cc:1434] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:54.299630 14382 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:54.300210 14382 ts_tablet_manager.cc:1403] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.016s
I20260709 13:18:54.303114 14382 raft_consensus.cc:359] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.303814 14382 raft_consensus.cc:385] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.304136 14382 raft_consensus.cc:740] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.304577 14431 consensus_queue.cc:1048] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:54.304828 14382 consensus_queue.cc:260] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.306761 14384 tablet_bootstrap.cc:654] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.306921 14382 ts_tablet_manager.cc:1434] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:54.307439 14383 tablet_bootstrap.cc:654] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.309270 14381 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:54.307955 14382 tablet_bootstrap.cc:492] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:54.313735 14503 raft_consensus.cc:493] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.314289 14503 raft_consensus.cc:515] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.316293 14420 consensus_queue.cc:1048] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:54.318163 14384 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:54.318660 14384 ts_tablet_manager.cc:1403] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 13:18:54.320681 14382 tablet_bootstrap.cc:654] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.321379 14384 raft_consensus.cc:359] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.322041 14384 raft_consensus.cc:385] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.322296 14384 raft_consensus.cc:740] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.323122 14384 consensus_queue.cc:260] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.325795 14381 tablet_bootstrap.cc:654] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.327759 14503 leader_election.cc:290] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:54.327769 14384 ts_tablet_manager.cc:1434] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:18:54.329041 14461 raft_consensus.cc:493] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.329063 14384 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:54.329550 14461 raft_consensus.cc:515] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.330368 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:54.331256 14111 raft_consensus.cc:2468] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:54.331619 14461 leader_election.cc:290] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:54.333225 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:54.335870 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.336500 14461 raft_consensus.cc:493] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.337008 14461 raft_consensus.cc:515] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.337779 14383 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:54.337702 14481 raft_consensus.cc:493] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.338464 14383 ts_tablet_manager.cc:1403] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:18:54.338587 14481 raft_consensus.cc:515] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.340284 14461 leader_election.cc:290] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:54.340516 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847793586a524d1e9df7a07c31f2d186" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:54.341181 14112 raft_consensus.cc:2468] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:54.341089 14299 leader_election.cc:304] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:54.342689 14151 leader_election.cc:304] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
W20260709 13:18:54.343329 14300 leader_election.cc:343] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.343645 14461 raft_consensus.cc:2804] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:54.344069 14461 raft_consensus.cc:493] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.344411 14461 raft_consensus.cc:3060] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.344906 14382 tablet_bootstrap.cc:492] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:54.344537 14383 raft_consensus.cc:359] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.345314 14383 raft_consensus.cc:385] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.345417 14382 ts_tablet_manager.cc:1403] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.002s
I20260709 13:18:54.335865 14384 tablet_bootstrap.cc:654] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:54.346040 14153 leader_election.cc:343] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.347100 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847793586a524d1e9df7a07c31f2d186" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.347808 14333 raft_consensus.cc:2468] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:54.345602 14383 raft_consensus.cc:740] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.349157 14501 raft_consensus.cc:2804] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:54.349151 14383 consensus_queue.cc:260] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.349802 14501 raft_consensus.cc:493] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.350251 14501 raft_consensus.cc:3060] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.350626 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:54.351584 14383 ts_tablet_manager.cc:1434] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
W20260709 13:18:54.352161 14151 leader_election.cc:343] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.352609 14383 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:54.352609 14151 leader_election.cc:304] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:54.354578 14481 leader_election.cc:290] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:54.355604 14422 raft_consensus.cc:2749] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:54.356400 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:54.357801 14226 leader_election.cc:343] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.358122 14501 raft_consensus.cc:515] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.358922 14383 tablet_bootstrap.cc:654] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.359637 14475 consensus_queue.cc:1048] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:54.361378 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:54.362031 14112 raft_consensus.cc:3060] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.370785 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:54.374361 14112 raft_consensus.cc:2468] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:54.386327 14335 raft_consensus.cc:2468] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:54.413802 14153 leader_election.cc:304] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:54.414820 14422 raft_consensus.cc:2804] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:54.415781 14422 raft_consensus.cc:697] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:54.389518 14111 raft_consensus.cc:3060] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.396631 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:54.416985 14422 consensus_queue.cc:237] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
W20260709 13:18:54.418211 14300 leader_election.cc:343] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.421957 14431 consensus_queue.cc:1048] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:54.422811 14501 leader_election.cc:290] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:54.422144 14299 leader_election.cc:304] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:54.348546 14382 raft_consensus.cc:359] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.425915 14382 raft_consensus.cc:385] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.426227 14382 raft_consensus.cc:740] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.428071 14503 raft_consensus.cc:2804] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:54.428699 14503 raft_consensus.cc:697] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:54.429662 14503 consensus_queue.cc:237] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.432905 14431 raft_consensus.cc:493] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.433576 14431 raft_consensus.cc:515] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.433871 14436 raft_consensus.cc:493] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.434489 14436 raft_consensus.cc:515] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.436722 14431 leader_election.cc:290] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.438179 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96808d860d8457caea08dbac23516b3" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:54.440874 14436 leader_election.cc:290] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:54.441959 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.442297 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96808d860d8457caea08dbac23516b3" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:54.443584 14078 leader_election.cc:343] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.444550 14299 leader_election.cc:304] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
W20260709 13:18:54.446054 14225 leader_election.cc:343] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.446564 14225 leader_election.cc:304] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:54.449743 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:54.451678 14436 raft_consensus.cc:2749] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:54.454114 14382 consensus_queue.cc:260] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.455385 14381 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:54.455938 14381 ts_tablet_manager.cc:1403] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.147s	user 0.009s	sys 0.016s
I20260709 13:18:54.462594 14443 raft_consensus.cc:2749] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:54.465168 14382 ts_tablet_manager.cc:1434] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.000s
I20260709 13:18:54.466213 14382 tablet_bootstrap.cc:492] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:54.468291 14461 raft_consensus.cc:515] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.469002 14009 catalog_manager.cc:5697] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.471746 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847793586a524d1e9df7a07c31f2d186" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:54.472536 14335 raft_consensus.cc:3060] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.478209 14443 consensus_queue.cc:1048] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:54.491711 14384 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:54.492473 14384 ts_tablet_manager.cc:1403] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.164s	user 0.030s	sys 0.034s
I20260709 13:18:54.491460 14010 catalog_manager.cc:5697] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.499228 14461 leader_election.cc:290] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:54.501480 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "847793586a524d1e9df7a07c31f2d186" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:54.502229 14112 raft_consensus.cc:3060] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.503875 14383 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:54.504446 14383 ts_tablet_manager.cc:1403] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.152s	user 0.044s	sys 0.035s
I20260709 13:18:54.505239 14384 raft_consensus.cc:359] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.506026 14384 raft_consensus.cc:385] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.506314 14384 raft_consensus.cc:740] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.507100 14383 raft_consensus.cc:359] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.507040 14384 consensus_queue.cc:260] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.509250 14384 ts_tablet_manager.cc:1434] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
W20260709 13:18:54.510082 14077 leader_election.cc:343] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.510210 14383 raft_consensus.cc:385] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.510766 14383 raft_consensus.cc:740] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.510730 14077 leader_election.cc:304] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:54.511873 14431 raft_consensus.cc:2749] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:54.511723 14383 consensus_queue.cc:260] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.510128 14384 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:54.512982 14381 raft_consensus.cc:359] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.513728 14381 raft_consensus.cc:385] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.514029 14381 raft_consensus.cc:740] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.514894 14381 consensus_queue.cc:260] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.519047 14384 tablet_bootstrap.cc:654] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.521384 14546 raft_consensus.cc:493] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.522022 14383 ts_tablet_manager.cc:1434] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:18:54.521936 14546 raft_consensus.cc:515] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.523335 14383 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:54.528441 14381 ts_tablet_manager.cc:1434] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:18:54.529528 14381 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:54.528643 14431 raft_consensus.cc:493] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.535063 14431 raft_consensus.cc:515] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.537075 14461 raft_consensus.cc:493] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.537741 14461 raft_consensus.cc:515] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.544663 14382 tablet_bootstrap.cc:654] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.545763 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f9212333fa40979fd9596511ba43b7" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:54.550411 14381 tablet_bootstrap.cc:654] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.551060 14546 leader_election.cc:290] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.553224 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39f9212333fa40979fd9596511ba43b7" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.554339 14334 raft_consensus.cc:2393] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c19f7f4ddb074bd8997d01296c3080d6 in current term 1: Already voted for candidate 45ddcb989aef4c9fa869766c3682632c in this term.
W20260709 13:18:54.556533 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:54.556627 14501 raft_consensus.cc:493] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.559407 14501 raft_consensus.cc:515] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.561504 14501 leader_election.cc:290] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:54.558671 14383 tablet_bootstrap.cc:654] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.566291 14227 leader_election.cc:304] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:54.569775 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:54.571756 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2af9154cf4749976dc55b506018e5" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:54.574338 14152 leader_election.cc:343] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.575728 14546 raft_consensus.cc:3060] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:54.584892 14299 leader_election.cc:343] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.587841 14431 leader_election.cc:290] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.589787 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:54.590667 14183 raft_consensus.cc:2468] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:54.592379 14300 leader_election.cc:304] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:54.593524 14501 raft_consensus.cc:2804] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:54.594077 14501 raft_consensus.cc:493] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.594118 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965959c6060c4e31872a4d63bb4cc3d8" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.594789 14501 raft_consensus.cc:3060] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.595224 14334 raft_consensus.cc:2468] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:54.596735 14078 leader_election.cc:304] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:54.601082 14461 leader_election.cc:290] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.602473 14431 raft_consensus.cc:2804] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:54.602960 14431 raft_consensus.cc:493] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.603366 14431 raft_consensus.cc:3060] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.607363 14501 raft_consensus.cc:515] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.609130 14112 raft_consensus.cc:2468] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:54.610858 14151 leader_election.cc:304] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:54.611862 14461 raft_consensus.cc:2804] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:54.611909 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:54.612839 14461 raft_consensus.cc:697] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
W20260709 13:18:54.614281 14299 leader_election.cc:343] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.613991 14461 consensus_queue.cc:237] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.616505 14501 leader_election.cc:290] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:54.619722 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:54.620548 14183 raft_consensus.cc:3060] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.639142 14335 raft_consensus.cc:2468] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:54.641832 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2af9154cf4749976dc55b506018e5" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.642724 14334 raft_consensus.cc:2468] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:54.644368 14153 leader_election.cc:304] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:54.645979 14463 raft_consensus.cc:2804] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:54.646462 14463 raft_consensus.cc:493] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.646855 14463 raft_consensus.cc:3060] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.669955 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965959c6060c4e31872a4d63bb4cc3d8" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:54.670902 14258 raft_consensus.cc:2468] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:54.674110 14490 consensus_queue.cc:1048] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:54.683686 14475 raft_consensus.cc:493] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.684387 14475 raft_consensus.cc:515] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.689069 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:54.689970 14259 raft_consensus.cc:2468] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:54.691542 14077 leader_election.cc:304] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:54.692657 14490 raft_consensus.cc:2804] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:54.693212 14490 raft_consensus.cc:493] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.693403 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:54.693787 14490 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.694339 14187 raft_consensus.cc:2468] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:54.688282 14475 leader_election.cc:290] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:54.708797 14489 consensus_queue.cc:1048] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:54.714118 14546 raft_consensus.cc:2749] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:54.717983 14463 raft_consensus.cc:515] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.718199 14490 raft_consensus.cc:515] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.721700 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2af9154cf4749976dc55b506018e5" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:54.774580 14382 tablet_bootstrap.cc:492] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:54.780967 14382 ts_tablet_manager.cc:1403] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.315s	user 0.010s	sys 0.004s
I20260709 13:18:54.766834 14463 leader_election.cc:290] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
W20260709 13:18:54.779304 14152 leader_election.cc:343] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:54.773707 14183 raft_consensus.cc:2468] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:54.797798 14382 raft_consensus.cc:359] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.798583 14382 raft_consensus.cc:385] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.798849 14382 raft_consensus.cc:740] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.790871 14490 leader_election.cc:290] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:54.802932 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2af9154cf4749976dc55b506018e5" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:54.803594 14335 raft_consensus.cc:3060] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.804971 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:54.805610 14260 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.808177 14300 leader_election.cc:304] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:54.809852 14503 raft_consensus.cc:2804] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:54.810458 14503 raft_consensus.cc:697] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:54.811558 14503 consensus_queue.cc:237] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.813283 14334 raft_consensus.cc:3060] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.772367 14431 raft_consensus.cc:515] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.825102 14431 leader_election.cc:290] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.825762 14009 catalog_manager.cc:5697] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.828030 14382 consensus_queue.cc:260] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.830335 14382 ts_tablet_manager.cc:1434] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.002s
I20260709 13:18:54.831324 14382 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
W20260709 13:18:54.831215 14300 consensus_peers.cc:597] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:54.834993 14463 consensus_queue.cc:1048] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:54.838807 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:54.841001 14260 raft_consensus.cc:2468] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:54.847252 14546 raft_consensus.cc:493] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.852453 14183 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.859473 14383 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:54.859922 14383 ts_tablet_manager.cc:1403] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.337s	user 0.009s	sys 0.016s
W20260709 13:18:54.851385 14078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 56657.8us
I20260709 13:18:54.856307 14546 raft_consensus.cc:515] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.865603 14381 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:54.858480 14335 raft_consensus.cc:2468] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:54.866351 14381 ts_tablet_manager.cc:1403] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.337s	user 0.019s	sys 0.004s
I20260709 13:18:54.866920 14384 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
W20260709 13:18:54.864112 14077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 45890.5us
I20260709 13:18:54.868999 14384 ts_tablet_manager.cc:1403] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.359s	user 0.015s	sys 0.053s
I20260709 13:18:54.874161 14382 tablet_bootstrap.cc:654] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.876703 14381 raft_consensus.cc:359] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.878366 14381 raft_consensus.cc:385] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.878698 14381 raft_consensus.cc:740] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.879149 14384 raft_consensus.cc:359] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.879704 14384 raft_consensus.cc:385] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.879925 14384 raft_consensus.cc:740] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.878068 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965959c6060c4e31872a4d63bb4cc3d8" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:54.885097 14332 raft_consensus.cc:3060] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.889549 14546 leader_election.cc:290] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:54.891325 14153 leader_election.cc:304] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:54.891892 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2af9154cf4749976dc55b506018e5" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:54.892536 14463 raft_consensus.cc:2804] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:54.892704 14335 raft_consensus.cc:2393] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c19f7f4ddb074bd8997d01296c3080d6 in current term 1: Already voted for candidate 45ddcb989aef4c9fa869766c3682632c in this term.
I20260709 13:18:54.893101 14463 raft_consensus.cc:697] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:54.893245 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9e2af9154cf4749976dc55b506018e5" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:54.893965 14383 raft_consensus.cc:359] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.895550 14383 raft_consensus.cc:385] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:54.895879 14383 raft_consensus.cc:740] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:54.897478 14384 consensus_queue.cc:260] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:54.899489 14381 consensus_queue.cc:260] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.893970 14463 consensus_queue.cc:237] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:54.903276 14383 consensus_queue.cc:260] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:54.908071 14381 ts_tablet_manager.cc:1434] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:18:54.908396 14384 ts_tablet_manager.cc:1434] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:18:54.905530 14227 leader_election.cc:304] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:54.911585 14547 raft_consensus.cc:3060] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.912412 14077 leader_election.cc:304] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:54.913965 14562 raft_consensus.cc:2804] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:54.914660 14562 raft_consensus.cc:697] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:54.915568 14562 consensus_queue.cc:237] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:54.916503 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965959c6060c4e31872a4d63bb4cc3d8" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:54.917162 14260 raft_consensus.cc:3060] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:54.918897 14384 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:54.925590 14381 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:54.931406 14383 ts_tablet_manager.cc:1434] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.002s
I20260709 13:18:54.932436 14383 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:54.934741 14183 raft_consensus.cc:2468] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:54.966491 14503 consensus_queue.cc:1048] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:54.974463 14260 raft_consensus.cc:2468] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:54.990645 14384 tablet_bootstrap.cc:654] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:54.997638 14332 raft_consensus.cc:2468] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:55.001262 14547 raft_consensus.cc:2749] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:54.984328 14077 leader_election.cc:304] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:55.008173 14431 raft_consensus.cc:2804] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:55.002811 14461 consensus_queue.cc:1048] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:55.008847 14431 raft_consensus.cc:697] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:55.017692 14383 tablet_bootstrap.cc:654] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.017163 14431 consensus_queue.cc:237] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.042675 14381 tablet_bootstrap.cc:654] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.055373 14009 catalog_manager.cc:5697] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.127740 14383 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:55.128505 14383 ts_tablet_manager.cc:1403] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.196s	user 0.022s	sys 0.000s
I20260709 13:18:55.128242 14010 catalog_manager.cc:5697] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.130591 14383 raft_consensus.cc:359] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.131062 14383 raft_consensus.cc:385] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.131222 14383 raft_consensus.cc:740] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.131134 14010 catalog_manager.cc:5697] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.132061 14383 consensus_queue.cc:260] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.139348 14382 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:55.142230 14383 ts_tablet_manager.cc:1434] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:18:55.139868 14382 ts_tablet_manager.cc:1403] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.309s	user 0.021s	sys 0.012s
I20260709 13:18:55.143268 14383 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:55.143419 14384 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:55.144006 14384 ts_tablet_manager.cc:1403] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.225s	user 0.011s	sys 0.011s
I20260709 13:18:55.145969 14382 raft_consensus.cc:359] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.146732 14382 raft_consensus.cc:385] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.147022 14382 raft_consensus.cc:740] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.149724 14383 tablet_bootstrap.cc:654] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.152405 14384 raft_consensus.cc:359] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.153119 14384 raft_consensus.cc:385] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.153622 14384 raft_consensus.cc:740] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.154332 14384 consensus_queue.cc:260] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.155445 14463 consensus_queue.cc:1048] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:55.162307 14384 ts_tablet_manager.cc:1434] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:18:55.163319 14384 tablet_bootstrap.cc:492] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:55.164328 14382 consensus_queue.cc:260] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.169936 14384 tablet_bootstrap.cc:654] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.172849 14381 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:55.173318 14381 ts_tablet_manager.cc:1403] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.249s	user 0.019s	sys 0.001s
I20260709 13:18:55.174263 14382 ts_tablet_manager.cc:1434] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:18:55.174909 14501 raft_consensus.cc:493] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.175595 14501 raft_consensus.cc:515] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.177690 14381 raft_consensus.cc:359] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.178373 14381 raft_consensus.cc:385] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.178295 14501 leader_election.cc:290] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:55.178787 14422 consensus_queue.cc:1048] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:55.180989 14547 raft_consensus.cc:493] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.181468 14547 raft_consensus.cc:515] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.183460 14547 leader_election.cc:290] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:55.185803 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.186128 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.186470 14112 raft_consensus.cc:2468] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:55.185803 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.187989 14258 raft_consensus.cc:2468] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:55.174916 14383 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:55.189280 14383 ts_tablet_manager.cc:1403] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.007s
I20260709 13:18:55.189430 14225 leader_election.cc:304] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:55.190483 14547 raft_consensus.cc:2804] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.190830 14547 raft_consensus.cc:493] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.191228 14547 raft_consensus.cc:3060] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.191022 14300 leader_election.cc:304] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:55.191615 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:55.192502 14335 raft_consensus.cc:2468] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:55.193120 14436 raft_consensus.cc:2804] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.193480 14436 raft_consensus.cc:493] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.193825 14436 raft_consensus.cc:3060] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.201391 14381 raft_consensus.cc:740] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.209336 14381 consensus_queue.cc:260] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.209656 14436 raft_consensus.cc:515] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.211531 14381 ts_tablet_manager.cc:1434] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:18:55.202057 14382 tablet_bootstrap.cc:492] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:55.203576 14383 raft_consensus.cc:359] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.205631 14501 raft_consensus.cc:493] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.212839 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:55.213457 14110 raft_consensus.cc:3060] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.213359 14501 raft_consensus.cc:515] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.213250 14010 catalog_manager.cc:5697] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.215986 14501 leader_election.cc:290] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:55.216534 14383 raft_consensus.cc:385] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.216833 14383 raft_consensus.cc:740] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.217377 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:55.217557 14383 consensus_queue.cc:260] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.220024 14383 ts_tablet_manager.cc:1434] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.004s
I20260709 13:18:55.216178 14436 leader_election.cc:290] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:55.208073 14547 raft_consensus.cc:515] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.216275 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e519b3fde754be785619f806259cbcb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.223883 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:55.224642 14335 raft_consensus.cc:2393] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c19f7f4ddb074bd8997d01296c3080d6 in current term 1: Already voted for candidate 0646b0acb9c943b59389eace852a5215 in this term.
W20260709 13:18:55.225016 14299 leader_election.cc:343] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.225879 14258 raft_consensus.cc:2393] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0646b0acb9c943b59389eace852a5215 in current term 1: Already voted for candidate c19f7f4ddb074bd8997d01296c3080d6 in this term.
I20260709 13:18:55.226222 14383 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:55.232290 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e519b3fde754be785619f806259cbcb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:55.233958 14300 leader_election.cc:343] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.234136 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0464e1aacb18475980f90e52a22f5c55" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:55.234511 14300 leader_election.cc:304] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:55.235173 14110 raft_consensus.cc:2468] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:55.235663 14501 raft_consensus.cc:2749] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.235733 14225 leader_election.cc:304] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:55.236527 14299 leader_election.cc:304] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.237358 14546 raft_consensus.cc:2749] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.232579 14383 tablet_bootstrap.cc:654] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.237844 14436 raft_consensus.cc:2804] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:55.238161 14547 leader_election.cc:290] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:55.240525 14436 raft_consensus.cc:697] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:55.241350 14436 consensus_queue.cc:237] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.245025 14422 raft_consensus.cc:493] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.208154 14384 tablet_bootstrap.cc:492] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:55.245792 14384 ts_tablet_manager.cc:1403] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.083s	user 0.025s	sys 0.012s
I20260709 13:18:55.245579 14422 raft_consensus.cc:515] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.248318 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:55.248805 14422 leader_election.cc:290] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:55.248832 14384 raft_consensus.cc:359] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.249718 14384 raft_consensus.cc:385] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.238097 14381 tablet_bootstrap.cc:492] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:55.248294 14382 tablet_bootstrap.cc:654] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.255084 14384 raft_consensus.cc:740] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.250454 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.264810 14187 raft_consensus.cc:3060] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.263839 14381 tablet_bootstrap.cc:654] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.277530 14503 consensus_queue.cc:1048] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:55.286084 14151 leader_election.cc:304] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:55.257536 14384 consensus_queue.cc:260] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.290675 14384 ts_tablet_manager.cc:1434] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:18:55.296885 14384 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:55.304062 14431 raft_consensus.cc:493] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.304622 14431 raft_consensus.cc:515] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
W20260709 13:18:55.305209 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 48301.7us
I20260709 13:18:55.307652 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:55.308750 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:55.314399 14078 leader_election.cc:304] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:55.315500 14383 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:55.315999 14383 ts_tablet_manager.cc:1403] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.017s
I20260709 13:18:55.315500 14562 raft_consensus.cc:2749] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.320132 14383 raft_consensus.cc:359] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.307951 14431 leader_election.cc:290] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:55.320814 14383 raft_consensus.cc:385] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.321259 14383 raft_consensus.cc:740] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.322227 14383 consensus_queue.cc:260] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.324702 14383 ts_tablet_manager.cc:1434] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:55.330132 14383 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:55.330399 14422 raft_consensus.cc:2749] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.333055 14382 tablet_bootstrap.cc:492] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:55.333580 14382 ts_tablet_manager.cc:1403] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.024s
I20260709 13:18:55.346889 14381 tablet_bootstrap.cc:492] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:55.359390 14381 ts_tablet_manager.cc:1403] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.122s	user 0.022s	sys 0.017s
I20260709 13:18:55.343956 14007 catalog_manager.cc:5697] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.336467 14382 raft_consensus.cc:359] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.360978 14382 raft_consensus.cc:385] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.363529 14382 raft_consensus.cc:740] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.338209 14383 tablet_bootstrap.cc:654] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.366585 14382 consensus_queue.cc:260] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.348129 14384 tablet_bootstrap.cc:654] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.337108 14110 raft_consensus.cc:3060] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.365302 14381 raft_consensus.cc:359] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.393601 14381 raft_consensus.cc:385] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.394910 14381 raft_consensus.cc:740] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.395758 14382 ts_tablet_manager.cc:1434] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.003s
I20260709 13:18:55.404716 14382 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:55.404527 14587 consensus_queue.cc:1048] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:55.396314 14381 consensus_queue.cc:260] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.407212 14381 ts_tablet_manager.cc:1434] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 13:18:55.408852 14381 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:55.414716 14463 raft_consensus.cc:493] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.415052 14381 tablet_bootstrap.cc:654] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.422945 14384 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:55.423668 14384 ts_tablet_manager.cc:1403] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.016s
I20260709 13:18:55.415432 14463 raft_consensus.cc:515] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.426271 14463 leader_election.cc:290] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.427524 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd224c5b12246cf83abcd8530f9e091" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.427340 14384 raft_consensus.cc:359] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.429478 14384 raft_consensus.cc:385] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.429780 14384 raft_consensus.cc:740] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
W20260709 13:18:55.429891 14152 leader_election.cc:343] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.430469 14384 consensus_queue.cc:260] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.432543 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd224c5b12246cf83abcd8530f9e091" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.432921 14381 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:55.433233 14111 raft_consensus.cc:2468] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:55.433449 14381 ts_tablet_manager.cc:1403] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 13:18:55.433889 14463 consensus_queue.cc:1048] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:55.434553 14151 leader_election.cc:304] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.436187 14422 raft_consensus.cc:2804] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.436645 14383 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:55.437207 14383 ts_tablet_manager.cc:1403] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.107s	user 0.027s	sys 0.019s
I20260709 13:18:55.436594 14422 raft_consensus.cc:493] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.439998 14422 raft_consensus.cc:3060] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.440307 14384 ts_tablet_manager.cc:1434] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.001s
I20260709 13:18:55.440919 14383 raft_consensus.cc:359] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.441394 14384 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:55.445989 14431 raft_consensus.cc:493] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.446707 14431 raft_consensus.cc:515] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.448791 14384 tablet_bootstrap.cc:654] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.450769 14431 leader_election.cc:290] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.450804 14383 raft_consensus.cc:385] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.452301 14383 raft_consensus.cc:740] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.453150 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:55.453627 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.453179 14383 consensus_queue.cc:260] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.454236 14260 raft_consensus.cc:2468] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
W20260709 13:18:55.454649 14077 leader_election.cc:343] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.436400 14381 raft_consensus.cc:359] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.455359 14381 raft_consensus.cc:385] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.455390 14077 leader_election.cc:304] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:55.455786 14381 raft_consensus.cc:740] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.455884 14383 ts_tablet_manager.cc:1434] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:18:55.456723 14431 raft_consensus.cc:2804] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.456959 14383 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:55.456580 14381 consensus_queue.cc:260] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.457149 14431 raft_consensus.cc:493] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.457645 14431 raft_consensus.cc:3060] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.458856 14381 ts_tablet_manager.cc:1434] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:18:55.464500 14384 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:55.464031 14381 tablet_bootstrap.cc:492] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:55.465238 14384 ts_tablet_manager.cc:1403] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
I20260709 13:18:55.466694 14431 raft_consensus.cc:515] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.470916 14384 raft_consensus.cc:359] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.478668 14384 raft_consensus.cc:385] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.478869 14501 raft_consensus.cc:493] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.479043 14384 raft_consensus.cc:740] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.479379 14501 raft_consensus.cc:515] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.479959 14384 consensus_queue.cc:260] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.472343 14383 tablet_bootstrap.cc:654] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.483801 14384 ts_tablet_manager.cc:1434] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:18:55.490873 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:55.483050 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f560b8d81584651b4720691469eca98" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:55.509519 14258 raft_consensus.cc:3060] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.509888 14384 tablet_bootstrap.cc:492] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:55.509769 14187 raft_consensus.cc:2468] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:55.499015 14422 raft_consensus.cc:515] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.489521 14431 leader_election.cc:290] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.513969 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd224c5b12246cf83abcd8530f9e091" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:55.514609 14110 raft_consensus.cc:3060] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.516358 14384 tablet_bootstrap.cc:654] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.513878 14300 leader_election.cc:304] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:55.481472 14501 leader_election.cc:290] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.519066 14501 raft_consensus.cc:2804] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.519444 14501 raft_consensus.cc:493] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.519765 14501 raft_consensus.cc:3060] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.521276 14422 leader_election.cc:290] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.522106 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd224c5b12246cf83abcd8530f9e091" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
W20260709 13:18:55.524159 14152 leader_election.cc:343] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.492527 14587 raft_consensus.cc:493] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.528724 14587 raft_consensus.cc:515] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.529706 14381 tablet_bootstrap.cc:654] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.530855 14587 leader_election.cc:290] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:55.484719 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f560b8d81584651b4720691469eca98" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.532792 14599 consensus_queue.cc:1048] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:55.491808 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:55.541066 14431 raft_consensus.cc:493] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.537254 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.551875 14111 raft_consensus.cc:2468] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:55.550688 14431 raft_consensus.cc:515] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.554126 14299 leader_election.cc:304] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:55.554387 14431 leader_election.cc:290] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:55.541206 14384 tablet_bootstrap.cc:492] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:55.555439 14110 raft_consensus.cc:2468] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:55.556183 14384 ts_tablet_manager.cc:1403] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.004s
I20260709 13:18:55.541585 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.556880 14151 leader_election.cc:304] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.546618 14561 consensus_queue.cc:1048] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:18:55.558187 14599 raft_consensus.cc:2804] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:55.541268 14300 leader_election.cc:343] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.558761 14599 raft_consensus.cc:697] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:55.559688 14599 consensus_queue.cc:237] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.559996 14384 raft_consensus.cc:359] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.560721 14384 raft_consensus.cc:385] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.560997 14384 raft_consensus.cc:740] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.561743 14384 consensus_queue.cc:260] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.562673 14436 raft_consensus.cc:2804] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.539191 14501 raft_consensus.cc:515] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.563021 14436 raft_consensus.cc:493] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.563443 14436 raft_consensus.cc:3060] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.564570 14384 ts_tablet_manager.cc:1434] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:55.565493 14384 tablet_bootstrap.cc:492] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
W20260709 13:18:55.571411 14300 leader_election.cc:343] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.571877 14384 tablet_bootstrap.cc:654] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.574262 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f560b8d81584651b4720691469eca98" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:55.574893 14186 raft_consensus.cc:3060] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.576283 14562 consensus_queue.cc:1048] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:55.583355 14384 tablet_bootstrap.cc:492] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:55.583514 14186 raft_consensus.cc:2468] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:55.584501 14443 raft_consensus.cc:493] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.586025 14443 raft_consensus.cc:515] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.583958 14384 ts_tablet_manager.cc:1403] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:18:55.586571 14300 leader_election.cc:304] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:55.571467 14436 raft_consensus.cc:515] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.590868 14436 leader_election.cc:290] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:18:55.592854 14077 leader_election.cc:343] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.593221 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9282e9c78a46a6a3bba23269e7adc7" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:55.596273 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df25294a6ce4432cbffe41a0bee4c8b8" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:55.597018 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:55.597592 14111 raft_consensus.cc:3060] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:55.596463 14226 leader_election.cc:343] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.601747 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f560b8d81584651b4720691469eca98" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
W20260709 13:18:55.603771 14300 leader_election.cc:343] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.604655 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
W20260709 13:18:55.605971 14300 leader_election.cc:343] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.604527 14010 catalog_manager.cc:5697] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.610093 14587 raft_consensus.cc:493] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.610706 14587 raft_consensus.cc:515] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.613005 14587 leader_election.cc:290] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.539137 14383 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:55.614557 14383 ts_tablet_manager.cc:1403] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.158s	user 0.015s	sys 0.011s
I20260709 13:18:55.614660 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9282e9c78a46a6a3bba23269e7adc7" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:55.616703 14300 leader_election.cc:343] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.617292 14383 raft_consensus.cc:359] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.617969 14383 raft_consensus.cc:385] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.617967 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9282e9c78a46a6a3bba23269e7adc7" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.618471 14383 raft_consensus.cc:740] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.618732 14257 raft_consensus.cc:2468] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:55.618914 14384 raft_consensus.cc:359] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.619185 14383 consensus_queue.cc:260] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.619591 14384 raft_consensus.cc:385] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.620265 14384 raft_consensus.cc:740] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.549602 14382 tablet_bootstrap.cc:654] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.621258 14384 consensus_queue.cc:260] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.617969 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9282e9c78a46a6a3bba23269e7adc7" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:55.622565 14335 raft_consensus.cc:2468] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:55.623325 14384 ts_tablet_manager.cc:1434] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.000s
I20260709 13:18:55.623688 14227 leader_election.cc:304] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:55.624285 14384 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:55.624661 14546 raft_consensus.cc:2804] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.625026 14546 raft_consensus.cc:493] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.625344 14546 raft_consensus.cc:3060] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.630614 14384 tablet_bootstrap.cc:654] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.630906 14300 leader_election.cc:304] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:55.620770 14111 raft_consensus.cc:2468] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:55.634902 14546 raft_consensus.cc:515] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.635385 14299 leader_election.cc:304] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.637430 14587 raft_consensus.cc:2804] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.638744 14599 raft_consensus.cc:493] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.639249 14599 raft_consensus.cc:515] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.637647 14503 raft_consensus.cc:493] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.641324 14599 leader_election.cc:290] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:55.585362 14501 leader_election.cc:290] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.618055 14443 leader_election.cc:290] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:55.638787 14587 raft_consensus.cc:493] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.646885 14383 ts_tablet_manager.cc:1434] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:18:55.636371 14436 raft_consensus.cc:2804] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:55.641355 14503 raft_consensus.cc:515] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.661543 14503 leader_election.cc:290] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:55.662310 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e519b3fde754be785619f806259cbcb" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:55.662977 14335 raft_consensus.cc:2468] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:55.663199 14546 leader_election.cc:290] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:55.665216 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9282e9c78a46a6a3bba23269e7adc7" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:55.666425 14153 leader_election.cc:304] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
W20260709 13:18:55.666733 14226 leader_election.cc:343] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.667274 14599 raft_consensus.cc:2804] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.667654 14599 raft_consensus.cc:493] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.667992 14599 raft_consensus.cc:3060] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.668251 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9282e9c78a46a6a3bba23269e7adc7" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:55.651311 14383 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:55.675778 14383 tablet_bootstrap.cc:654] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:55.677227 14077 leader_election.cc:343] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.677536 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b2ad2ed67144c6b9baffea26c9ae16" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:55.677241 14599 raft_consensus.cc:515] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.678393 14562 consensus_queue.cc:1048] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:55.679102 14300 leader_election.cc:343] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.669884 14258 raft_consensus.cc:2468] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:55.680034 14599 leader_election.cc:290] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:55.680944 14436 raft_consensus.cc:697] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:55.681838 14436 consensus_queue.cc:237] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.683883 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e519b3fde754be785619f806259cbcb" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:55.686275 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e519b3fde754be785619f806259cbcb" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:55.686555 14077 leader_election.cc:304] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:55.686928 14334 raft_consensus.cc:3060] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.687398 14561 raft_consensus.cc:2804] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:55.687858 14561 raft_consensus.cc:697] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
W20260709 13:18:55.688341 14151 leader_election.cc:343] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.688679 14561 consensus_queue.cc:237] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.653126 14609 raft_consensus.cc:2804] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:55.657393 14381 tablet_bootstrap.cc:492] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:55.693369 14381 ts_tablet_manager.cc:1403] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.234s	user 0.016s	sys 0.000s
I20260709 13:18:55.658506 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e519b3fde754be785619f806259cbcb" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.651336 14587 raft_consensus.cc:3060] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.696010 14381 raft_consensus.cc:359] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.700618 14381 raft_consensus.cc:385] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.701046 14381 raft_consensus.cc:740] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.702042 14381 consensus_queue.cc:260] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.716953 14381 ts_tablet_manager.cc:1434] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:18:55.718379 14381 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:55.711870 14609 raft_consensus.cc:697] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:55.720916 14609 consensus_queue.cc:237] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
W20260709 13:18:55.725970 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:18:55.728330 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 92203.9us
W20260709 13:18:55.717018 14151 leader_election.cc:343] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.736665 14334 raft_consensus.cc:2468] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:55.766037 14608 consensus_queue.cc:1048] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:18:55.775955 14384 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:55.776512 14384 ts_tablet_manager.cc:1403] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.010s
I20260709 13:18:55.776440 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b2ad2ed67144c6b9baffea26c9ae16" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.761171 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df25294a6ce4432cbffe41a0bee4c8b8" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
W20260709 13:18:55.782195 14299 leader_election.cc:343] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.782743 14299 leader_election.cc:304] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:55.779810 14384 raft_consensus.cc:359] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.785796 14384 raft_consensus.cc:385] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.786144 14384 raft_consensus.cc:740] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.792744 14384 consensus_queue.cc:260] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
W20260709 13:18:55.762557 14077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 44107.9us
W20260709 13:18:55.764091 14151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 49212us
I20260709 13:18:55.787294 14503 raft_consensus.cc:493] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.788137 14608 raft_consensus.cc:2749] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.799243 14332 raft_consensus.cc:2468] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:55.829761 14384 ts_tablet_manager.cc:1434] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:18:55.810163 14503 raft_consensus.cc:515] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.811108 14562 raft_consensus.cc:493] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.808183 14381 tablet_bootstrap.cc:654] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.829063 14382 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:55.835139 14382 ts_tablet_manager.cc:1403] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.431s	user 0.015s	sys 0.015s
I20260709 13:18:55.832181 14384 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:55.836442 14562 raft_consensus.cc:515] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:55.838786 14587 raft_consensus.cc:515] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.842816 14382 raft_consensus.cc:359] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.843752 14382 raft_consensus.cc:385] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.843596 14153 leader_election.cc:304] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:55.844101 14382 raft_consensus.cc:740] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.844918 14382 consensus_queue.cc:260] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.847255 14335 raft_consensus.cc:2393] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c19f7f4ddb074bd8997d01296c3080d6 in current term 1: Already voted for candidate 0646b0acb9c943b59389eace852a5215 in this term.
I20260709 13:18:55.848271 14599 raft_consensus.cc:2804] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:55.848790 14599 raft_consensus.cc:697] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:55.849985 14382 ts_tablet_manager.cc:1434] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:18:55.849602 14599 consensus_queue.cc:237] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.851208 14587 leader_election.cc:290] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.852356 14503 leader_election.cc:290] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.853860 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9282e9c78a46a6a3bba23269e7adc7" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:55.854657 14258 raft_consensus.cc:2393] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0646b0acb9c943b59389eace852a5215 in current term 1: Already voted for candidate c19f7f4ddb074bd8997d01296c3080d6 in this term.
I20260709 13:18:55.854508 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a68e63a39ca44319695c6f4e9937912" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.855213 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a68e63a39ca44319695c6f4e9937912" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:55.854508 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9282e9c78a46a6a3bba23269e7adc7" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:55.856552 14187 raft_consensus.cc:3060] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.856781 14383 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:55.857267 14383 ts_tablet_manager.cc:1403] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.207s	user 0.024s	sys 0.017s
W20260709 13:18:55.857450 14300 leader_election.cc:343] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:55.858140 14300 leader_election.cc:343] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.858548 14300 leader_election.cc:304] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.859308 14609 raft_consensus.cc:2749] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.862025 14227 leader_election.cc:304] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:55.863137 14546 raft_consensus.cc:2749] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.863447 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa413bb6214043609003b441decca56f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:55.865090 14383 raft_consensus.cc:359] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.865892 14383 raft_consensus.cc:385] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.866170 14383 raft_consensus.cc:740] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.866706 14384 tablet_bootstrap.cc:654] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.868448 14383 consensus_queue.cc:260] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.869362 14621 raft_consensus.cc:493] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.869776 14621 raft_consensus.cc:515] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.870671 14562 leader_election.cc:290] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:55.871830 14621 leader_election.cc:290] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.875800 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa413bb6214043609003b441decca56f" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.878626 14503 consensus_queue.cc:1048] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:55.882403 14382 tablet_bootstrap.cc:492] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:55.883247 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfb3a603d584bcabbf0c9f0d3594ff7" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:55.886346 14618 log.cc:927] Time spent T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:55.882843 14187 raft_consensus.cc:2468] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:55.889776 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfb3a603d584bcabbf0c9f0d3594ff7" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:55.890388 14382 tablet_bootstrap.cc:654] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.887239 14007 catalog_manager.cc:5697] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.896380 14381 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:55.896862 14381 ts_tablet_manager.cc:1403] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.179s	user 0.007s	sys 0.005s
I20260709 13:18:55.898880 14300 leader_election.cc:304] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.899637 14381 raft_consensus.cc:359] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.900554 14381 raft_consensus.cc:385] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.900641 14383 ts_tablet_manager.cc:1434] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:18:55.900952 14610 raft_consensus.cc:2804] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:55.900998 14381 raft_consensus.cc:740] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.903550 14381 consensus_queue.cc:260] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:18:55.905210 14078 leader_election.cc:343] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.905740 14381 ts_tablet_manager.cc:1434] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:55.906327 14078 leader_election.cc:304] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:55.907020 14381 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:55.907998 14622 raft_consensus.cc:2804] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.908430 14622 raft_consensus.cc:493] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.908754 14622 raft_consensus.cc:3060] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.901664 14383 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:55.901592 14610 raft_consensus.cc:697] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
W20260709 13:18:55.912951 14077 leader_election.cc:343] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.913316 14381 tablet_bootstrap.cc:654] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.913769 14610 consensus_queue.cc:237] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
W20260709 13:18:55.914223 14077 leader_election.cc:343] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.890448 14010 catalog_manager.cc:5697] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.929389 14010 catalog_manager.cc:5697] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.933840 14383 tablet_bootstrap.cc:654] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:55.925295 14077 leader_election.cc:304] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.947060 14616 raft_consensus.cc:2749] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.947466 14382 tablet_bootstrap.cc:492] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:55.948029 14382 ts_tablet_manager.cc:1403] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.000s
W20260709 13:18:55.948704 14077 leader_election.cc:343] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.948501 14621 consensus_queue.cc:1048] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:55.949290 14077 leader_election.cc:304] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.950120 14621 raft_consensus.cc:2749] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:55.950891 14382 raft_consensus.cc:359] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.951620 14382 raft_consensus.cc:385] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:55.951881 14382 raft_consensus.cc:740] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:55.960502 14622 raft_consensus.cc:515] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:55.963433 14622 leader_election.cc:290] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:55.966847 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df25294a6ce4432cbffe41a0bee4c8b8" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:55.969707 14382 consensus_queue.cc:260] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:55.970544 14333 raft_consensus.cc:3060] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.973066 14382 ts_tablet_manager.cc:1434] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:18:55.974026 14382 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:55.981003 14422 raft_consensus.cc:493] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.981582 14422 raft_consensus.cc:515] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:55.983639 14422 leader_election.cc:290] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:55.986140 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfb3a603d584bcabbf0c9f0d3594ff7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:55.988179 14152 leader_election.cc:343] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:55.989085 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfb3a603d584bcabbf0c9f0d3594ff7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:55.989786 14109 raft_consensus.cc:2468] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:55.990912 14151 leader_election.cc:304] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:55.992156 14422 raft_consensus.cc:2804] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:55.992569 14422 raft_consensus.cc:493] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.993125 14422 raft_consensus.cc:3060] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:55.998854 14382 tablet_bootstrap.cc:654] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.006554 14008 catalog_manager.cc:5697] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.011922 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df25294a6ce4432cbffe41a0bee4c8b8" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:56.011976 14422 raft_consensus.cc:515] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.016505 14422 leader_election.cc:290] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:56.017489 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfb3a603d584bcabbf0c9f0d3594ff7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:56.018134 14109 raft_consensus.cc:3060] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.036372 14383 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:56.038498 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dfb3a603d584bcabbf0c9f0d3594ff7" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:56.039925 14383 ts_tablet_manager.cc:1403] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.009s
W20260709 13:18:56.042062 14152 leader_election.cc:343] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.045060 14422 consensus_queue.cc:1048] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:56.048882 14077 leader_election.cc:343] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.050513 14010 catalog_manager.cc:5697] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.057929 14381 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:56.061964 14381 ts_tablet_manager.cc:1403] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.018s
I20260709 13:18:56.061311 14384 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:56.062595 14384 ts_tablet_manager.cc:1403] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.232s	user 0.006s	sys 0.019s
I20260709 13:18:56.064554 14382 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:56.065276 14384 raft_consensus.cc:359] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.065805 14382 ts_tablet_manager.cc:1403] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.003s
I20260709 13:18:56.065935 14384 raft_consensus.cc:385] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.066254 14384 raft_consensus.cc:740] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.067129 14384 consensus_queue.cc:260] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.061363 14383 raft_consensus.cc:359] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.051277 14333 raft_consensus.cc:2468] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:56.053040 14109 raft_consensus.cc:2468] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:56.070291 14078 leader_election.cc:304] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:56.068876 14383 raft_consensus.cc:385] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.069209 14546 raft_consensus.cc:493] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.071674 14546 raft_consensus.cc:515] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.072347 14622 raft_consensus.cc:2804] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.073179 14384 ts_tablet_manager.cc:1434] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:18:56.073732 14546 leader_election.cc:290] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:56.074155 14384 tablet_bootstrap.cc:492] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:56.073194 14622 raft_consensus.cc:697] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:56.075119 14622 consensus_queue.cc:237] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.076191 14151 leader_election.cc:304] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.076329 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd224c5b12246cf83abcd8530f9e091" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:56.078246 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd224c5b12246cf83abcd8530f9e091" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:56.078254 14599 raft_consensus.cc:2804] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.081189 14599 raft_consensus.cc:697] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:56.082017 14599 consensus_queue.cc:237] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.084162 14225 leader_election.cc:304] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:56.085142 14381 raft_consensus.cc:359] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.085446 14546 raft_consensus.cc:2749] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:56.085865 14381 raft_consensus.cc:385] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.086208 14381 raft_consensus.cc:740] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.086791 14381 consensus_queue.cc:260] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.091913 14261 raft_consensus.cc:3060] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.092568 14383 raft_consensus.cc:740] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.094132 14383 consensus_queue.cc:260] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.103436 14383 ts_tablet_manager.cc:1434] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.000s
I20260709 13:18:56.095508 14382 raft_consensus.cc:359] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.106050 14384 tablet_bootstrap.cc:654] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.106235 14382 raft_consensus.cc:385] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.106671 14382 raft_consensus.cc:740] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.107514 14382 consensus_queue.cc:260] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.114338 14382 ts_tablet_manager.cc:1434] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 13:18:56.111881 14381 ts_tablet_manager.cc:1434] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:18:56.120980 14381 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:56.121065 14382 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:56.112661 14383 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:56.109045 14007 catalog_manager.cc:5697] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.127784 14463 consensus_queue.cc:1048] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:56.133548 14422 raft_consensus.cc:493] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.134068 14422 raft_consensus.cc:515] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.136094 14422 leader_election.cc:290] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:56.139983 14381 tablet_bootstrap.cc:654] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.145725 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b2ad2ed67144c6b9baffea26c9ae16" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:56.146657 14383 tablet_bootstrap.cc:654] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.149015 14587 consensus_queue.cc:1048] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:56.151871 14381 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:56.152422 14381 ts_tablet_manager.cc:1403] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.005s
I20260709 13:18:56.152882 14382 tablet_bootstrap.cc:654] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.155203 14381 raft_consensus.cc:359] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:18:56.149024 14151 leader_election.cc:343] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.157554 14384 tablet_bootstrap.cc:492] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:56.158073 14384 ts_tablet_manager.cc:1403] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.003s
I20260709 13:18:56.161152 14384 raft_consensus.cc:359] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.161763 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b2ad2ed67144c6b9baffea26c9ae16" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:56.162861 14333 raft_consensus.cc:2468] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:56.161906 14384 raft_consensus.cc:385] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.164209 14384 raft_consensus.cc:740] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.164518 14153 leader_election.cc:304] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:56.164899 14384 consensus_queue.cc:260] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.165843 14463 raft_consensus.cc:2804] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:56.166208 14463 raft_consensus.cc:493] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.166513 14463 raft_consensus.cc:3060] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.166512 14384 ts_tablet_manager.cc:1434] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:18:56.155941 14381 raft_consensus.cc:385] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.172313 14381 raft_consensus.cc:740] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.176009 14384 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:56.179056 14463 raft_consensus.cc:515] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.181769 14381 consensus_queue.cc:260] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.189289 14381 ts_tablet_manager.cc:1434] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.003s
I20260709 13:18:56.184942 14261 raft_consensus.cc:3060] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.192938 14587 consensus_queue.cc:1048] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:56.196767 14587 raft_consensus.cc:493] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.197358 14587 raft_consensus.cc:515] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.202517 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:56.184443 14007 catalog_manager.cc:5697] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.210270 14381 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:56.210469 14384 tablet_bootstrap.cc:654] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.215721 14463 leader_election.cc:290] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:56.217089 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b2ad2ed67144c6b9baffea26c9ae16" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:56.219220 14587 leader_election.cc:290] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:56.217651 14383 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:56.220409 14383 ts_tablet_manager.cc:1403] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.003s
W20260709 13:18:56.221515 14151 leader_election.cc:343] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.222528 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b2ad2ed67144c6b9baffea26c9ae16" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:56.223165 14333 raft_consensus.cc:3060] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.223459 14383 raft_consensus.cc:359] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.224220 14383 raft_consensus.cc:385] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.224478 14383 raft_consensus.cc:740] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.225478 14381 tablet_bootstrap.cc:654] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.225221 14383 consensus_queue.cc:260] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.220947 14546 raft_consensus.cc:493] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.229056 14546 raft_consensus.cc:515] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.232267 14625 consensus_queue.cc:1048] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:18:56.270720 14616 raft_consensus.cc:493] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.271579 14616 raft_consensus.cc:515] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.291252 14383 ts_tablet_manager.cc:1434] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.071s	user 0.012s	sys 0.013s
I20260709 13:18:56.291715 14382 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:56.292271 14382 ts_tablet_manager.cc:1403] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.171s	user 0.039s	sys 0.036s
I20260709 13:18:56.292400 14383 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:56.293860 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f560b8d81584651b4720691469eca98" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:56.295603 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b2ad2ed67144c6b9baffea26c9ae16" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:56.296263 14546 leader_election.cc:290] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:56.297286 14382 raft_consensus.cc:359] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.298020 14382 raft_consensus.cc:385] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.298130 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f560b8d81584651b4720691469eca98" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:56.299772 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:56.299885 14227 leader_election.cc:304] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:56.298309 14382 raft_consensus.cc:740] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.302960 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b2ad2ed67144c6b9baffea26c9ae16" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:56.302081 14382 consensus_queue.cc:260] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.303475 14616 leader_election.cc:290] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
W20260709 13:18:56.304248 14300 leader_election.cc:343] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.304509 14187 raft_consensus.cc:2393] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 675788979b2e4a89be45b2af4fa3141a in current term 1: Already voted for candidate 45ddcb989aef4c9fa869766c3682632c in this term.
W20260709 13:18:56.304904 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 77109.9us
I20260709 13:18:56.305816 14077 leader_election.cc:304] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:56.306726 14621 raft_consensus.cc:3060] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.306911 14260 raft_consensus.cc:3060] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.312310 14382 ts_tablet_manager.cc:1434] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 13:18:56.313274 14382 tablet_bootstrap.cc:492] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
W20260709 13:18:56.320932 14299 leader_election.cc:343] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.323561 14383 tablet_bootstrap.cc:654] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.324105 14299 leader_election.cc:304] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.324715 14382 tablet_bootstrap.cc:654] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.326781 14333 raft_consensus.cc:2468] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:56.326906 14622 consensus_queue.cc:1048] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:56.328926 14153 leader_election.cc:304] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:56.330127 14463 raft_consensus.cc:2804] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.330591 14463 raft_consensus.cc:697] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:56.331379 14463 consensus_queue.cc:237] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.336335 14501 raft_consensus.cc:2749] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:56.360606 14384 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:56.361155 14384 ts_tablet_manager.cc:1403] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.185s	user 0.023s	sys 0.039s
I20260709 13:18:56.357995 14616 raft_consensus.cc:493] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.366873 14384 raft_consensus.cc:359] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.367578 14384 raft_consensus.cc:385] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.367847 14384 raft_consensus.cc:740] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.368491 14384 consensus_queue.cc:260] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.370543 14384 ts_tablet_manager.cc:1434] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:56.371819 14384 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:56.372512 14616 raft_consensus.cc:515] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.377189 14616 leader_election.cc:290] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:56.362581 14648 raft_consensus.cc:2749] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:56.389328 14381 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:56.389863 14381 ts_tablet_manager.cc:1403] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.030s
I20260709 13:18:56.391671 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:56.392513 14186 raft_consensus.cc:2468] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:56.393467 14381 raft_consensus.cc:359] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.393810 14609 consensus_queue.cc:1048] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:56.394263 14381 raft_consensus.cc:385] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.394562 14381 raft_consensus.cc:740] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.395179 14381 consensus_queue.cc:260] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.396921 14381 ts_tablet_manager.cc:1434] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:56.397871 14381 tablet_bootstrap.cc:492] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
W20260709 13:18:56.407749 14077 consensus_peers.cc:597] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:56.408479 14077 leader_election.cc:304] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:56.409297 14616 raft_consensus.cc:2804] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:56.409669 14616 raft_consensus.cc:493] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.410010 14616 raft_consensus.cc:3060] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.412940 14381 tablet_bootstrap.cc:654] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:56.413064 14151 consensus_peers.cc:597] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:56.406790 14621 raft_consensus.cc:2749] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:56.428644 14383 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:56.429141 14383 ts_tablet_manager.cc:1403] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.137s	user 0.008s	sys 0.021s
I20260709 13:18:56.441918 14382 tablet_bootstrap.cc:492] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:56.442484 14382 ts_tablet_manager.cc:1403] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.011s
I20260709 13:18:56.445269 14382 raft_consensus.cc:359] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.446566 14382 raft_consensus.cc:385] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.446833 14382 raft_consensus.cc:740] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.447420 14382 consensus_queue.cc:260] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.450456 14610 consensus_queue.cc:1048] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:56.453495 14382 ts_tablet_manager.cc:1434] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:18:56.454489 14382 tablet_bootstrap.cc:492] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:56.457767 14616 raft_consensus.cc:515] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.459897 14616 leader_election.cc:290] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:56.462051 14382 tablet_bootstrap.cc:654] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.471418 14384 tablet_bootstrap.cc:654] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.469772 14009 catalog_manager.cc:5697] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.472956 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:56.473554 14183 raft_consensus.cc:3060] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.476929 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:56.487685 14183 raft_consensus.cc:2468] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:56.492844 14077 leader_election.cc:304] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:56.494515 14621 raft_consensus.cc:2804] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.495024 14621 raft_consensus.cc:697] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:56.496729 14587 consensus_queue.cc:1048] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:56.498405 14621 consensus_queue.cc:237] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.502825 14383 raft_consensus.cc:359] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.511893 14463 consensus_queue.cc:1048] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:56.514930 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:56.504853 14383 raft_consensus.cc:385] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.515795 14383 raft_consensus.cc:740] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.516670 14383 consensus_queue.cc:260] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.519682 14383 ts_tablet_manager.cc:1434] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.001s
I20260709 13:18:56.520816 14383 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:18:56.521106 14077 leader_election.cc:343] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.523995 14654 raft_consensus.cc:493] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.524673 14654 raft_consensus.cc:515] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
W20260709 13:18:56.525900 14077 leader_election.cc:343] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.527148 14654 leader_election.cc:290] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:56.527830 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa413bb6214043609003b441decca56f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
W20260709 13:18:56.529629 14227 leader_election.cc:343] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.534595 14383 tablet_bootstrap.cc:654] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.535961 14587 raft_consensus.cc:493] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.536501 14587 raft_consensus.cc:515] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.543540 14587 leader_election.cc:290] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:56.544812 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:56.545734 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:56.546201 14299 leader_election.cc:343] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:56.547957 14300 leader_election.cc:343] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.548491 14300 leader_election.cc:304] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.549780 14609 raft_consensus.cc:2749] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:56.552012 14422 raft_consensus.cc:493] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.552563 14422 raft_consensus.cc:515] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.554687 14422 leader_election.cc:290] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:56.557511 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b052613656f42f19ebcb9c59686e9a3" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:56.559085 14151 leader_election.cc:343] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.566973 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b052613656f42f19ebcb9c59686e9a3" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:56.568707 14383 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:56.569247 14383 ts_tablet_manager.cc:1403] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.002s
W20260709 13:18:56.570509 14152 leader_election.cc:343] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.571012 14152 leader_election.cc:304] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.572592 14599 raft_consensus.cc:2749] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:56.574499 14383 raft_consensus.cc:359] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.575317 14383 raft_consensus.cc:385] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.575827 14383 raft_consensus.cc:740] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.576617 14383 consensus_queue.cc:260] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.578439 14383 ts_tablet_manager.cc:1434] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:56.579349 14383 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:56.582861 14382 tablet_bootstrap.cc:492] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:56.583380 14382 ts_tablet_manager.cc:1403] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.129s	user 0.007s	sys 0.011s
I20260709 13:18:56.586861 14381 tablet_bootstrap.cc:492] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:56.587396 14381 ts_tablet_manager.cc:1403] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.190s	user 0.008s	sys 0.004s
I20260709 13:18:56.600857 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa413bb6214043609003b441decca56f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:56.601626 14110 raft_consensus.cc:2468] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:56.603219 14599 consensus_queue.cc:1048] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:56.603919 14152 consensus_peers.cc:597] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:56.606982 14609 raft_consensus.cc:493] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.607566 14609 raft_consensus.cc:515] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.604610 14381 raft_consensus.cc:359] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.608703 14381 raft_consensus.cc:385] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.609012 14381 raft_consensus.cc:740] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.609752 14609 leader_election.cc:290] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:56.611275 14383 tablet_bootstrap.cc:654] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.612766 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:56.613018 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:56.614408 14300 leader_election.cc:343] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.615253 14384 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:56.615775 14384 ts_tablet_manager.cc:1403] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.244s	user 0.013s	sys 0.008s
I20260709 13:18:56.618438 14384 raft_consensus.cc:359] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.619102 14384 raft_consensus.cc:385] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.619401 14384 raft_consensus.cc:740] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.619614 14225 leader_election.cc:304] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215
I20260709 13:18:56.620467 14654 raft_consensus.cc:2804] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:56.620831 14654 raft_consensus.cc:493] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.621160 14654 raft_consensus.cc:3060] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.609710 14381 consensus_queue.cc:260] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.628176 14186 raft_consensus.cc:2468] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:56.627358 14009 catalog_manager.cc:5697] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.631640 14300 leader_election.cc:304] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.632817 14609 raft_consensus.cc:2804] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:56.633220 14609 raft_consensus.cc:493] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.633571 14609 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.635450 14654 raft_consensus.cc:515] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.645545 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa413bb6214043609003b441decca56f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
W20260709 13:18:56.647229 14227 leader_election.cc:343] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.645558 14381 ts_tablet_manager.cc:1434] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.003s
I20260709 13:18:56.649812 14381 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:56.644549 14382 raft_consensus.cc:359] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.653373 14382 raft_consensus.cc:385] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.653718 14382 raft_consensus.cc:740] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.653934 14609 raft_consensus.cc:515] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.654567 14382 consensus_queue.cc:260] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
W20260709 13:18:56.658700 14077 consensus_peers.cc:597] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:56.666442 14382 ts_tablet_manager.cc:1434] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 13:18:56.666877 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa413bb6214043609003b441decca56f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:56.664760 14654 leader_election.cc:290] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:56.667472 14110 raft_consensus.cc:3060] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.670750 14382 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:56.674782 14110 raft_consensus.cc:2468] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:56.675967 14381 tablet_bootstrap.cc:654] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.656983 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:56.676895 14186 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.679857 14382 tablet_bootstrap.cc:654] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.680747 14225 leader_election.cc:304] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215
I20260709 13:18:56.681579 14654 raft_consensus.cc:2804] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.682085 14654 raft_consensus.cc:697] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:18:56.682879 14654 consensus_queue.cc:237] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.688768 14384 consensus_queue.cc:260] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.689893 14383 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:56.690402 14383 ts_tablet_manager.cc:1403] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.010s
I20260709 13:18:56.693076 14383 raft_consensus.cc:359] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.693800 14383 raft_consensus.cc:385] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.694047 14383 raft_consensus.cc:740] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.694818 14383 consensus_queue.cc:260] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.696261 14186 raft_consensus.cc:2468] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:56.697211 14383 ts_tablet_manager.cc:1434] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:18:56.697886 14300 leader_election.cc:304] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:56.698341 14616 consensus_queue.cc:1048] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:56.698848 14625 raft_consensus.cc:2804] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.699404 14625 raft_consensus.cc:697] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:56.700306 14625 consensus_queue.cc:237] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.702888 14616 raft_consensus.cc:493] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.703251 14616 raft_consensus.cc:515] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.705238 14616 leader_election.cc:290] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:56.698179 14383 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:56.696791 14384 ts_tablet_manager.cc:1434] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.002s
I20260709 13:18:56.707433 14384 tablet_bootstrap.cc:492] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:56.709367 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:56.709944 14609 leader_election.cc:290] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:56.710352 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:56.710984 14259 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.711807 14383 tablet_bootstrap.cc:654] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:56.712087 14077 leader_election.cc:343] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.715308 14384 tablet_bootstrap.cc:654] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.715484 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:56.721691 14333 raft_consensus.cc:2468] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:56.722921 14078 leader_election.cc:304] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.724102 14616 raft_consensus.cc:2804] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:56.724484 14616 raft_consensus.cc:493] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.724821 14616 raft_consensus.cc:3060] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.728905 14381 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:56.729383 14381 ts_tablet_manager.cc:1403] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 13:18:56.730310 14383 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:56.730752 14383 ts_tablet_manager.cc:1403] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:18:56.731962 14381 raft_consensus.cc:359] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.734294 14384 tablet_bootstrap.cc:492] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:56.742606 14381 raft_consensus.cc:385] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.732116 14259 raft_consensus.cc:2468] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:56.743312 14381 raft_consensus.cc:740] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.732385 14621 raft_consensus.cc:493] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.744351 14381 consensus_queue.cc:260] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.744927 14621 raft_consensus.cc:515] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.748490 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:56.749118 14333 raft_consensus.cc:2468] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:56.749500 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:56.750348 14078 leader_election.cc:304] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
W20260709 13:18:56.751155 14077 leader_election.cc:343] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.751185 14622 raft_consensus.cc:2804] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:56.751806 14621 leader_election.cc:290] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:56.752017 14622 raft_consensus.cc:493] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.743268 14384 ts_tablet_manager.cc:1403] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.012s
I20260709 13:18:56.752564 14622 raft_consensus.cc:3060] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.752301 14006 catalog_manager.cc:5697] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.755203 14384 raft_consensus.cc:359] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.763993 14384 raft_consensus.cc:385] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.771957 14381 ts_tablet_manager.cc:1434] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.002s
I20260709 13:18:56.764528 14384 raft_consensus.cc:740] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.724916 14008 catalog_manager.cc:5697] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.775991 14384 consensus_queue.cc:260] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.761439 14616 raft_consensus.cc:515] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.770843 14622 raft_consensus.cc:515] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.784986 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:56.785183 14110 raft_consensus.cc:3060] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.785624 14333 raft_consensus.cc:3060] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.792141 14384 ts_tablet_manager.cc:1434] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:18:56.793239 14384 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:56.794762 14616 leader_election.cc:290] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:56.795094 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
W20260709 13:18:56.796633 14077 leader_election.cc:343] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:56.798344 14671 log.cc:927] Time spent T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:18:56.803045 14668 consensus_queue.cc:1048] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:56.804430 14333 raft_consensus.cc:2468] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:56.806622 14078 leader_election.cc:304] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.807468 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:56.808106 14624 raft_consensus.cc:2804] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.808818 14624 raft_consensus.cc:697] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:56.809752 14624 consensus_queue.cc:237] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.824260 14382 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:56.824828 14382 ts_tablet_manager.cc:1403] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.158s	user 0.008s	sys 0.004s
I20260709 13:18:56.825479 14665 consensus_queue.cc:1048] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:56.827544 14382 raft_consensus.cc:359] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.828265 14382 raft_consensus.cc:385] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.828550 14382 raft_consensus.cc:740] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.829329 14382 consensus_queue.cc:260] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:56.831831 14384 tablet_bootstrap.cc:654] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.763303 14383 raft_consensus.cc:359] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
W20260709 13:18:56.835070 14077 leader_election.cc:343] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.849244 14382 ts_tablet_manager.cc:1434] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:18:56.839636 14381 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:56.853775 14006 catalog_manager.cc:5697] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.840346 14383 raft_consensus.cc:385] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.856484 14383 raft_consensus.cc:740] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.858403 14382 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:56.860392 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:56.861019 14333 raft_consensus.cc:3060] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:56.864997 14382 tablet_bootstrap.cc:654] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.868705 14383 consensus_queue.cc:260] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.871166 14383 ts_tablet_manager.cc:1434] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.000s
I20260709 13:18:56.872416 14384 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:56.872987 14384 ts_tablet_manager.cc:1403] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.000s
I20260709 13:18:56.875560 14384 raft_consensus.cc:359] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.876900 14384 raft_consensus.cc:385] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.877163 14384 raft_consensus.cc:740] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.877959 14384 consensus_queue.cc:260] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.879959 14384 ts_tablet_manager.cc:1434] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:56.880918 14384 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:56.883647 14622 leader_election.cc:290] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:56.887239 14384 tablet_bootstrap.cc:654] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.892320 14382 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:56.893184 14333 raft_consensus.cc:2468] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:56.894898 14078 leader_election.cc:304] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.897066 14621 raft_consensus.cc:2804] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:56.897583 14621 raft_consensus.cc:697] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:56.897902 14382 ts_tablet_manager.cc:1403] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.002s
I20260709 13:18:56.898460 14621 consensus_queue.cc:237] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.902503 14382 raft_consensus.cc:359] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.903249 14382 raft_consensus.cc:385] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.903519 14382 raft_consensus.cc:740] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.904312 14382 consensus_queue.cc:260] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.908226 14383 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:18:56.910392 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:56.910913 14382 ts_tablet_manager.cc:1434] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:18:56.919831 14382 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:56.913811 14381 tablet_bootstrap.cc:654] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.913568 14384 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:56.926702 14384 ts_tablet_manager.cc:1403] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.046s	user 0.005s	sys 0.005s
I20260709 13:18:56.929113 14384 raft_consensus.cc:359] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.929785 14384 raft_consensus.cc:385] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.930063 14384 raft_consensus.cc:740] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.930857 14384 consensus_queue.cc:260] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:56.934183 14381 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:56.935591 14381 ts_tablet_manager.cc:1403] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.000s
I20260709 13:18:56.934288 14624 consensus_queue.cc:1048] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:56.938424 14381 raft_consensus.cc:359] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.939141 14381 raft_consensus.cc:385] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:56.939488 14381 raft_consensus.cc:740] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:56.940204 14381 consensus_queue.cc:260] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.935105 14382 tablet_bootstrap.cc:654] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.943295 14381 ts_tablet_manager.cc:1434] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:56.944329 14381 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:56.944844 14625 raft_consensus.cc:493] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.945353 14625 raft_consensus.cc:515] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.947535 14625 leader_election.cc:290] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:56.950464 14381 tablet_bootstrap.cc:654] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.950600 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:56.952224 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:56.954241 14300 leader_election.cc:343] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:56.957688 14300 leader_election.cc:343] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.958249 14300 leader_election.cc:304] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:56.956723 14648 raft_consensus.cc:493] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.960695 14648 raft_consensus.cc:515] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:56.961122 14501 raft_consensus.cc:2749] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:56.962845 14384 ts_tablet_manager.cc:1434] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:18:56.962922 14648 leader_election.cc:290] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:56.964185 14384 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:56.967445 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a68e63a39ca44319695c6f4e9937912" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:56.968159 14333 raft_consensus.cc:2468] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:56.969758 14006 catalog_manager.cc:5697] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.971513 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a68e63a39ca44319695c6f4e9937912" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:56.973570 14077 consensus_peers.cc:597] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:56.973691 14226 leader_election.cc:343] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:56.977411 14227 leader_election.cc:304] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:56.987828 14587 raft_consensus.cc:493] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.988602 14587 raft_consensus.cc:515] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:56.991264 14587 leader_election.cc:290] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:56.995639 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183a076c0e614a54b0a8875f351528a3" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:56.996327 14384 tablet_bootstrap.cc:654] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:56.996614 14110 raft_consensus.cc:2468] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:57.000234 14665 raft_consensus.cc:493] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.000912 14665 raft_consensus.cc:515] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.004277 14665 leader_election.cc:290] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:57.005786 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:57.010049 14151 leader_election.cc:343] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.010301 14299 leader_election.cc:304] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:57.012365 14625 raft_consensus.cc:2804] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:57.012781 14625 raft_consensus.cc:493] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.013121 14625 raft_consensus.cc:3060] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.015689 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:57.016388 14333 raft_consensus.cc:2468] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:56.986112 14648 raft_consensus.cc:2804] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:57.018489 14648 raft_consensus.cc:493] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.019169 14648 raft_consensus.cc:3060] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.021600 14153 leader_election.cc:304] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:57.022876 14665 raft_consensus.cc:2804] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:57.023290 14665 raft_consensus.cc:493] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.023625 14665 raft_consensus.cc:3060] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.033857 14383 tablet_bootstrap.cc:654] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.035383 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183a076c0e614a54b0a8875f351528a3" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:57.039851 14382 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:57.040584 14382 ts_tablet_manager.cc:1403] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.009s
I20260709 13:18:57.044024 14381 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:57.044562 14381 ts_tablet_manager.cc:1403] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.100s	user 0.031s	sys 0.018s
I20260709 13:18:57.046447 14648 raft_consensus.cc:515] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.066982 14648 leader_election.cc:290] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:57.068135 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a68e63a39ca44319695c6f4e9937912" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
W20260709 13:18:57.069988 14226 leader_election.cc:343] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.047255 14381 raft_consensus.cc:359] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.072769 14381 raft_consensus.cc:385] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.073153 14381 raft_consensus.cc:740] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.058363 14665 raft_consensus.cc:515] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
W20260709 13:18:57.054733 14300 leader_election.cc:343] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.075043 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a68e63a39ca44319695c6f4e9937912" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:57.075791 14335 raft_consensus.cc:3060] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.081909 14186 raft_consensus.cc:3060] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.083690 14381 consensus_queue.cc:260] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.088835 14381 ts_tablet_manager.cc:1434] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.000s
I20260709 13:18:57.089615 14381 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:57.092752 14665 leader_election.cc:290] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:57.102559 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:57.103348 14333 raft_consensus.cc:3060] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.103721 14381 tablet_bootstrap.cc:654] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.111315 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:57.116240 14384 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:57.116966 14384 ts_tablet_manager.cc:1403] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.153s	user 0.036s	sys 0.020s
I20260709 13:18:57.117017 14335 raft_consensus.cc:2468] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:57.118368 14227 leader_election.cc:304] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:57.119565 14648 raft_consensus.cc:2804] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:57.120512 14151 leader_election.cc:343] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.121381 14383 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:57.121798 14382 raft_consensus.cc:359] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.124873 14382 raft_consensus.cc:385] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.125027 14383 ts_tablet_manager.cc:1403] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.253s	user 0.028s	sys 0.008s
I20260709 13:18:57.125161 14382 raft_consensus.cc:740] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.122475 14384 raft_consensus.cc:359] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.122886 14333 raft_consensus.cc:2468] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:57.104467 14625 raft_consensus.cc:515] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.126516 14384 raft_consensus.cc:385] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.125927 14382 consensus_queue.cc:260] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.127395 14384 raft_consensus.cc:740] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.131510 14383 raft_consensus.cc:359] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.132565 14383 raft_consensus.cc:385] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.132967 14383 raft_consensus.cc:740] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.135716 14383 consensus_queue.cc:260] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.124017 14648 raft_consensus.cc:697] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:18:57.140014 14153 leader_election.cc:304] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:57.140998 14463 raft_consensus.cc:2804] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:57.141479 14463 raft_consensus.cc:697] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:57.141556 14648 consensus_queue.cc:237] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.142305 14463 consensus_queue.cc:237] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.145035 14384 consensus_queue.cc:260] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.148972 14625 leader_election.cc:290] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:57.148878 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183a076c0e614a54b0a8875f351528a3" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:57.149657 14110 raft_consensus.cc:3060] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.151202 14384 ts_tablet_manager.cc:1434] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:18:57.152256 14384 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:57.153875 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183a076c0e614a54b0a8875f351528a3" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:57.154505 14187 raft_consensus.cc:3060] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.166570 14381 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:57.167124 14381 ts_tablet_manager.cc:1403] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.015s
I20260709 13:18:57.167361 14384 tablet_bootstrap.cc:654] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.169754 14110 raft_consensus.cc:2468] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:57.173115 14187 raft_consensus.cc:2468] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:57.175275 14383 ts_tablet_manager.cc:1434] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:18:57.180083 14383 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:57.181167 14382 ts_tablet_manager.cc:1434] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.140s	user 0.014s	sys 0.007s
I20260709 13:18:57.182042 14382 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:57.186148 14381 raft_consensus.cc:359] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.186846 14381 raft_consensus.cc:385] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.187201 14381 raft_consensus.cc:740] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.187830 14381 consensus_queue.cc:260] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.193953 14381 ts_tablet_manager.cc:1434] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:18:57.194548 14259 raft_consensus.cc:3060] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.194846 14381 tablet_bootstrap.cc:492] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:57.201269 14381 tablet_bootstrap.cc:654] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:57.204231 14077 consensus_peers.cc:597] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:57.182873 14299 leader_election.cc:304] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
W20260709 13:18:57.222311 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 46009.2us
I20260709 13:18:57.221319 14008 catalog_manager.cc:5697] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:57.222400 14587 raft_consensus.cc:2804] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:57.228722 14501 raft_consensus.cc:493] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.243896 14501 raft_consensus.cc:515] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.245975 14501 leader_election.cc:290] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:18:57.249094 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 59017.1us
I20260709 13:18:57.231876 14587 raft_consensus.cc:697] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:57.252282 14587 consensus_queue.cc:237] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.254873 14383 tablet_bootstrap.cc:654] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.255323 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa413bb6214043609003b441decca56f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:57.261092 14384 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:57.261827 14384 ts_tablet_manager.cc:1403] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.008s
I20260709 13:18:57.264187 14691 consensus_queue.cc:1048] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:57.267277 14333 raft_consensus.cc:3060] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.267442 14382 tablet_bootstrap.cc:654] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.271822 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa413bb6214043609003b441decca56f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:57.276391 14300 leader_election.cc:304] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:57.280452 14625 consensus_queue.cc:1048] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:57.303323 14384 raft_consensus.cc:359] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.304428 14384 raft_consensus.cc:385] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.304773 14384 raft_consensus.cc:740] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.310554 14381 tablet_bootstrap.cc:492] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:57.311148 14381 ts_tablet_manager.cc:1403] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.019s
I20260709 13:18:57.305606 14384 consensus_queue.cc:260] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.324568 14381 raft_consensus.cc:359] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.325196 14691 raft_consensus.cc:493] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.325502 14381 raft_consensus.cc:385] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.325810 14381 raft_consensus.cc:740] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.331111 14381 consensus_queue.cc:260] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.333024 14381 ts_tablet_manager.cc:1434] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:18:57.333921 14381 tablet_bootstrap.cc:492] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:57.336404 14257 raft_consensus.cc:3060] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.336870 14624 consensus_queue.cc:1048] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:57.340356 14691 raft_consensus.cc:515] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.342754 14691 leader_election.cc:290] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:57.340160 14624 consensus_queue.cc:1048] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:57.346338 14006 catalog_manager.cc:5697] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:57.349225 14609 raft_consensus.cc:2749] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:57.350450 14186 raft_consensus.cc:3060] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.352927 14691 consensus_queue.cc:1048] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:57.354818 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b052613656f42f19ebcb9c59686e9a3" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:57.355571 14187 raft_consensus.cc:2468] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:57.358970 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b052613656f42f19ebcb9c59686e9a3" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:57.361130 14226 leader_election.cc:304] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:57.362812 14691 raft_consensus.cc:2804] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:57.363451 14225 leader_election.cc:343] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.364382 14382 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:57.364966 14382 ts_tablet_manager.cc:1403] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.183s	user 0.021s	sys 0.012s
I20260709 13:18:57.363164 14691 raft_consensus.cc:493] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.368489 14691 raft_consensus.cc:3060] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.376430 14382 raft_consensus.cc:359] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.377529 14382 raft_consensus.cc:385] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.377930 14382 raft_consensus.cc:740] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.380971 14384 ts_tablet_manager.cc:1434] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.119s	user 0.016s	sys 0.008s
I20260709 13:18:57.359835 14008 catalog_manager.cc:5697] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:57.382302 14384 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:57.378897 14382 consensus_queue.cc:260] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.400285 14382 ts_tablet_manager.cc:1434] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:18:57.401752 14382 tablet_bootstrap.cc:492] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:57.391260 14648 raft_consensus.cc:493] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.358462 14587 consensus_queue.cc:1048] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:18:57.412122 14383 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:57.416633 14383 ts_tablet_manager.cc:1403] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.240s	user 0.015s	sys 0.014s
I20260709 13:18:57.412278 14648 raft_consensus.cc:515] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.402130 14621 consensus_queue.cc:1048] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:18:57.422152 14501 raft_consensus.cc:493] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.430843 14501 raft_consensus.cc:515] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.432719 14383 raft_consensus.cc:359] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.433802 14383 raft_consensus.cc:385] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.434083 14383 raft_consensus.cc:740] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.422628 14606 raft_consensus.cc:493] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.434718 14383 consensus_queue.cc:260] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.440377 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:57.432921 14501 leader_election.cc:290] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:57.446555 14383 ts_tablet_manager.cc:1434] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:18:57.447569 14383 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:57.443066 14606 raft_consensus.cc:515] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.451891 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:57.460593 14381 tablet_bootstrap.cc:654] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.463712 14606 leader_election.cc:290] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:57.474339 14382 tablet_bootstrap.cc:654] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.493206 14712 raft_consensus.cc:493] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.496906 14712 raft_consensus.cc:515] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.512244 14712 leader_election.cc:290] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
W20260709 13:18:57.512625 14077 leader_election.cc:343] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.494072 14691 raft_consensus.cc:515] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.515030 14691 leader_election.cc:290] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:57.507050 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:57.529066 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:57.533679 14299 leader_election.cc:343] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.548556 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b052613656f42f19ebcb9c59686e9a3" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:57.549233 14183 raft_consensus.cc:3060] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:57.551895 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b052613656f42f19ebcb9c59686e9a3" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:57.552452 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:57.553411 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:57.556820 14381 tablet_bootstrap.cc:492] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:57.557427 14381 ts_tablet_manager.cc:1403] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.224s	user 0.032s	sys 0.030s
I20260709 13:18:57.564678 14384 tablet_bootstrap.cc:654] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:57.559799 14300 leader_election.cc:343] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.604547 14300 leader_election.cc:304] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
W20260709 13:18:57.605779 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 58014.5us
I20260709 13:18:57.606891 14501 raft_consensus.cc:2749] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:57.608747 14151 consensus_peers.cc:597] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:57.615422 14226 consensus_peers.cc:597] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:57.623054 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:57.635449 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:57.635421 14078 leader_election.cc:343] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.586706 14382 tablet_bootstrap.cc:492] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:57.668639 14382 ts_tablet_manager.cc:1403] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.267s	user 0.014s	sys 0.004s
I20260709 13:18:57.668462 14078 leader_election.cc:304] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:57.670980 14622 raft_consensus.cc:2749] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:57.598165 14383 tablet_bootstrap.cc:654] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:57.599563 14225 leader_election.cc:343] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:57.672977 14225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 73467.8us
I20260709 13:18:57.674520 14225 leader_election.cc:304] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:57.675885 14691 raft_consensus.cc:2749] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:57.676991 14225 leader_election.cc:304] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:57.562842 14648 leader_election.cc:290] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:18:57.639724 14708 log.cc:927] Time spent T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:57.575181 14183 raft_consensus.cc:2468] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:57.683342 14226 leader_election.cc:304] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:57.683636 14648 raft_consensus.cc:2749] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:57.684520 14648 raft_consensus.cc:2804] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:57.685289 14648 raft_consensus.cc:697] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:18:57.686100 14648 consensus_queue.cc:237] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.671535 14382 raft_consensus.cc:359] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.688349 14382 raft_consensus.cc:385] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.688666 14382 raft_consensus.cc:740] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.689347 14382 consensus_queue.cc:260] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.691169 14382 ts_tablet_manager.cc:1434] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:18:57.692131 14382 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:57.583246 14381 raft_consensus.cc:359] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.697793 14381 raft_consensus.cc:385] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.698181 14381 raft_consensus.cc:740] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.700273 14381 consensus_queue.cc:260] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.714771 14381 ts_tablet_manager.cc:1434] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.003s
I20260709 13:18:57.716600 14381 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:57.721052 14710 raft_consensus.cc:493] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.762073 14691 consensus_queue.cc:1048] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:57.769938 14383 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:57.770808 14383 ts_tablet_manager.cc:1403] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.323s	user 0.011s	sys 0.018s
I20260709 13:18:57.774410 14383 raft_consensus.cc:359] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.775892 14383 raft_consensus.cc:385] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.776271 14383 raft_consensus.cc:740] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.756445 14599 consensus_queue.cc:1048] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:18:57.776930 14383 consensus_queue.cc:260] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:57.755169 14710 raft_consensus.cc:515] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.841547 14381 tablet_bootstrap.cc:654] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.761782 14587 raft_consensus.cc:493] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.854866 14382 tablet_bootstrap.cc:654] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:57.864283 14599 raft_consensus.cc:493] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.865891 14383 ts_tablet_manager.cc:1434] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.095s	user 0.018s	sys 0.010s
I20260709 13:18:57.867236 14383 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:57.820700 14621 raft_consensus.cc:493] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:57.841043 14077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 113840us
I20260709 13:18:57.876540 14621 raft_consensus.cc:515] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.865576 14587 raft_consensus.cc:515] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:57.901098 14621 leader_election.cc:290] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:57.902449 14587 leader_election.cc:290] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:57.916755 14384 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:57.917464 14384 ts_tablet_manager.cc:1403] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.535s	user 0.018s	sys 0.015s
I20260709 13:18:57.925563 14384 raft_consensus.cc:359] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.926360 14384 raft_consensus.cc:385] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:57.926743 14384 raft_consensus.cc:740] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:57.921756 14463 raft_consensus.cc:493] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.928387 14463 raft_consensus.cc:515] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.928311 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c732e8e709f497eaee427bcad377540" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:57.930589 14463 leader_election.cc:290] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:57.943006 14384 consensus_queue.cc:260] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:57.873229 14599 raft_consensus.cc:515] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:57.953423 14384 ts_tablet_manager.cc:1434] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.004s
I20260709 13:18:57.968536 14710 leader_election.cc:290] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:57.977154 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:57.977902 14330 raft_consensus.cc:2468] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:57.993410 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183f0c224f074c99903307d0678a8ccf" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:57.995303 14226 leader_election.cc:343] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:57.997390 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95255a6465943e199a2aa0b7601bf32" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:58.002579 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:58.012904 14153 leader_election.cc:304] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:58.014058 14463 raft_consensus.cc:2804] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:58.014463 14463 raft_consensus.cc:493] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.014811 14463 raft_consensus.cc:3060] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:58.018453 14152 leader_election.cc:343] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:57.999394 14077 leader_election.cc:343] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:58.038164 14078 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 341350us
W20260709 13:18:58.027552 14299 leader_election.cc:343] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:58.027189 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 153272us
I20260709 13:18:58.042448 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183f0c224f074c99903307d0678a8ccf" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:58.038187 14463 raft_consensus.cc:515] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.055192 14381 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:58.055639 14381 ts_tablet_manager.cc:1403] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.340s	user 0.014s	sys 0.019s
W20260709 13:18:58.053181 14227 leader_election.cc:343] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.086515 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a68e63a39ca44319695c6f4e9937912" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:58.054663 14720 consensus_queue.cc:1048] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:18:58.093098 14382 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:58.093648 14382 ts_tablet_manager.cc:1403] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.402s	user 0.024s	sys 0.012s
I20260709 13:18:58.098145 14384 tablet_bootstrap.cc:492] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:58.099712 14383 tablet_bootstrap.cc:654] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.088117 14599 leader_election.cc:290] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:58.104305 14384 tablet_bootstrap.cc:654] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.106036 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95255a6465943e199a2aa0b7601bf32" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:58.108569 14587 raft_consensus.cc:493] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.108953 14382 raft_consensus.cc:359] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.109118 14587 raft_consensus.cc:515] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.109724 14382 raft_consensus.cc:385] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.110105 14382 raft_consensus.cc:740] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.111284 14587 leader_election.cc:290] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:58.110925 14382 consensus_queue.cc:260] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:18:58.115830 14300 leader_election.cc:343] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.091745 14227 leader_election.cc:304] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:58.116014 14006 catalog_manager.cc:5697] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.117735 14654 raft_consensus.cc:2749] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.116325 14300 leader_election.cc:304] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:58.115551 14381 raft_consensus.cc:359] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.119870 14381 raft_consensus.cc:385] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.120278 14381 raft_consensus.cc:740] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.121017 14382 ts_tablet_manager.cc:1434] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
W20260709 13:18:58.118635 14227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 66367us
I20260709 13:18:58.122437 14382 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:58.140823 14381 consensus_queue.cc:260] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.124418 14609 raft_consensus.cc:2749] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.161340 14258 raft_consensus.cc:3060] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:58.162881 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:58.179082 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:58.197628 14151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 47607.8us
I20260709 13:18:58.201212 14381 ts_tablet_manager.cc:1434] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.145s	user 0.007s	sys 0.000s
I20260709 13:18:58.197794 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:18:58.203269 14299 leader_election.cc:343] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.205405 14609 consensus_queue.cc:1048] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:58.211827 14381 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:58.214030 14463 leader_election.cc:290] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
W20260709 13:18:58.217056 14300 leader_election.cc:343] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.217669 14300 leader_election.cc:304] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:58.218932 14587 raft_consensus.cc:2749] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.222673 14710 consensus_queue.cc:1048] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:58.224437 14381 tablet_bootstrap.cc:654] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.254158 14384 tablet_bootstrap.cc:492] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:58.254822 14384 ts_tablet_manager.cc:1403] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.157s	user 0.007s	sys 0.018s
I20260709 13:18:58.259192 14384 raft_consensus.cc:359] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.267623 14384 raft_consensus.cc:385] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.268409 14384 raft_consensus.cc:740] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.269292 14384 consensus_queue.cc:260] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.293087 14384 ts_tablet_manager.cc:1434] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 13:18:58.294433 14384 tablet_bootstrap.cc:492] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:58.299774 14382 tablet_bootstrap.cc:654] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.314687 14383 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:58.316514 14383 ts_tablet_manager.cc:1403] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.450s	user 0.013s	sys 0.018s
I20260709 13:18:58.328276 14381 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:58.329030 14381 ts_tablet_manager.cc:1403] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.018s
I20260709 13:18:58.339619 14384 tablet_bootstrap.cc:654] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.350391 14383 raft_consensus.cc:359] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.351485 14383 raft_consensus.cc:385] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.351851 14383 raft_consensus.cc:740] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.352607 14383 consensus_queue.cc:260] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.355166 14383 ts_tablet_manager.cc:1434] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:18:58.363000 14383 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:58.369249 14702 raft_consensus.cc:493] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.378114 14702 raft_consensus.cc:515] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.382257 14187 raft_consensus.cc:3060] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.382653 14381 raft_consensus.cc:359] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.383373 14381 raft_consensus.cc:385] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.383625 14381 raft_consensus.cc:740] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.385915 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c732e8e709f497eaee427bcad377540" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:58.392117 14702 leader_election.cc:290] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:58.392508 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183f0c224f074c99903307d0678a8ccf" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:58.393992 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183f0c224f074c99903307d0678a8ccf" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:58.394667 14253 raft_consensus.cc:2468] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
W20260709 13:18:58.395247 14300 leader_election.cc:343] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.396993 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a68e63a39ca44319695c6f4e9937912" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:58.400585 14300 leader_election.cc:304] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:58.401901 14609 raft_consensus.cc:2804] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:58.402271 14609 raft_consensus.cc:493] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.402586 14609 raft_consensus.cc:3060] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.412967 14384 tablet_bootstrap.cc:492] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:58.413682 14384 ts_tablet_manager.cc:1403] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.008s
I20260709 13:18:58.414702 14381 consensus_queue.cc:260] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.410717 14712 raft_consensus.cc:493] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.446214 14381 ts_tablet_manager.cc:1434] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.117s	user 0.002s	sys 0.005s
I20260709 13:18:58.452369 14381 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:58.436697 14712 raft_consensus.cc:515] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.440102 14733 raft_consensus.cc:493] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.458547 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:58.487440 14383 tablet_bootstrap.cc:654] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.489001 14381 tablet_bootstrap.cc:654] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.491051 14335 raft_consensus.cc:3060] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.480957 14733 raft_consensus.cc:515] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.493155 14733 leader_election.cc:290] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:58.494771 14384 raft_consensus.cc:359] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.495445 14384 raft_consensus.cc:385] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.495693 14384 raft_consensus.cc:740] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.491113 14712 leader_election.cc:290] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
W20260709 13:18:58.502054 14225 consensus_peers.cc:597] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:58.504429 14384 consensus_queue.cc:260] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.506179 14382 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:58.506840 14382 ts_tablet_manager.cc:1403] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.385s	user 0.014s	sys 0.008s
I20260709 13:18:58.508605 14384 ts_tablet_manager.cc:1434] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.000s
I20260709 13:18:58.508443 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9aa82f67f724a9789d4486481fc7f6a" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:58.509541 14108 raft_consensus.cc:2468] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:58.510478 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9aa82f67f724a9789d4486481fc7f6a" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:58.505677 14609 raft_consensus.cc:515] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.513895 14609 leader_election.cc:290] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
W20260709 13:18:58.517004 14226 leader_election.cc:343] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.522315 14153 leader_election.cc:304] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:58.523463 14225 leader_election.cc:304] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:58.525839 14654 raft_consensus.cc:2804] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:58.526264 14654 raft_consensus.cc:493] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.526619 14654 raft_consensus.cc:3060] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.526839 14382 raft_consensus.cc:359] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:58.527666 14382 raft_consensus.cc:385] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.527972 14382 raft_consensus.cc:740] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.528373 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183f0c224f074c99903307d0678a8ccf" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
W20260709 13:18:58.541611 14078 leader_election.cc:343] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.542107 14078 leader_election.cc:304] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:58.543031 14756 raft_consensus.cc:2749] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.532536 14382 consensus_queue.cc:260] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:58.554760 14384 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:58.561725 14382 ts_tablet_manager.cc:1434] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 13:18:58.563055 14382 tablet_bootstrap.cc:492] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
W20260709 13:18:58.564128 14300 leader_election.cc:343] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.551120 14712 raft_consensus.cc:493] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.548242 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 129865us
I20260709 13:18:58.587078 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:58.570604 14712 raft_consensus.cc:515] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:58.593251 14383 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:58.593842 14383 ts_tablet_manager.cc:1403] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.231s	user 0.015s	sys 0.016s
I20260709 13:18:58.593945 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:58.599843 14254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183f0c224f074c99903307d0678a8ccf" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:58.601176 14254 raft_consensus.cc:3060] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:58.601862 14152 leader_election.cc:343] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.604748 14732 raft_consensus.cc:493] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.605001 14383 raft_consensus.cc:359] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.605316 14732 raft_consensus.cc:515] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.605780 14383 raft_consensus.cc:385] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.606281 14383 raft_consensus.cc:740] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.607101 14383 consensus_queue.cc:260] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.609628 14383 ts_tablet_manager.cc:1434] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:18:58.612093 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71afc145d3844248a07bbf2114fbd5f" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:58.613726 14151 leader_election.cc:343] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.614540 14732 leader_election.cc:290] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:58.606961 14712 leader_election.cc:290] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:58.619081 14383 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:58.620347 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:58.625104 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:58.628031 14335 raft_consensus.cc:2468] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:58.635762 14153 leader_election.cc:304] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:58.639566 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71afc145d3844248a07bbf2114fbd5f" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:58.639801 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:58.642966 14384 tablet_bootstrap.cc:654] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.642964 14077 leader_election.cc:304] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:58.647246 14728 raft_consensus.cc:2749] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.642609 14665 raft_consensus.cc:2749] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.653683 14227 leader_election.cc:304] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:58.654541 14735 raft_consensus.cc:2804] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:58.657389 14654 raft_consensus.cc:515] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.661558 14381 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:58.662037 14381 ts_tablet_manager.cc:1403] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.210s	user 0.036s	sys 0.019s
I20260709 13:18:58.666195 14735 raft_consensus.cc:697] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:58.667114 14735 consensus_queue.cc:237] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.669777 14383 tablet_bootstrap.cc:654] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.670009 14381 raft_consensus.cc:359] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
W20260709 13:18:58.670323 14153 leader_election.cc:343] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.676028 14381 raft_consensus.cc:385] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.676412 14381 raft_consensus.cc:740] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.677101 14381 consensus_queue.cc:260] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.674496 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9aa82f67f724a9789d4486481fc7f6a" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:58.678367 14112 raft_consensus.cc:3060] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.678642 14710 raft_consensus.cc:2749] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.679970 14153 leader_election.cc:304] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:18:58.685178 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9aa82f67f724a9789d4486481fc7f6a" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:58.685891 14654 leader_election.cc:290] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
W20260709 13:18:58.687074 14226 leader_election.cc:343] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.697017 14599 raft_consensus.cc:2749] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.698035 14381 ts_tablet_manager.cc:1434] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:18:58.698494 14463 raft_consensus.cc:493] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.699008 14381 tablet_bootstrap.cc:492] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:58.698951 14463 raft_consensus.cc:515] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.701227 14463 leader_election.cc:290] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:58.702807 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:18:58.708700 14151 leader_election.cc:343] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.710049 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:58.712551 14152 leader_election.cc:343] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.712833 14108 raft_consensus.cc:3060] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.713001 14152 leader_election.cc:304] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:58.713920 14463 raft_consensus.cc:2749] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.714659 14254 raft_consensus.cc:2468] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:58.716171 14300 leader_election.cc:304] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:58.717060 14759 raft_consensus.cc:2804] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:58.717541 14759 raft_consensus.cc:697] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:58.718734 14382 tablet_bootstrap.cc:654] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.718329 14759 consensus_queue.cc:237] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.733235 14112 raft_consensus.cc:2468] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:18:58.735988 14384 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:58.737353 14225 leader_election.cc:304] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c
I20260709 13:18:58.738199 14654 raft_consensus.cc:2804] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:58.738471 14384 ts_tablet_manager.cc:1403] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.184s	user 0.010s	sys 0.005s
I20260709 13:18:58.738713 14654 raft_consensus.cc:697] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:18:58.741010 14734 raft_consensus.cc:493] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.741245 14654 consensus_queue.cc:237] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.741585 14734 raft_consensus.cc:515] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:58.743712 14734 leader_election.cc:290] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:58.746665 14006 catalog_manager.cc:5697] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:58.749883 14381 tablet_bootstrap.cc:654] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.760663 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:58.762588 14254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:18:58.769589 14077 leader_election.cc:343] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:58.770450 14077 leader_election.cc:343] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:58.770882 14077 leader_election.cc:304] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:58.775417 14255 raft_consensus.cc:3060] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.772936 14734 raft_consensus.cc:2749] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:58.799630 14383 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:58.810947 14384 raft_consensus.cc:359] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.825497 14384 raft_consensus.cc:385] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.826058 14384 raft_consensus.cc:740] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.827827 14381 tablet_bootstrap.cc:492] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:58.828351 14381 ts_tablet_manager.cc:1403] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.130s	user 0.007s	sys 0.005s
I20260709 13:18:58.830304 14007 catalog_manager.cc:5697] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.831110 14381 raft_consensus.cc:359] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.831780 14381 raft_consensus.cc:385] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.820457 14383 ts_tablet_manager.cc:1403] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.202s	user 0.020s	sys 0.012s
I20260709 13:18:58.820326 14009 catalog_manager.cc:5697] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:58.832016 14381 raft_consensus.cc:740] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.837291 14383 raft_consensus.cc:359] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:58.840906 14383 raft_consensus.cc:385] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.841204 14383 raft_consensus.cc:740] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.841856 14383 consensus_queue.cc:260] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:58.844259 14381 consensus_queue.cc:260] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.833209 14384 consensus_queue.cc:260] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.853842 14381 ts_tablet_manager.cc:1434] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:18:58.856575 14381 tablet_bootstrap.cc:492] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:58.859186 14384 ts_tablet_manager.cc:1434] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.001s
I20260709 13:18:58.862329 14383 ts_tablet_manager.cc:1434] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:18:58.865351 14383 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:58.873974 14384 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:58.888466 14381 tablet_bootstrap.cc:654] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.897199 14382 tablet_bootstrap.cc:492] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:58.897687 14382 ts_tablet_manager.cc:1403] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.335s	user 0.012s	sys 0.003s
I20260709 13:18:58.900677 14382 raft_consensus.cc:359] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.900969 14759 raft_consensus.cc:493] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.901387 14382 raft_consensus.cc:385] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.901566 14759 raft_consensus.cc:515] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.904834 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c732e8e709f497eaee427bcad377540" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:58.905192 14384 tablet_bootstrap.cc:654] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.905747 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c732e8e709f497eaee427bcad377540" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:58.905782 14108 raft_consensus.cc:2468] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:58.906499 14186 raft_consensus.cc:2468] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:58.908236 14300 leader_election.cc:304] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:58.909148 14702 raft_consensus.cc:2804] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:58.909528 14702 raft_consensus.cc:493] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.909835 14702 raft_consensus.cc:3060] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.901705 14382 raft_consensus.cc:740] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.907580 14759 leader_election.cc:290] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:58.911908 14382 consensus_queue.cc:260] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.911232 14383 tablet_bootstrap.cc:654] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.915763 14381 tablet_bootstrap.cc:492] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:58.916263 14381 ts_tablet_manager.cc:1403] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.003s
I20260709 13:18:58.918794 14381 raft_consensus.cc:359] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.919426 14381 raft_consensus.cc:385] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.919664 14381 raft_consensus.cc:740] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.920233 14381 consensus_queue.cc:260] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.922211 14381 ts_tablet_manager.cc:1434] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:58.923674 14381 tablet_bootstrap.cc:492] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:58.925858 14702 raft_consensus.cc:515] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.933401 14383 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:58.933923 14383 ts_tablet_manager.cc:1403] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.002s
I20260709 13:18:58.934248 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c732e8e709f497eaee427bcad377540" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:58.934870 14108 raft_consensus.cc:3060] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.929214 14381 tablet_bootstrap.cc:654] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.930408 14382 ts_tablet_manager.cc:1434] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:18:58.936000 14382 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:58.942210 14108 raft_consensus.cc:2468] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:58.943423 14299 leader_election.cc:304] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:58.944231 14759 raft_consensus.cc:2804] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:58.944736 14759 raft_consensus.cc:697] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:58.945518 14759 consensus_queue.cc:237] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.947250 14384 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:58.947795 14384 ts_tablet_manager.cc:1403] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.008s
I20260709 13:18:58.950840 14383 raft_consensus.cc:359] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.951604 14383 raft_consensus.cc:385] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.951874 14383 raft_consensus.cc:740] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.953260 14384 raft_consensus.cc:359] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.953924 14384 raft_consensus.cc:385] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.954169 14384 raft_consensus.cc:740] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.954586 14382 tablet_bootstrap.cc:654] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.958942 14384 consensus_queue.cc:260] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.961246 14383 consensus_queue.cc:260] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.969302 14383 ts_tablet_manager.cc:1434] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:18:58.970283 14383 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:58.972949 14702 leader_election.cc:290] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:58.973517 14702 raft_consensus.cc:493] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.973937 14702 raft_consensus.cc:515] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:58.974104 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c732e8e709f497eaee427bcad377540" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:58.974805 14186 raft_consensus.cc:3060] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:58.977327 14381 tablet_bootstrap.cc:492] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:58.977864 14381 ts_tablet_manager.cc:1403] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:18:58.980773 14381 raft_consensus.cc:359] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.981457 14381 raft_consensus.cc:385] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:58.981726 14381 raft_consensus.cc:740] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:58.982968 14384 ts_tablet_manager.cc:1434] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 13:18:58.984019 14384 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:58.988385 14186 raft_consensus.cc:2468] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:58.986189 14381 consensus_queue.cc:260] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:58.991954 14384 tablet_bootstrap.cc:654] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:58.996791 14381 ts_tablet_manager.cc:1434] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:18:59.003403 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71afc145d3844248a07bbf2114fbd5f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:59.004107 14108 raft_consensus.cc:2468] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:59.004352 14381 tablet_bootstrap.cc:492] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:59.005569 14299 leader_election.cc:304] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:59.006420 14625 raft_consensus.cc:493] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.006882 14625 raft_consensus.cc:515] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.008671 14009 catalog_manager.cc:5697] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.009727 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:59.010298 14625 leader_election.cc:290] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:59.010499 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.010972 14728 raft_consensus.cc:493] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.011340 14625 raft_consensus.cc:2804] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.011806 14625 raft_consensus.cc:493] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:59.012060 14300 leader_election.cc:343] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.012290 14625 raft_consensus.cc:3060] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:59.016121 14300 leader_election.cc:343] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.016544 14300 leader_election.cc:304] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:59.017442 14381 tablet_bootstrap.cc:654] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.019376 14384 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:59.000906 14735 raft_consensus.cc:493] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.001757 14382 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:59.020740 14382 ts_tablet_manager.cc:1403] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.003s
I20260709 13:18:59.020872 14735 raft_consensus.cc:515] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.011474 14728 raft_consensus.cc:515] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:58.999711 14383 tablet_bootstrap.cc:654] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.019879 14384 ts_tablet_manager.cc:1403] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.006s
I20260709 13:18:59.021551 14758 raft_consensus.cc:2749] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:59.030349 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183f0c224f074c99903307d0678a8ccf" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.030248 14625 raft_consensus.cc:515] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:59.031369 14257 raft_consensus.cc:2393] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddcb989aef4c9fa869766c3682632c in current term 1: Already voted for candidate 0646b0acb9c943b59389eace852a5215 in this term.
I20260709 13:18:59.037297 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:59.030509 14384 raft_consensus.cc:359] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.040894 14381 tablet_bootstrap.cc:492] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:59.045939 14384 raft_consensus.cc:385] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.046450 14384 raft_consensus.cc:740] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.026428 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.046558 14381 ts_tablet_manager.cc:1403] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.005s
I20260709 13:18:59.027604 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183f0c224f074c99903307d0678a8ccf" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:59.049782 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71afc145d3844248a07bbf2114fbd5f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:59.026818 14702 leader_election.cc:290] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:59.025283 14728 leader_election.cc:290] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:59.047247 14384 consensus_queue.cc:260] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.050629 14153 leader_election.cc:304] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:59.050617 14381 raft_consensus.cc:359] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.051625 14381 raft_consensus.cc:385] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.051771 14732 raft_consensus.cc:3060] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.052033 14381 raft_consensus.cc:740] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.052897 14381 consensus_queue.cc:260] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.053364 14384 ts_tablet_manager.cc:1434] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.004s
I20260709 13:18:59.054369 14384 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:59.055145 14381 ts_tablet_manager.cc:1434] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:59.056082 14381 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:59.023550 14382 raft_consensus.cc:359] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.056984 14382 raft_consensus.cc:385] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.057932 14382 raft_consensus.cc:740] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.058779 14382 consensus_queue.cc:260] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.026515 14735 leader_election.cc:290] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:59.038116 14335 raft_consensus.cc:2468] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:59.050392 14186 raft_consensus.cc:2468] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:59.063625 14382 ts_tablet_manager.cc:1434] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 13:18:59.065246 14255 raft_consensus.cc:2468] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:59.067189 14384 tablet_bootstrap.cc:654] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.074198 14077 leader_election.cc:304] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:59.079147 14382 tablet_bootstrap.cc:492] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:59.078367 14728 raft_consensus.cc:2804] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.086896 14728 raft_consensus.cc:493] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.090617 14728 raft_consensus.cc:3060] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.090647 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71afc145d3844248a07bbf2114fbd5f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:59.091454 14108 raft_consensus.cc:3060] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.110276 14383 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:59.110596 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71afc145d3844248a07bbf2114fbd5f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:18:59.110818 14383 ts_tablet_manager.cc:1403] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.003s
I20260709 13:18:59.122115 14381 tablet_bootstrap.cc:654] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.111253 14185 raft_consensus.cc:3060] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.120575 14759 consensus_queue.cc:1048] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:18:59.117903 14108 raft_consensus.cc:2468] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:59.119994 14697 consensus_queue.cc:1048] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20260709 13:18:59.142316 14382 tablet_bootstrap.cc:654] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.105556 14625 leader_election.cc:290] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:18:59.117154 14732 raft_consensus.cc:2749] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:59.189890 14255 raft_consensus.cc:3060] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:59.191913 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:59.193197 14299 leader_election.cc:304] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
W20260709 13:18:59.194484 14226 consensus_peers.cc:597] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.195267 14702 raft_consensus.cc:2804] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:59.195766 14702 raft_consensus.cc:697] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:18:59.196486 14702 consensus_queue.cc:237] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:59.203378 14758 consensus_queue.cc:1048] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:59.118538 14728 raft_consensus.cc:515] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.210709 14697 consensus_queue.cc:1048] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:59.213161 14758 raft_consensus.cc:493] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.213712 14758 raft_consensus.cc:515] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.215746 14758 leader_election.cc:290] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:59.216930 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:59.217217 14110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:59.217559 14257 raft_consensus.cc:3060] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.217924 14110 raft_consensus.cc:2468] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:59.238687 14383 raft_consensus.cc:359] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.239336 14383 raft_consensus.cc:385] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.239568 14383 raft_consensus.cc:740] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.240165 14383 consensus_queue.cc:260] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.220381 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.243492 14383 ts_tablet_manager.cc:1434] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
I20260709 13:18:59.247658 14381 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:59.236861 14728 leader_election.cc:290] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:59.249182 14381 ts_tablet_manager.cc:1403] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.193s	user 0.031s	sys 0.027s
I20260709 13:18:59.252138 14383 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:59.245321 14185 raft_consensus.cc:2468] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:18:59.257090 14463 raft_consensus.cc:493] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.247365 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:18:59.268759 14332 raft_consensus.cc:3060] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.267122 14463 raft_consensus.cc:515] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.291236 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef01c7e413414a618fc490804422f834" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:59.292327 14257 raft_consensus.cc:2468] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:59.267005 14654 consensus_queue.cc:1048] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:18:59.294090 14384 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:59.267457 14299 leader_election.cc:304] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:59.296401 14384 ts_tablet_manager.cc:1403] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.242s	user 0.011s	sys 0.017s
W20260709 13:18:59.299674 14300 leader_election.cc:343] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.288331 14463 leader_election.cc:290] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:59.305707 14077 leader_election.cc:304] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:59.306527 14734 raft_consensus.cc:2804] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:59.306991 14734 raft_consensus.cc:697] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:18:59.307822 14734 consensus_queue.cc:237] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
W20260709 13:18:59.300930 14153 leader_election.cc:343] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:59.313831 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 49722.2us
I20260709 13:18:59.320461 14009 catalog_manager.cc:5697] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:59.333220 14384 raft_consensus.cc:359] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.334002 14384 raft_consensus.cc:385] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.334264 14384 raft_consensus.cc:740] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.334903 14384 consensus_queue.cc:260] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.342891 14697 raft_consensus.cc:493] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.343405 14697 raft_consensus.cc:515] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.345373 14697 leader_election.cc:290] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:59.347960 14381 raft_consensus.cc:359] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.348625 14381 raft_consensus.cc:385] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.348883 14381 raft_consensus.cc:740] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.349483 14381 consensus_queue.cc:260] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.351544 14381 ts_tablet_manager.cc:1434] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.102s	user 0.004s	sys 0.000s
I20260709 13:18:59.365329 14384 ts_tablet_manager.cc:1434] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.002s
I20260709 13:18:59.366428 14384 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:59.369768 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4709c305db34d068e37448bc1462f47" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:59.377245 14381 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:59.381419 14382 tablet_bootstrap.cc:492] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:59.382103 14382 ts_tablet_manager.cc:1403] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.304s	user 0.024s	sys 0.010s
W20260709 13:18:59.383908 14153 leader_election.cc:343] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.330750 14702 raft_consensus.cc:2804] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.396366 14702 raft_consensus.cc:493] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.426396 14702 raft_consensus.cc:3060] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.445712 14382 raft_consensus.cc:359] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.446713 14382 raft_consensus.cc:385] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.447053 14382 raft_consensus.cc:740] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
W20260709 13:18:59.450255 14785 log.cc:927] Time spent T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:18:59.451264 14332 raft_consensus.cc:2468] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:18:59.452634 14383 tablet_bootstrap.cc:654] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.447856 14382 consensus_queue.cc:260] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
W20260709 13:18:59.412357 14152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 126660us
W20260709 13:18:59.436359 14151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 96487.1us
W20260709 13:18:59.474542 14790 log.cc:927] Time spent T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:18:59.477002 14793 raft_consensus.cc:493] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.512102 14384 tablet_bootstrap.cc:654] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.512917 14381 tablet_bootstrap.cc:654] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.513873 14702 raft_consensus.cc:515] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.516005 14702 leader_election.cc:290] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:59.518582 14625 consensus_queue.cc:1048] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:59.506867 14787 log.cc:927] Time spent T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:18:59.538751 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef01c7e413414a618fc490804422f834" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.546779 14006 catalog_manager.cc:5697] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:59.501149 14793 raft_consensus.cc:515] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.548394 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:59.568579 14794 raft_consensus.cc:493] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.577808 14254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4709c305db34d068e37448bc1462f47" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.584266 14382 ts_tablet_manager.cc:1434] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.202s	user 0.009s	sys 0.019s
W20260709 13:18:59.585276 14152 leader_election.cc:343] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.585536 14382 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:59.585780 14152 leader_election.cc:304] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:59.587955 14732 raft_consensus.cc:2749] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:59.588944 14735 raft_consensus.cc:493] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.589464 14735 raft_consensus.cc:515] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.591482 14735 leader_election.cc:290] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:59.592010 14382 tablet_bootstrap.cc:654] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.592839 14384 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:59.593370 14384 ts_tablet_manager.cc:1403] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.227s	user 0.016s	sys 0.002s
I20260709 13:18:59.569612 14759 consensus_queue.cc:1048] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:18:59.600540 14384 raft_consensus.cc:359] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.601505 14384 raft_consensus.cc:385] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.601845 14384 raft_consensus.cc:740] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.602653 14384 consensus_queue.cc:260] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.605933 14384 ts_tablet_manager.cc:1434] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:18:59.607050 14384 tablet_bootstrap.cc:492] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:59.632614 14381 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:18:59.633109 14381 ts_tablet_manager.cc:1403] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.256s	user 0.016s	sys 0.015s
I20260709 13:18:59.636456 14384 tablet_bootstrap.cc:654] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.583583 14794 raft_consensus.cc:515] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
W20260709 13:18:59.679991 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 44938.8us
W20260709 13:18:59.683287 14300 leader_election.cc:343] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.683758 14801 raft_consensus.cc:493] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.695083 14383 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:18:59.695547 14383 ts_tablet_manager.cc:1403] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.444s	user 0.015s	sys 0.006s
W20260709 13:18:59.699448 14152 leader_election.cc:343] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.699965 14152 leader_election.cc:304] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:59.694461 14105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:59.705439 14463 raft_consensus.cc:2749] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:59.709281 14381 raft_consensus.cc:359] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:59.717990 14381 raft_consensus.cc:385] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.718451 14381 raft_consensus.cc:740] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.719401 14381 consensus_queue.cc:260] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:18:59.732641 14383 raft_consensus.cc:359] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.736915 14382 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:18:59.727178 14105 raft_consensus.cc:2468] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:59.750487 14382 ts_tablet_manager.cc:1403] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.165s	user 0.024s	sys 0.009s
I20260709 13:18:59.748915 14383 raft_consensus.cc:385] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.751647 14383 raft_consensus.cc:740] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.691915 14801 raft_consensus.cc:515] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.752348 14383 consensus_queue.cc:260] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.766063 14383 ts_tablet_manager.cc:1434] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:18:59.762148 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.770605 14382 raft_consensus.cc:359] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.776445 14382 raft_consensus.cc:385] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.776769 14382 raft_consensus.cc:740] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.781728 14382 consensus_queue.cc:260] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.785990 14382 ts_tablet_manager.cc:1434] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:18:59.787235 14382 tablet_bootstrap.cc:492] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:18:59.780599 14794 leader_election.cc:290] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:59.768028 14793 leader_election.cc:290] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:18:59.792586 14381 ts_tablet_manager.cc:1434] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.159s	user 0.009s	sys 0.000s
I20260709 13:18:59.790524 14254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb81836efc194afea3e9a9b0a1e5d000" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.795197 14381 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:18:59.803043 14801 leader_election.cc:290] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:59.813027 14151 leader_election.cc:304] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:59.813568 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb81836efc194afea3e9a9b0a1e5d000" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:18:59.817034 14382 tablet_bootstrap.cc:654] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:59.856030 14300 leader_election.cc:343] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:59.853348 14153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 84749.8us
I20260709 13:18:59.863919 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:59.864765 14335 raft_consensus.cc:2468] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:18:59.853655 14793 consensus_queue.cc:1048] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:18:59.856359 14794 raft_consensus.cc:2804] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:59.845328 14152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 99005.6us
I20260709 13:18:59.868285 14606 raft_consensus.cc:493] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.852586 14111 raft_consensus.cc:2468] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:18:59.873994 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:59.886523 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:18:59.890300 14153 leader_election.cc:304] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:18:59.894862 14334 raft_consensus.cc:2468] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:18:59.893725 14108 raft_consensus.cc:3060] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.888595 14794 raft_consensus.cc:493] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.900429 14381 tablet_bootstrap.cc:654] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.905304 14299 leader_election.cc:304] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:18:59.908567 14463 raft_consensus.cc:2804] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.909001 14463 raft_consensus.cc:493] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.909301 14463 raft_consensus.cc:3060] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.909345 14227 leader_election.cc:304] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:18:59.910219 14800 raft_consensus.cc:2804] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.910604 14800 raft_consensus.cc:493] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.910915 14800 raft_consensus.cc:3060] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.892781 14606 raft_consensus.cc:515] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.913789 14384 tablet_bootstrap.cc:492] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:18:59.914295 14384 ts_tablet_manager.cc:1403] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.307s	user 0.014s	sys 0.017s
I20260709 13:18:59.914479 14606 leader_election.cc:290] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:59.902242 14794 raft_consensus.cc:3060] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.917028 14384 raft_consensus.cc:359] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.917588 14654 raft_consensus.cc:2804] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.917764 14384 raft_consensus.cc:385] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:59.918061 14654 raft_consensus.cc:493] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.918154 14384 raft_consensus.cc:740] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:18:59.918517 14654 raft_consensus.cc:3060] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:59.921809 14152 leader_election.cc:343] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.918946 14384 consensus_queue.cc:260] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.932224 14383 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:18:59.932421 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:59.933149 14184 raft_consensus.cc:2468] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:59.941216 14758 consensus_queue.cc:1048] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:59.945766 14077 leader_election.cc:304] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:18:59.947286 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.949848 14383 tablet_bootstrap.cc:654] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:59.951733 14725 raft_consensus.cc:2804] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:59.952174 14725 raft_consensus.cc:493] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.948025 14261 raft_consensus.cc:2468] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:18:59.952533 14725 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.953460 14794 raft_consensus.cc:515] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:18:59.956270 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:18:59.958973 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:18:59.962826 14800 raft_consensus.cc:515] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:18:59.965744 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:18:59.966379 14111 raft_consensus.cc:3060] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:59.974748 14463 raft_consensus.cc:515] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:18:59.966382 14384 ts_tablet_manager.cc:1434] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 13:18:59.978655 14111 raft_consensus.cc:2468] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:18:59.981977 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:18:59.984812 14151 leader_election.cc:304] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
W20260709 13:18:59.985621 14152 leader_election.cc:343] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:59.985677 14697 raft_consensus.cc:2804] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:59.986487 14697 raft_consensus.cc:697] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:18:59.980605 14794 leader_election.cc:290] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:18:59.995538 14384 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
I20260709 13:18:59.998746 14463 leader_election.cc:290] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:18:59.987421 14697 consensus_queue.cc:237] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.002370 14184 raft_consensus.cc:2393] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c19f7f4ddb074bd8997d01296c3080d6 in current term 1: Already voted for candidate 45ddcb989aef4c9fa869766c3682632c in this term.
I20260709 13:19:00.005234 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:00.015349 14108 raft_consensus.cc:2468] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:19:00.032781 14382 tablet_bootstrap.cc:492] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:19:00.033668 14382 ts_tablet_manager.cc:1403] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.247s	user 0.020s	sys 0.016s
I20260709 13:19:00.034564 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:00.035240 14331 raft_consensus.cc:3060] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.045469 14381 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:19:00.046196 14381 ts_tablet_manager.cc:1403] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.251s	user 0.015s	sys 0.002s
I20260709 13:19:00.048883 14800 leader_election.cc:290] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:00.054149 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb81836efc194afea3e9a9b0a1e5d000" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:00.008805 14654 raft_consensus.cc:515] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
W20260709 13:19:00.059389 14300 leader_election.cc:343] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.001536 14725 raft_consensus.cc:515] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.062948 14261 raft_consensus.cc:2393] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddcb989aef4c9fa869766c3682632c in current term 1: Already voted for candidate c19f7f4ddb074bd8997d01296c3080d6 in this term.
I20260709 13:19:00.064338 14818 consensus_queue.cc:1048] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:00.064837 14654 leader_election.cc:290] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:00.064356 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:00.069192 14383 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:19:00.069726 14383 ts_tablet_manager.cc:1403] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.014s
I20260709 13:19:00.069998 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:00.072571 14383 raft_consensus.cc:359] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.073356 14383 raft_consensus.cc:385] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.073659 14383 raft_consensus.cc:740] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.073457 14331 raft_consensus.cc:2468] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:00.065127 14381 raft_consensus.cc:359] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.075325 14381 raft_consensus.cc:385] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.075608 14381 raft_consensus.cc:740] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.074328 14383 consensus_queue.cc:260] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.076494 14381 consensus_queue.cc:260] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.077898 14153 leader_election.cc:304] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:00.078169 14384 tablet_bootstrap.cc:654] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.087085 14802 raft_consensus.cc:493] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.115702 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb81836efc194afea3e9a9b0a1e5d000" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:19:00.116478 14106 raft_consensus.cc:3060] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.116343 14802 raft_consensus.cc:515] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.118093 14299 leader_election.cc:304] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:00.119095 14799 raft_consensus.cc:2804] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.119573 14799 raft_consensus.cc:697] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:00.120422 14799 consensus_queue.cc:237] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.124418 14383 ts_tablet_manager.cc:1434] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.008s
I20260709 13:19:00.125420 14383 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:00.119760 14802 leader_election.cc:290] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:19:00.138226 14153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 60401.5us
I20260709 13:19:00.139921 14463 raft_consensus.cc:2804] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.140463 14463 raft_consensus.cc:697] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:00.141204 14463 consensus_queue.cc:237] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.148010 14381 ts_tablet_manager.cc:1434] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.000s
I20260709 13:19:00.149281 14381 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:19:00.154659 14725 leader_election.cc:290] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:00.155511 14382 raft_consensus.cc:359] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.156684 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:00.157310 14261 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.152915 14734 consensus_queue.cc:1048] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:19:00.167236 14261 raft_consensus.cc:2468] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:19:00.139180 14226 leader_election.cc:304] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:19:00.168010 14106 raft_consensus.cc:2468] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
W20260709 13:19:00.168987 14226 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 83663.4us
I20260709 13:19:00.156283 14382 raft_consensus.cc:385] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.172214 14382 raft_consensus.cc:740] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.173089 14382 consensus_queue.cc:260] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.173837 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:00.174373 14697 raft_consensus.cc:493] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.174472 14185 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.174983 14697 raft_consensus.cc:515] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.177739 14697 leader_election.cc:290] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:00.179009 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f8d4bb28b4564a44774231b92f8c9" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:19:00.181041 14383 tablet_bootstrap.cc:654] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:00.182690 14151 leader_election.cc:343] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.183655 14104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876b3eb00a984f94a6d6df1d7472bedb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:19:00.188388 14077 leader_election.cc:304] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:00.186826 14299 leader_election.cc:304] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:00.191069 14382 ts_tablet_manager.cc:1434] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.001s
I20260709 13:19:00.191737 14702 raft_consensus.cc:493] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.200546 14814 raft_consensus.cc:2749] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:00.199368 14702 raft_consensus.cc:515] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.206045 14702 leader_election.cc:290] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:00.194720 14725 raft_consensus.cc:2804] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.208349 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4709c305db34d068e37448bc1462f47" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:00.208514 14725 raft_consensus.cc:697] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:00.215868 14184 raft_consensus.cc:2468] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:19:00.220624 14725 consensus_queue.cc:237] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.230883 14300 leader_election.cc:304] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:19:00.216331 14759 raft_consensus.cc:2804] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.232115 14800 raft_consensus.cc:2804] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:00.232656 14759 raft_consensus.cc:697] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:00.232688 14800 raft_consensus.cc:493] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.233549 14759 consensus_queue.cc:237] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.253799 14328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f8d4bb28b4564a44774231b92f8c9" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:00.249024 14800 raft_consensus.cc:3060] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:00.266747 14153 leader_election.cc:343] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.267195 14153 leader_election.cc:304] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:00.269098 14819 raft_consensus.cc:2749] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:00.277683 14802 raft_consensus.cc:493] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.279454 14802 raft_consensus.cc:515] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.282047 14802 leader_election.cc:290] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:00.285712 14384 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:19:00.286340 14384 ts_tablet_manager.cc:1403] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.298s	user 0.011s	sys 0.003s
I20260709 13:19:00.290304 14384 raft_consensus.cc:359] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.291163 14384 raft_consensus.cc:385] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.291481 14384 raft_consensus.cc:740] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.291939 14185 raft_consensus.cc:2468] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:19:00.292320 14384 consensus_queue.cc:260] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.303125 14382 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:19:00.312666 14381 tablet_bootstrap.cc:654] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.314356 14384 ts_tablet_manager.cc:1434] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:19:00.315783 14384 tablet_bootstrap.cc:492] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215: Bootstrap starting.
W20260709 13:19:00.333801 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 107858us
W20260709 13:19:00.335235 14299 leader_election.cc:343] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.330801 14802 raft_consensus.cc:493] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.336198 14802 raft_consensus.cc:515] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.344456 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:00.347800 14625 raft_consensus.cc:493] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.348385 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:19:00.348361 14625 raft_consensus.cc:515] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.350602 14625 leader_election.cc:290] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:00.347018 14007 catalog_manager.cc:5697] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:00.356102 14300 leader_election.cc:343] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.361959 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95255a6465943e199a2aa0b7601bf32" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:19:00.362799 14382 tablet_bootstrap.cc:654] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:00.372711 14299 leader_election.cc:343] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.374083 14299 leader_election.cc:304] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:00.362726 14108 raft_consensus.cc:2468] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:19:00.379417 14383 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:19:00.380007 14383 ts_tablet_manager.cc:1403] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.255s	user 0.006s	sys 0.033s
I20260709 13:19:00.388911 14800 raft_consensus.cc:515] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.391024 14800 leader_election.cc:290] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:00.404901 14299 leader_election.cc:304] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:00.378700 14759 raft_consensus.cc:2749] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:00.411962 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:00.417647 14802 leader_election.cc:290] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:00.418504 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4709c305db34d068e37448bc1462f47" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:00.410499 14799 raft_consensus.cc:2804] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:00.419277 14187 raft_consensus.cc:3060] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.423139 14106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f8d4bb28b4564a44774231b92f8c9" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:19:00.425091 14299 leader_election.cc:343] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.431272 14187 raft_consensus.cc:2468] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:19:00.421504 14799 raft_consensus.cc:493] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.432462 14799 raft_consensus.cc:3060] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.418637 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f8d4bb28b4564a44774231b92f8c9" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:00.436607 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876b3eb00a984f94a6d6df1d7472bedb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:00.437361 14185 raft_consensus.cc:2468] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:19:00.434221 14300 leader_election.cc:304] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:19:00.441337 14300 leader_election.cc:304] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:00.441740 14383 raft_consensus.cc:359] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.442407 14383 raft_consensus.cc:385] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.442652 14383 raft_consensus.cc:740] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.444864 14383 consensus_queue.cc:260] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.447466 14842 raft_consensus.cc:2804] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.452248 14383 ts_tablet_manager.cc:1434] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.003s
I20260709 13:19:00.446165 14702 raft_consensus.cc:2804] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:00.459860 14702 raft_consensus.cc:493] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.461092 14383 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:00.458232 14799 raft_consensus.cc:515] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.462705 14384 tablet_bootstrap.cc:654] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.463546 14702 raft_consensus.cc:3060] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.464140 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4709c305db34d068e37448bc1462f47" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:00.470614 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4709c305db34d068e37448bc1462f47" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:00.470861 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95255a6465943e199a2aa0b7601bf32" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:00.461529 14842 raft_consensus.cc:697] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
W20260709 13:19:00.486850 14300 leader_election.cc:343] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.493486 14300 leader_election.cc:304] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:00.496156 14759 raft_consensus.cc:2749] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:00.498597 14697 raft_consensus.cc:493] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.499274 14697 raft_consensus.cc:515] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.491832 14842 consensus_queue.cc:237] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.510208 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
W20260709 13:19:00.511713 14151 leader_election.cc:343] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.513200 14697 leader_election.cc:290] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:00.517190 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95255a6465943e199a2aa0b7601bf32" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:19:00.517859 14108 raft_consensus.cc:3060] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:00.521413 14300 leader_election.cc:343] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:00.522399 14300 leader_election.cc:343] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.525430 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95255a6465943e199a2aa0b7601bf32" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:00.526469 14702 raft_consensus.cc:515] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.528419 14108 raft_consensus.cc:2468] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:19:00.529553 14299 leader_election.cc:304] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:00.530359 14800 raft_consensus.cc:2804] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.530871 14800 raft_consensus.cc:697] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:00.531754 14800 consensus_queue.cc:237] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.530515 14381 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:19:00.533566 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:00.534047 14381 ts_tablet_manager.cc:1403] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.385s	user 0.022s	sys 0.009s
W20260709 13:19:00.535144 14152 consensus_peers.cc:597] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:00.535785 14799 leader_election.cc:290] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:19:00.536983 14300 leader_election.cc:343] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.538944 14383 tablet_bootstrap.cc:654] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.539358 14108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f8d4bb28b4564a44774231b92f8c9" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
W20260709 13:19:00.540393 14152 leader_election.cc:343] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:00.540675 14299 leader_election.cc:343] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:00.540961 14152 leader_election.cc:304] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:00.541965 14381 raft_consensus.cc:359] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.545733 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f8d4bb28b4564a44774231b92f8c9" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:00.547173 14702 leader_election.cc:290] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:00.549297 14381 raft_consensus.cc:385] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.548915 14384 tablet_bootstrap.cc:492] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215: No bootstrap required, opened a new log
I20260709 13:19:00.549695 14381 raft_consensus.cc:740] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.550236 14384 ts_tablet_manager.cc:1403] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215: Time spent bootstrapping tablet: real 0.235s	user 0.009s	sys 0.010s
I20260709 13:19:00.550992 14819 raft_consensus.cc:2749] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:00.550298 14185 raft_consensus.cc:3060] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.554100 14382 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:19:00.554641 14382 ts_tablet_manager.cc:1403] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.252s	user 0.005s	sys 0.013s
I20260709 13:19:00.552000 14381 consensus_queue.cc:260] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.559361 14382 raft_consensus.cc:359] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.560106 14382 raft_consensus.cc:385] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.560413 14382 raft_consensus.cc:740] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.560984 14697 consensus_queue.cc:1048] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:00.565737 14381 ts_tablet_manager.cc:1434] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:19:00.567131 14381 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c: Bootstrap starting.
I20260709 13:19:00.568472 14382 consensus_queue.cc:260] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.573513 14384 raft_consensus.cc:359] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.574196 14384 raft_consensus.cc:385] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.574759 14382 ts_tablet_manager.cc:1434] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:19:00.574468 14384 raft_consensus.cc:740] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.577111 14261 raft_consensus.cc:3060] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.568148 14185 raft_consensus.cc:2468] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:19:00.586201 14381 tablet_bootstrap.cc:654] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.586884 14300 leader_election.cc:304] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:00.587674 14800 raft_consensus.cc:2804] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:00.588198 14800 raft_consensus.cc:697] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:00.584497 14382 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:19:00.590991 14383 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:19:00.591595 14383 ts_tablet_manager.cc:1403] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.131s	user 0.012s	sys 0.005s
I20260709 13:19:00.577431 14384 consensus_queue.cc:260] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.592450 14800 consensus_queue.cc:237] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.601400 14383 raft_consensus.cc:359] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.602888 14383 raft_consensus.cc:385] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.603371 14382 tablet_bootstrap.cc:654] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.603323 14383 raft_consensus.cc:740] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.604887 14383 consensus_queue.cc:260] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.608863 14383 ts_tablet_manager.cc:1434] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:19:00.609061 14384 ts_tablet_manager.cc:1434] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:19:00.625046 14702 consensus_queue.cc:1048] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:00.629747 14383 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:00.620374 14008 catalog_manager.cc:5697] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } }
I20260709 13:19:00.663784 14009 catalog_manager.cc:5697] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.666998 14009 catalog_manager.cc:5697] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.687763 14381 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c: No bootstrap required, opened a new log
I20260709 13:19:00.688337 14381 ts_tablet_manager.cc:1403] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c: Time spent bootstrapping tablet: real 0.122s	user 0.018s	sys 0.002s
I20260709 13:19:00.692165 14381 raft_consensus.cc:359] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.692855 14381 raft_consensus.cc:385] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.693140 14381 raft_consensus.cc:740] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.693784 14381 consensus_queue.cc:260] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.694991 14383 tablet_bootstrap.cc:654] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:00.701191 14381 ts_tablet_manager.cc:1434] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:19:00.701917 14382 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:19:00.702567 14382 ts_tablet_manager.cc:1403] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.027s
I20260709 13:19:00.809203 14728 raft_consensus.cc:493] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.810160 14735 consensus_queue.cc:1048] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:00.821257 14382 raft_consensus.cc:359] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.812980 14819 consensus_queue.cc:1048] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:00.818902 14728 raft_consensus.cc:515] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:00.833321 14382 raft_consensus.cc:385] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:00.835026 14382 raft_consensus.cc:740] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:19:00.863093 14187 raft_consensus.cc:3060] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.865823 14728 leader_election.cc:290] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
W20260709 13:19:00.866714 14152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 77525.9us
I20260709 13:19:00.856151 14382 consensus_queue.cc:260] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:00.878943 14759 raft_consensus.cc:493] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.879971 14759 raft_consensus.cc:515] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:00.879042 14382 ts_tablet_manager.cc:1434] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.176s	user 0.011s	sys 0.000s
I20260709 13:19:00.887344 14759 leader_election.cc:290] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:00.901852 14108 raft_consensus.cc:3060] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:00.904520 14300 consensus_peers.cc:597] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:00.917811 14382 tablet_bootstrap.cc:492] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:19:00.921872 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b052613656f42f19ebcb9c59686e9a3" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:00.926602 14728 consensus_queue.cc:1048] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:00.903925 14383 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:19:00.944891 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef01c7e413414a618fc490804422f834" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:00.945307 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b052613656f42f19ebcb9c59686e9a3" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:00.945925 14183 raft_consensus.cc:2468] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:19:00.952265 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef01c7e413414a618fc490804422f834" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:00.953258 14261 raft_consensus.cc:2468] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 0.
I20260709 13:19:00.972466 14816 raft_consensus.cc:493] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.973119 14816 raft_consensus.cc:515] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:00.978614 14300 leader_election.cc:304] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:00.963222 14383 ts_tablet_manager.cc:1403] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.353s	user 0.013s	sys 0.003s
I20260709 13:19:00.980422 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f8d4bb28b4564a44774231b92f8c9" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:00.981324 14800 raft_consensus.cc:2804] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:00.981832 14800 raft_consensus.cc:493] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.982214 14800 raft_consensus.cc:3060] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:00.979557 14816 leader_election.cc:290] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:00.992728 14758 consensus_queue.cc:1048] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:00.995321 14842 consensus_queue.cc:1048] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:01.032711 14383 raft_consensus.cc:359] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:01.034168 14383 raft_consensus.cc:385] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.034636 14383 raft_consensus.cc:740] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.037539 14077 leader_election.cc:304] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:01.044716 14382 tablet_bootstrap.cc:654] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.045336 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb9f8d4bb28b4564a44774231b92f8c9" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:19:01.080818 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 45566.4us
W20260709 13:19:01.084342 14151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 267755us
I20260709 13:19:01.042948 14816 consensus_queue.cc:1048] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 13:19:01.087997 14383 consensus_queue.cc:260] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:01.090493 14383 ts_tablet_manager.cc:1434] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.003s
I20260709 13:19:01.088615 14808 consensus_queue.cc:1048] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:19:01.097681 14184 raft_consensus.cc:2393] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 675788979b2e4a89be45b2af4fa3141a in current term 1: Already voted for candidate 0646b0acb9c943b59389eace852a5215 in this term.
I20260709 13:19:01.098546 14654 raft_consensus.cc:493] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.091938 14383 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:01.099205 14654 raft_consensus.cc:515] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:01.101976 14654 leader_election.cc:290] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:19:01.103787 14152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 54821.9us
W20260709 13:19:01.114332 14077 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 77172us
I20260709 13:19:01.140569 14111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876b3eb00a984f94a6d6df1d7472bedb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:19:01.141359 14111 raft_consensus.cc:2468] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:19:01.156196 14225 leader_election.cc:304] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:01.157485 14859 raft_consensus.cc:2804] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:01.157879 14859 raft_consensus.cc:493] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.158205 14859 raft_consensus.cc:3060] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.176728 14077 leader_election.cc:304] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:19:01.185791 14816 raft_consensus.cc:3060] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.205062 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876b3eb00a984f94a6d6df1d7472bedb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:01.205930 14332 raft_consensus.cc:2468] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 0.
I20260709 13:19:01.189061 14800 raft_consensus.cc:515] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:01.226945 14800 leader_election.cc:290] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:01.261202 14382 tablet_bootstrap.cc:492] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:19:01.261941 14382 ts_tablet_manager.cc:1403] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.345s	user 0.029s	sys 0.025s
W20260709 13:19:01.285450 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 105511us
W20260709 13:19:01.286497 14300 consensus_peers.cc:597] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:01.289357 14382 raft_consensus.cc:359] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:01.289899 14382 raft_consensus.cc:385] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.290061 14382 raft_consensus.cc:740] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.301784 14382 consensus_queue.cc:260] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:01.314189 14816 raft_consensus.cc:2749] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:01.315456 14877 log.cc:927] Time spent T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6: Append to log took a long time: real 0.073s	user 0.004s	sys 0.000s
I20260709 13:19:01.324146 14823 raft_consensus.cc:2749] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:01.327613 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef01c7e413414a618fc490804422f834" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:01.340773 14182 raft_consensus.cc:3060] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.397591 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef01c7e413414a618fc490804422f834" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:01.397984 14863 raft_consensus.cc:493] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.398341 14253 raft_consensus.cc:3060] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.398754 14863 raft_consensus.cc:515] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:01.397665 14861 raft_consensus.cc:493] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.400646 14861 raft_consensus.cc:515] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:01.401652 14863 leader_election.cc:290] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:01.402349 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4709c305db34d068e37448bc1462f47" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:01.402715 14861 leader_election.cc:290] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:01.403275 14184 raft_consensus.cc:2393] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c19f7f4ddb074bd8997d01296c3080d6 in current term 1: Already voted for candidate 0646b0acb9c943b59389eace852a5215 in this term.
I20260709 13:19:01.403636 14842 consensus_queue.cc:1048] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:01.405381 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4709c305db34d068e37448bc1462f47" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:01.406674 14328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:01.407600 14328 raft_consensus.cc:2468] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 0.
I20260709 13:19:01.412832 14107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:19:01.430738 14227 leader_election.cc:304] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:19:01.429046 14625 consensus_queue.cc:1048] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:01.433048 14654 raft_consensus.cc:3060] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.431025 14383 tablet_bootstrap.cc:654] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.445097 14153 leader_election.cc:304] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
W20260709 13:19:01.445880 14151 leader_election.cc:343] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:01.447394 14382 ts_tablet_manager.cc:1434] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.185s	user 0.004s	sys 0.004s
I20260709 13:19:01.447674 14861 raft_consensus.cc:2804] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:01.448251 14861 raft_consensus.cc:493] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.448632 14861 raft_consensus.cc:3060] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.448880 14382 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:19:01.451268 14253 raft_consensus.cc:2468] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
W20260709 13:19:01.464146 14151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 44330.2us
I20260709 13:19:01.474401 14859 raft_consensus.cc:515] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
W20260709 13:19:01.476401 14300 consensus_peers.cc:597] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:01.477212 14859 leader_election.cc:290] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:01.477726 14300 leader_election.cc:304] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:01.478492 14842 consensus_queue.cc:1048] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:01.479420 14328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876b3eb00a984f94a6d6df1d7472bedb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:01.480175 14010 catalog_manager.cc:5697] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:01.459936 14182 raft_consensus.cc:2468] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:19:01.506090 14808 raft_consensus.cc:2804] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:01.508615 14382 tablet_bootstrap.cc:654] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.525683 14112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876b3eb00a984f94a6d6df1d7472bedb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
I20260709 13:19:01.526439 14112 raft_consensus.cc:3060] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.511773 14861 raft_consensus.cc:515] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:01.530081 14861 leader_election.cc:290] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:01.531451 14654 raft_consensus.cc:2749] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:01.535689 14112 raft_consensus.cc:2468] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:01.536106 14808 raft_consensus.cc:697] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:01.538113 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:01.538888 14334 raft_consensus.cc:3060] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.538499 14808 consensus_queue.cc:237] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:01.547391 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
W20260709 13:19:01.548954 14151 leader_election.cc:343] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:01.550047 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 45896.3us
I20260709 13:19:01.543922 14328 raft_consensus.cc:3060] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.573942 14225 leader_election.cc:304] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:01.577940 14863 raft_consensus.cc:2804] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:01.586690 14863 raft_consensus.cc:697] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:01.586797 14334 raft_consensus.cc:2468] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:01.587692 14863 consensus_queue.cc:237] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:01.588197 14153 leader_election.cc:304] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:01.589365 14861 raft_consensus.cc:2804] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:01.589867 14861 raft_consensus.cc:697] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:01.590669 14861 consensus_queue.cc:237] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:01.608527 14328 raft_consensus.cc:2468] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:01.620726 14383 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:19:01.622203 14383 ts_tablet_manager.cc:1403] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.531s	user 0.019s	sys 0.038s
I20260709 13:19:01.640130 14382 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:19:01.640702 14382 ts_tablet_manager.cc:1403] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.192s	user 0.014s	sys 0.003s
I20260709 13:19:01.641754 14383 raft_consensus.cc:359] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:01.644480 14382 raft_consensus.cc:359] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:01.645823 14382 raft_consensus.cc:385] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.646279 14382 raft_consensus.cc:740] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.642501 14383 raft_consensus.cc:385] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.647004 14383 raft_consensus.cc:740] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.647782 14383 consensus_queue.cc:260] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:01.647410 14382 consensus_queue.cc:260] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:01.651659 14382 ts_tablet_manager.cc:1434] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:19:01.653658 14382 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:19:01.651966 14383 ts_tablet_manager.cc:1434] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:19:01.659930 14383 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:01.665995 14382 tablet_bootstrap.cc:654] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.674197 14383 tablet_bootstrap.cc:654] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.723546 14382 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:19:01.724857 14382 ts_tablet_manager.cc:1403] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.012s
I20260709 13:19:01.728124 14382 raft_consensus.cc:359] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:01.734207 14382 raft_consensus.cc:385] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.734882 14382 raft_consensus.cc:740] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.736248 14382 consensus_queue.cc:260] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:01.744735 14382 ts_tablet_manager.cc:1434] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:19:01.766780 14382 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:19:01.792407 14382 tablet_bootstrap.cc:654] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.793989 14383 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: No bootstrap required, opened a new log
I20260709 13:19:01.794535 14383 ts_tablet_manager.cc:1403] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.135s	user 0.039s	sys 0.051s
W20260709 13:19:01.797392 14058 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:01.797324 14383 raft_consensus.cc:359] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:01.798123 14383 raft_consensus.cc:385] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.798421 14383 raft_consensus.cc:740] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.801049 14383 consensus_queue.cc:260] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:01.801777 14261 raft_consensus.cc:3060] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.812011 14383 ts_tablet_manager.cc:1434] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:19:01.828869 14382 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:19:01.829509 14382 ts_tablet_manager.cc:1403] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.022s
I20260709 13:19:01.840938 14382 raft_consensus.cc:359] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:01.841655 14382 raft_consensus.cc:385] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.841954 14382 raft_consensus.cc:740] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.842597 14382 consensus_queue.cc:260] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:01.844796 14382 ts_tablet_manager.cc:1434] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:19:01.845885 14382 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6: Bootstrap starting.
I20260709 13:19:01.850942 14007 catalog_manager.cc:5697] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.852330 14382 tablet_bootstrap.cc:654] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:01.852980 14863 raft_consensus.cc:493] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.858706 14863 raft_consensus.cc:515] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:01.861515 14863 leader_election.cc:290] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:01.862926 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:01.865244 14109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "675788979b2e4a89be45b2af4fa3141a" is_pre_election: true
I20260709 13:19:01.867483 14226 leader_election.cc:304] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:01.873184 14863 raft_consensus.cc:2749] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:01.874207 14007 catalog_manager.cc:5697] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:01.911971 14007 catalog_manager.cc:5697] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:01.934115 14798 raft_consensus.cc:493] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.934648 14798 raft_consensus.cc:515] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:01.936887 14798 leader_election.cc:290] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:01.937824 14382 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6: No bootstrap required, opened a new log
I20260709 13:19:01.938331 14382 ts_tablet_manager.cc:1403] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.030s
I20260709 13:19:01.941207 14382 raft_consensus.cc:359] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:01.941900 14382 raft_consensus.cc:385] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:01.942193 14382 raft_consensus.cc:740] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Initialized, Role: FOLLOWER
I20260709 13:19:01.941665 14009 catalog_manager.cc:5697] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:01.942901 14382 consensus_queue.cc:260] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:01.944339 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:01.945003 14181 raft_consensus.cc:2468] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:19:01.945112 14382 ts_tablet_manager.cc:1434] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:19:01.942274 14798 raft_consensus.cc:493] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.948609 14798 raft_consensus.cc:515] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:01.950982 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:01.951267 14328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:01.951666 14253 raft_consensus.cc:2468] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 0.
I20260709 13:19:01.952065 14328 raft_consensus.cc:2393] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 675788979b2e4a89be45b2af4fa3141a in current term 1: Already voted for candidate 45ddcb989aef4c9fa869766c3682632c in this term.
I20260709 13:19:01.953094 14798 leader_election.cc:290] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:01.954097 14077 leader_election.cc:304] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:01.958844 14816 raft_consensus.cc:2804] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:01.959280 14816 raft_consensus.cc:493] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.959617 14816 raft_consensus.cc:3060] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.961113 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:01.971366 14077 leader_election.cc:304] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:19:01.973984 14818 raft_consensus.cc:3060] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:01.972235 14009 catalog_manager.cc:5697] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 1 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.979430 14697 consensus_queue.cc:1048] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:01.996600 14818 raft_consensus.cc:2749] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:02.005940 14883 consensus_queue.cc:1048] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.006780 14009 catalog_manager.cc:5697] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 1 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } }
I20260709 13:19:02.009124 14816 raft_consensus.cc:515] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:02.014251 14873 consensus_queue.cc:1048] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.016426 14816 leader_election.cc:290] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:02.025580 14842 consensus_queue.cc:1048] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:02.043569 14863 consensus_queue.cc:1048] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.048408 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:02.049295 14258 raft_consensus.cc:3060] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.055227 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:02.055932 14181 raft_consensus.cc:3060] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.090658 14258 raft_consensus.cc:2468] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:19:02.115908 14181 raft_consensus.cc:2468] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 1.
I20260709 13:19:02.139724 14077 leader_election.cc:304] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:02.141372 14798 raft_consensus.cc:2804] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:02.141877 14798 raft_consensus.cc:697] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:02.142773 14798 consensus_queue.cc:237] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:02.148916 14654 consensus_queue.cc:1048] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.175194 14009 catalog_manager.cc:5697] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 0 to 1, leader changed from <none> to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 1 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:02.189574 14261 raft_consensus.cc:3060] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.197160 14258 raft_consensus.cc:3060] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:02.566689 14871 consensus_queue.cc:1048] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:02.582290 14816 consensus_queue.cc:1048] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:03.879529  7076 tablet_server.cc:179] TabletServer@127.6.233.1:0 shutting down...
W20260709 13:19:03.893189 14225 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:19:03.906162 14225 consensus_peers.cc:597] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:03.915742 14151 consensus_peers.cc:597] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:03.921157 14151 consensus_peers.cc:597] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:03.960520 14151 consensus_peers.cc:597] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:03.968178 14225 consensus_peers.cc:597] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:03.969249 14225 consensus_peers.cc:597] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:03.979027  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:19:03.981503 14151 consensus_peers.cc:597] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:03.979333 14299 consensus_peers.cc:597] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:03.982612 14299 consensus_peers.cc:597] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:03.983470  7076 tablet_replica.cc:333] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:03.984467  7076 raft_consensus.cc:2243] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:03.985335  7076 raft_consensus.cc:2272] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.987579  7076 tablet_replica.cc:333] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:03.988219  7076 raft_consensus.cc:2243] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.988658  7076 raft_consensus.cc:2272] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.990360  7076 tablet_replica.cc:333] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:03.990947  7076 raft_consensus.cc:2243] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.991362  7076 raft_consensus.cc:2272] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.993369  7076 tablet_replica.cc:333] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:03.994279  7076 raft_consensus.cc:2243] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:03.995255  7076 raft_consensus.cc:2272] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:03.998176  7076 tablet_replica.cc:333] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:03.998977  7076 raft_consensus.cc:2243] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:03.999553  7076 raft_consensus.cc:2272] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.002295  7076 tablet_replica.cc:333] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.003093  7076 raft_consensus.cc:2243] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.003682  7076 raft_consensus.cc:2272] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:04.005614 14299 consensus_peers.cc:597] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.006517  7076 tablet_replica.cc:333] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.007264  7076 raft_consensus.cc:2243] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.007791  7076 raft_consensus.cc:2272] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.009908  7076 tablet_replica.cc:333] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.010488  7076 raft_consensus.cc:2243] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.010882  7076 raft_consensus.cc:2272] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.013111  7076 tablet_replica.cc:333] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.013945  7076 raft_consensus.cc:2243] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.014513  7076 raft_consensus.cc:2272] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.017539  7076 tablet_replica.cc:333] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.018420  7076 raft_consensus.cc:2243] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:04.018551 14299 consensus_peers.cc:597] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.019001  7076 raft_consensus.cc:2272] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.024169  7076 tablet_replica.cc:333] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.025060  7076 raft_consensus.cc:2243] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.025707  7076 raft_consensus.cc:2272] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:04.026796 14299 consensus_peers.cc:597] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.028229  7076 tablet_replica.cc:333] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.029208  7076 raft_consensus.cc:2243] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.029731  7076 raft_consensus.cc:2272] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.032485  7076 tablet_replica.cc:333] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
W20260709 13:19:04.032745 14299 consensus_peers.cc:597] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.033473  7076 raft_consensus.cc:2243] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.034591  7076 raft_consensus.cc:2272] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:04.036816 14299 consensus_peers.cc:597] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.037643  7076 tablet_replica.cc:333] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.038627  7076 raft_consensus.cc:2243] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.039418  7076 raft_consensus.cc:2272] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.042347  7076 tablet_replica.cc:333] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.043267  7076 raft_consensus.cc:2243] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.044312  7076 raft_consensus.cc:2272] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:04.046178 14299 consensus_peers.cc:597] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.047372  7076 tablet_replica.cc:333] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.048245  7076 raft_consensus.cc:2243] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.048745  7076 raft_consensus.cc:2272] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.050670  7076 tablet_replica.cc:333] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.051326  7076 raft_consensus.cc:2243] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.051802  7076 raft_consensus.cc:2272] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.054208  7076 tablet_replica.cc:333] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.054973  7076 raft_consensus.cc:2243] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.055510  7076 raft_consensus.cc:2272] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.058123  7076 tablet_replica.cc:333] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.058663  7076 raft_consensus.cc:2243] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.059156  7076 raft_consensus.cc:2272] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.061376  7076 tablet_replica.cc:333] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.061961  7076 raft_consensus.cc:2243] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.062388  7076 raft_consensus.cc:2272] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.065171  7076 tablet_replica.cc:333] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.065940  7076 raft_consensus.cc:2243] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.066972  7076 raft_consensus.cc:2272] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.069723  7076 tablet_replica.cc:333] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.070634  7076 raft_consensus.cc:2243] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:04.073268 14151 consensus_peers.cc:597] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.074007  7076 raft_consensus.cc:2272] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.078063  7076 tablet_replica.cc:333] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.078910  7076 raft_consensus.cc:2243] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.079439  7076 raft_consensus.cc:2272] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.083279  7076 tablet_replica.cc:333] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.084064  7076 raft_consensus.cc:2243] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.084729  7076 raft_consensus.cc:2272] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.087792  7076 tablet_replica.cc:333] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.088411  7076 raft_consensus.cc:2243] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.089337  7076 raft_consensus.cc:2272] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.091478  7076 tablet_replica.cc:333] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.092116  7076 raft_consensus.cc:2243] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.093017  7076 raft_consensus.cc:2272] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:04.095400 14225 consensus_peers.cc:597] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.095847  7076 tablet_replica.cc:333] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.096694  7076 raft_consensus.cc:2243] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.097638  7076 raft_consensus.cc:2272] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.100545  7076 tablet_replica.cc:333] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.101429  7076 raft_consensus.cc:2243] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:04.101742 14299 consensus_peers.cc:597] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.102017  7076 raft_consensus.cc:2272] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.104858  7076 tablet_replica.cc:333] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.105588  7076 raft_consensus.cc:2243] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.106037  7076 raft_consensus.cc:2272] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.107878  7076 tablet_replica.cc:333] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.108430  7076 raft_consensus.cc:2243] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.108886  7076 raft_consensus.cc:2272] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.111693  7076 tablet_replica.cc:333] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.112389  7076 raft_consensus.cc:2243] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.112872  7076 raft_consensus.cc:2272] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.115806  7076 tablet_replica.cc:333] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.116529  7076 raft_consensus.cc:2243] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.117012  7076 raft_consensus.cc:2272] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:04.118963 14299 consensus_peers.cc:597] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.120805  7076 tablet_replica.cc:333] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.121762  7076 raft_consensus.cc:2243] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.122781  7076 raft_consensus.cc:2272] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.125846  7076 tablet_replica.cc:333] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.126362  7076 raft_consensus.cc:2243] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.127200  7076 raft_consensus.cc:2272] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.129642  7076 tablet_replica.cc:333] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.130339  7076 raft_consensus.cc:2243] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.131168  7076 raft_consensus.cc:2272] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.133770  7076 tablet_replica.cc:333] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.134394  7076 raft_consensus.cc:2243] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.134814  7076 raft_consensus.cc:2272] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.137604  7076 tablet_replica.cc:333] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.138278  7076 raft_consensus.cc:2243] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.138804  7076 raft_consensus.cc:2272] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.141683  7076 tablet_replica.cc:333] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.142541  7076 raft_consensus.cc:2243] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.143503  7076 raft_consensus.cc:2272] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.146252  7076 tablet_replica.cc:333] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.147027  7076 raft_consensus.cc:2243] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.147521  7076 raft_consensus.cc:2272] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.149996  7076 tablet_replica.cc:333] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.150501  7076 raft_consensus.cc:2243] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.151548  7076 raft_consensus.cc:2272] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.154302  7076 tablet_replica.cc:333] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.155019  7076 raft_consensus.cc:2243] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.155999  7076 raft_consensus.cc:2272] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.159018  7076 tablet_replica.cc:333] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.159845  7076 raft_consensus.cc:2243] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.160384  7076 raft_consensus.cc:2272] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:04.160454 14151 consensus_peers.cc:597] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.163319  7076 tablet_replica.cc:333] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
W20260709 13:19:04.162707 14299 consensus_peers.cc:597] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.164085  7076 raft_consensus.cc:2243] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.164681  7076 raft_consensus.cc:2272] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.166646  7076 tablet_replica.cc:333] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.167138  7076 raft_consensus.cc:2243] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:04.167567  7076 raft_consensus.cc:2272] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:04.170038  7076 tablet_replica.cc:333] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: stopping tablet replica
I20260709 13:19:04.170568  7076 raft_consensus.cc:2243] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:04.171597  7076 raft_consensus.cc:2272] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:04.201395 14225 consensus_peers.cc:597] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:04.229784 14225 consensus_peers.cc:597] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:04.251400 14151 consensus_peers.cc:597] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.256124  7076 tablet_server.cc:196] TabletServer@127.6.233.1:0 shutdown complete.
W20260709 13:19:04.316982 14299 consensus_peers.cc:597] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:04.330677 14225 consensus_peers.cc:597] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:04.332796 14299 consensus_peers.cc:597] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.351732  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:04.360502 14931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:04.361023 14930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:04.363914 14934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:04.365598  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:04.370599  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:04.370891  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:04.371130  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603144371108 us; error 0 us; skew 500 ppm
I20260709 13:19:04.371942  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:04.377015  7076 webserver.cc:533] Webserver started at http://127.6.233.1:46633/ using document root <none> and password file <none>
W20260709 13:19:04.377839 14151 consensus_peers.cc:597] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.377846  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:04.378351  7076 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:04.384685  7076 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.001s	sys 0.005s
W20260709 13:19:04.395808 14151 consensus_peers.cc:597] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:04.397528 14938 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:04.398578  7076 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:19:04.398990  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "675788979b2e4a89be45b2af4fa3141a"
format_stamp: "Formatted at 2026-07-09 13:18:49 on dist-test-slave-sjgx"
I20260709 13:19:04.399520  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:04.425994  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:04.427687  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:04.429217  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:04.435524 14945 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:19:04.561936 14152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 62944.1us
W20260709 13:19:04.564100 14153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 60824.9us
I20260709 13:19:04.797653  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:19:04.798218  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.364s	user 0.010s	sys 0.000s
I20260709 13:19:04.798583  7076 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:19:04.804510 14945 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:04.822762 14945 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:04.823880 14945 tablet_bootstrap.cc:492] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:04.832881 14945 ts_tablet_manager.cc:1403] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.004s
I20260709 13:19:04.835634 14945 raft_consensus.cc:359] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:04.836404 14945 raft_consensus.cc:740] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.837249 14945 consensus_queue.cc:260] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:04.849741 14945 ts_tablet_manager.cc:1434] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.008s
I20260709 13:19:04.850651 14945 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:04.874843 14945 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:04.876942 14945 tablet_bootstrap.cc:492] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:04.877667 14945 ts_tablet_manager.cc:1403] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 13:19:04.880220 14945 raft_consensus.cc:359] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:04.881033 14945 raft_consensus.cc:740] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.881745 14945 consensus_queue.cc:260] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:04.885123 14945 ts_tablet_manager.cc:1434] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:04.885998 14945 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:04.903636 14945 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:04.904649 14945 tablet_bootstrap.cc:492] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:04.905328 14945 ts_tablet_manager.cc:1403] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.007s
I20260709 13:19:04.908262 14945 raft_consensus.cc:359] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:04.908986 14945 raft_consensus.cc:740] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:04.909674 14945 consensus_queue.cc:260] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:04.911996 14945 ts_tablet_manager.cc:1434] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:04.912820 14945 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:05.041525 14914 raft_consensus.cc:493] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.042153 14914 raft_consensus.cc:515] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.044945 14914 leader_election.cc:290] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.046392 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965959c6060c4e31872a4d63bb4cc3d8" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:05.077674  7076 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:19:05.078145  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.280s	user 0.237s	sys 0.005s
I20260709 13:19:05.088953 14920 raft_consensus.cc:493] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.090338 14920 raft_consensus.cc:515] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.093834 14920 leader_election.cc:290] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.096597 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:19:05.150018 14225 leader_election.cc:336] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.150935 14225 leader_election.cc:304] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.153544 14914 raft_consensus.cc:2749] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.204756 14956 raft_consensus.cc:493] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.205268 14956 raft_consensus.cc:515] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.207260 14956 leader_election.cc:290] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.208279 14945 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:05.208796 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.209261 14945 tablet_bootstrap.cc:492] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:05.209978 14945 ts_tablet_manager.cc:1403] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.297s	user 0.099s	sys 0.110s
I20260709 13:19:05.218364 14914 raft_consensus.cc:493] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.218991 14914 raft_consensus.cc:515] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.222383 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.223984 14914 leader_election.cc:290] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.227155 14949 raft_consensus.cc:493] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.227743 14949 raft_consensus.cc:515] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.230819 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.231626 14261 raft_consensus.cc:2468] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:05.232302 14955 raft_consensus.cc:493] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.232869 14955 raft_consensus.cc:515] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.235766 14955 leader_election.cc:290] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.235857 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.236925 14152 leader_election.cc:304] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.238402 14949 leader_election.cc:290] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.239060 14949 raft_consensus.cc:2804] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.239576 14949 raft_consensus.cc:493] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.240448 14953 raft_consensus.cc:493] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.240983 14953 raft_consensus.cc:515] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.242601 14949 raft_consensus.cc:3060] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.243162 14953 leader_election.cc:290] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:19:05.253665 14299 leader_election.cc:336] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.255182 14955 raft_consensus.cc:493] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.255781 14955 raft_consensus.cc:515] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.258514 14955 leader_election.cc:290] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.258733 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.259423 14258 raft_consensus.cc:2468] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:05.259883 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.261446 14152 leader_election.cc:304] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.263975 14923 raft_consensus.cc:2804] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.264355 14923 raft_consensus.cc:493] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.264708 14923 raft_consensus.cc:3060] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.272589 14923 raft_consensus.cc:515] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.274763 14300 leader_election.cc:304] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:05.275076 14953 raft_consensus.cc:493] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.277163 14951 raft_consensus.cc:2749] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.275682 14953 raft_consensus.cc:515] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.281316 14923 leader_election.cc:290] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.284605 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d51f9492d6490eb3724b897994f107" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:05.285385 14258 raft_consensus.cc:3060] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:05.284710 14225 leader_election.cc:336] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.288460 14225 leader_election.cc:304] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
W20260709 13:19:05.289600 14299 leader_election.cc:336] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.290714 14950 raft_consensus.cc:493] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.291268 14950 raft_consensus.cc:515] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.293467 14950 leader_election.cc:290] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.295616 14920 raft_consensus.cc:2749] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:05.296766 14151 leader_election.cc:336] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.298178 14225 leader_election.cc:336] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.299000 14225 leader_election.cc:304] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.298578 14953 leader_election.cc:290] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:19:05.301892 14151 leader_election.cc:336] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.302299 14151 leader_election.cc:304] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:05.302948 14947 raft_consensus.cc:2749] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:05.303881 14151 leader_election.cc:336] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.300180 14225 leader_election.cc:336] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.305259 14225 leader_election.cc:304] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.300580 14914 raft_consensus.cc:2749] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:05.306617 14299 leader_election.cc:336] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.309597 14967 raft_consensus.cc:493] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.310138 14967 raft_consensus.cc:515] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.311549 14258 raft_consensus.cc:2468] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 2.
I20260709 13:19:05.312170 14920 raft_consensus.cc:2749] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:05.322017 14151 leader_election.cc:336] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.317677 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.315331 14945 raft_consensus.cc:359] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.312288 14967 leader_election.cc:290] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.326294 14152 leader_election.cc:304] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.327227 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df25294a6ce4432cbffe41a0bee4c8b8" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.328819 14923 raft_consensus.cc:2804] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.329586 14920 raft_consensus.cc:493] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.330340 14923 raft_consensus.cc:697] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:05.325088 14945 raft_consensus.cc:740] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.332129 14923 consensus_queue.cc:237] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.333540 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.333515 14945 consensus_queue.cc:260] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
W20260709 13:19:05.321596 14299 leader_election.cc:336] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.330499 14920 raft_consensus.cc:515] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.336766 14945 ts_tablet_manager.cc:1434] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.000s
I20260709 13:19:05.337586 14945 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:05.338019 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:05.338263 14920 leader_election.cc:290] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.338707 14949 raft_consensus.cc:515] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.342051 14953 raft_consensus.cc:493] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.342614 14953 raft_consensus.cc:515] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.344738 14953 leader_election.cc:290] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.344815 14955 raft_consensus.cc:493] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.345523 14955 raft_consensus.cc:515] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:19:05.352636 14225 leader_election.cc:336] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.353344 14225 leader_election.cc:304] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a
W20260709 13:19:05.356168 14151 leader_election.cc:336] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.357952 14920 raft_consensus.cc:2749] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.362489 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:19:05.362919 14299 leader_election.cc:336] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.363190 14253 raft_consensus.cc:2468] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:05.364384 14152 leader_election.cc:304] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.365458 14923 raft_consensus.cc:2804] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.367048 14955 leader_election.cc:290] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.368604 14008 catalog_manager.cc:5697] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 2 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:05.384534 14923 raft_consensus.cc:493] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.385097 14923 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:05.370399 14151 leader_election.cc:336] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.375435 14920 raft_consensus.cc:493] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.379988 14949 leader_election.cc:290] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.379822 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82c6d6688efe44588062121fe1de87d2" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:05.380673 14947 raft_consensus.cc:493] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.380630 14914 raft_consensus.cc:493] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.388465 14970 raft_consensus.cc:493] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.388459 14920 raft_consensus.cc:515] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.395510 14970 raft_consensus.cc:515] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.397223 14920 leader_election.cc:290] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.389900 14949 raft_consensus.cc:493] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
W20260709 13:19:05.398623 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 56407.4us
I20260709 13:19:05.399246 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:05.399570 14300 leader_election.cc:304] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:05.399214 14949 raft_consensus.cc:515] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.400031 14332 raft_consensus.cc:2468] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:05.401348 14227 leader_election.cc:304] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.388758 14253 raft_consensus.cc:3060] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.390062 14914 raft_consensus.cc:515] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.402401 14949 leader_election.cc:290] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.403908 14914 leader_election.cc:290] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.404452 14914 raft_consensus.cc:2804] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.404771 14914 raft_consensus.cc:493] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.405099 14914 raft_consensus.cc:3060] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.389083 14947 raft_consensus.cc:515] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.408125 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5acb16ea44ef882abb6d9013b2848" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.411080 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:05.411288 14954 raft_consensus.cc:493] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.411974 14954 raft_consensus.cc:515] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.411150 14947 leader_election.cc:290] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.416030 14954 leader_election.cc:290] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.416291 14253 raft_consensus.cc:2468] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 2.
I20260709 13:19:05.417179 14951 raft_consensus.cc:2749] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.417400 14956 raft_consensus.cc:493] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
W20260709 13:19:05.419239 14225 leader_election.cc:336] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.419569 14956 raft_consensus.cc:515] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.421902 14956 leader_election.cc:290] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.417636 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.422883 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb043e88ddb1409188b19489adb77959" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.413543 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.425288 14152 leader_election.cc:304] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.426491 14955 raft_consensus.cc:2804] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.418462 14300 leader_election.cc:304] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:05.427021 14955 raft_consensus.cc:697] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:05.429677 14955 consensus_queue.cc:237] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.428673 14950 raft_consensus.cc:2749] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.411898 14332 raft_consensus.cc:2468] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:05.431977 14153 leader_election.cc:304] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
W20260709 13:19:05.432794 14225 leader_election.cc:336] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.433060 14954 raft_consensus.cc:2804] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.433373 14225 leader_election.cc:304] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.433849 14947 raft_consensus.cc:493] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
W20260709 13:19:05.434638 14151 leader_election.cc:336] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.434439 14956 raft_consensus.cc:2749] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.434099 14954 raft_consensus.cc:493] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.434976 14947 raft_consensus.cc:515] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.435770 14954 raft_consensus.cc:3060] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.438042 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df25294a6ce4432cbffe41a0bee4c8b8" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:05.438207 14947 leader_election.cc:290] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.438644 14332 raft_consensus.cc:2468] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:05.440222 14153 leader_election.cc:304] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:19:05.441015 14947 raft_consensus.cc:2804] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.441422 14947 raft_consensus.cc:493] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.441809 14947 raft_consensus.cc:3060] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.442917 14914 raft_consensus.cc:515] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
W20260709 13:19:05.443492 14225 leader_election.cc:336] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.449306 14225 leader_election.cc:304] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19f7f4ddb074bd8997d01296c3080d6; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.453699 14956 raft_consensus.cc:493] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.455880 14920 raft_consensus.cc:2749] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.455811 14956 raft_consensus.cc:515] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.456820 14914 leader_election.cc:290] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.457723 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8465239326774a1386ddba99f9e50efb" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:05.458279 14332 raft_consensus.cc:3060] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.454584 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.458961 14328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:05.453122 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965959c6060c4e31872a4d63bb4cc3d8" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.459618 14328 raft_consensus.cc:2468] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:05.465559 14332 raft_consensus.cc:2468] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
W20260709 13:19:05.469154 14151 leader_election.cc:336] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.469707 14300 leader_election.cc:304] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.469728 14151 leader_election.cc:304] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:05.459883 14956 leader_election.cc:290] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.463002 14970 leader_election.cc:290] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.460098 14253 raft_consensus.cc:2468] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:19:05.480777 14227 leader_election.cc:304] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.479012 14967 raft_consensus.cc:493] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.468473 14954 raft_consensus.cc:515] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.512552 14953 raft_consensus.cc:2749] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.514969 14914 raft_consensus.cc:2804] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.531729 14979 raft_consensus.cc:493] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.532332 14979 raft_consensus.cc:515] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.533928 14945 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:05.534415 14979 leader_election.cc:290] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.534993 14954 leader_election.cc:290] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.535779 14945 tablet_bootstrap.cc:492] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:05.535630 14328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:05.536235 14328 raft_consensus.cc:3060] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.536473 14945 ts_tablet_manager.cc:1403] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.199s	user 0.028s	sys 0.037s
I20260709 13:19:05.539408 14181 raft_consensus.cc:2393] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0646b0acb9c943b59389eace852a5215 in current term 2: Already voted for candidate 45ddcb989aef4c9fa869766c3682632c in this term.
I20260709 13:19:05.539117 14945 raft_consensus.cc:359] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.540030 14945 raft_consensus.cc:740] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.512746 14967 raft_consensus.cc:515] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.540907 14945 consensus_queue.cc:260] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.541174 14956 raft_consensus.cc:493] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.541771 14956 raft_consensus.cc:515] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.542091 14967 leader_election.cc:290] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:19:05.543694 14225 leader_election.cc:336] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.544101 14956 leader_election.cc:290] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.544301 14951 raft_consensus.cc:493] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.544905 14951 raft_consensus.cc:515] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.545898 14914 raft_consensus.cc:697] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:05.547019 14951 leader_election.cc:290] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.546917 14923 raft_consensus.cc:515] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:19:05.547031 14225 leader_election.cc:336] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.534956 14979 raft_consensus.cc:2749] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:05.558960 14225 leader_election.cc:336] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.561892 14328 raft_consensus.cc:2468] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 2.
W20260709 13:19:05.563627 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 94200.7us
I20260709 13:19:05.563961 14153 leader_election.cc:304] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:19:05.565961 14945 ts_tablet_manager.cc:1434] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:19:05.567015 14945 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:19:05.562036 14299 leader_election.cc:336] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.569294 14151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 100160us
W20260709 13:19:05.570482 14151 leader_election.cc:336] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.569665 14979 raft_consensus.cc:2804] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.571337 14151 leader_election.cc:304] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:05.571552 14979 raft_consensus.cc:697] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:05.572526 14979 consensus_queue.cc:237] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.573760 14980 raft_consensus.cc:2749] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.574856 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.578058 14300 leader_election.cc:304] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.588804 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.575757 14182 raft_consensus.cc:2468] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:05.589928 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.590466 14300 leader_election.cc:304] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.575340 14947 raft_consensus.cc:515] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.592559 14261 raft_consensus.cc:2468] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 1.
I20260709 13:19:05.593763 14983 raft_consensus.cc:2804] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.595700 14923 leader_election.cc:290] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.596159 14978 raft_consensus.cc:2749] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.598081 14920 raft_consensus.cc:493] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
W20260709 13:19:05.598944 14299 leader_election.cc:336] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.600385 14914 consensus_queue.cc:237] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.599367 14983 raft_consensus.cc:493] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.601912 14226 leader_election.cc:304] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
W20260709 13:19:05.602074 14151 leader_election.cc:336] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.605023 14299 leader_election.cc:336] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.592080 14980 raft_consensus.cc:493] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.605647 14920 raft_consensus.cc:515] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.609222 14300 leader_election.cc:304] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:05.621730 14300 leader_election.cc:304] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.611392 14983 raft_consensus.cc:3060] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.632691 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5acb16ea44ef882abb6d9013b2848" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.633389 14261 raft_consensus.cc:2468] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:05.633991 14920 leader_election.cc:290] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.626327 14978 raft_consensus.cc:2749] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.634537 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:05.599444 14227 leader_election.cc:304] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.635164 14261 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:05.635576 14227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 45819.8us
I20260709 13:19:05.637573 14152 leader_election.cc:304] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.628119 14970 raft_consensus.cc:2804] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.620576 14956 raft_consensus.cc:493] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.648866 14914 raft_consensus.cc:2804] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.653050 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:05.653182 14970 raft_consensus.cc:493] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.653748 14332 raft_consensus.cc:2468] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:05.654322 14956 raft_consensus.cc:515] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.656111 14982 raft_consensus.cc:493] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.656430 14956 leader_election.cc:290] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.656661 14982 raft_consensus.cc:515] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.657850 14956 raft_consensus.cc:493] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.625782 14980 raft_consensus.cc:515] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.643409 14954 raft_consensus.cc:2804] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.660423 14954 raft_consensus.cc:493] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.660686 14980 leader_election.cc:290] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:05.658682 14982 leader_election.cc:290] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.653780 14970 raft_consensus.cc:3060] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.662556 14227 leader_election.cc:304] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
W20260709 13:19:05.664319 14151 leader_election.cc:336] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.664583 14982 raft_consensus.cc:2804] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.664880 14947 leader_election.cc:290] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.665167 14982 raft_consensus.cc:493] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
W20260709 13:19:05.665292 14151 leader_election.cc:336] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.665604 14982 raft_consensus.cc:3060] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.634549 14920 raft_consensus.cc:2804] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.666635 14920 raft_consensus.cc:493] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.660795 14954 raft_consensus.cc:3060] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.658383 14956 raft_consensus.cc:515] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.666999 14920 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.670006 14914 raft_consensus.cc:493] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.670418 14914 raft_consensus.cc:3060] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.675468 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df25294a6ce4432cbffe41a0bee4c8b8" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:05.676148 14332 raft_consensus.cc:3060] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.677136 14956 leader_election.cc:290] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.664665 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:05.682559 14334 raft_consensus.cc:2468] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:05.679939 14261 raft_consensus.cc:2468] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 2.
I20260709 13:19:05.687547 14332 raft_consensus.cc:2468] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 2.
I20260709 13:19:05.696803 14227 leader_election.cc:304] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.698333 14956 raft_consensus.cc:2804] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.698710 14956 raft_consensus.cc:493] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.688618 14153 leader_election.cc:304] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c; no voters: 
I20260709 13:19:05.699069 14956 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.701071 14923 raft_consensus.cc:2804] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.701545 14923 raft_consensus.cc:697] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:05.702366 14923 consensus_queue.cc:237] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
W20260709 13:19:05.706845 14151 leader_election.cc:336] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.704795 14982 raft_consensus.cc:515] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
W20260709 13:19:05.725589 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:46091, user_credentials={real_user=slave}} blocked reactor thread for 83005.1us
I20260709 13:19:05.718887 14954 raft_consensus.cc:515] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:05.744907 14914 raft_consensus.cc:515] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.747225 14954 leader_election.cc:290] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.756552 14914 leader_election.cc:290] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
W20260709 13:19:05.761364 14151 leader_election.cc:336] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.762588 14328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14767c1f0196445ea4a179965d06965f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:05.763196 14328 raft_consensus.cc:3060] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.762042 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a259ed126849a0a6653f5d96884b87" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:05.764385 14332 raft_consensus.cc:3060] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.756870 14983 raft_consensus.cc:515] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.766901 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.766968 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:05.767606 14181 raft_consensus.cc:2468] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:05.767915 14184 raft_consensus.cc:2468] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 1.
I20260709 13:19:05.769482 14226 leader_election.cc:304] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.770433 14226 leader_election.cc:304] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.771353 14989 raft_consensus.cc:2804] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:05.771705 14989 raft_consensus.cc:493] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.771975 14999 raft_consensus.cc:2804] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:19:05.760986 14225 leader_election.cc:336] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.772096 14989 raft_consensus.cc:3060] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.767690 14983 leader_election.cc:290] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.772536 14999 raft_consensus.cc:493] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:05.772748 14010 catalog_manager.cc:5697] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:05.774361 14151 leader_election.cc:336] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.757817 14982 leader_election.cc:290] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.779582 14999 raft_consensus.cc:3060] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:05.796865 14225 leader_election.cc:336] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.798316 14225 leader_election.cc:336] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.799013 14225 leader_election.cc:336] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.803045 14945 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:05.804131 14299 leader_election.cc:336] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.805924 14945 tablet_bootstrap.cc:492] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:05.806694 14945 ts_tablet_manager.cc:1403] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.240s	user 0.023s	sys 0.004s
I20260709 13:19:05.809741 14332 raft_consensus.cc:2468] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:05.810927 14227 leader_election.cc:304] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:05.812032 14914 raft_consensus.cc:2804] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.812575 14914 raft_consensus.cc:697] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:05.813434 14914 consensus_queue.cc:237] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.815233 14920 raft_consensus.cc:515] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.818419 14945 raft_consensus.cc:359] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.819113 14945 raft_consensus.cc:740] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:05.819629 14920 leader_election.cc:290] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.819800 14945 consensus_queue.cc:260] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.826810 14152 leader_election.cc:304] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.828838 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:05.829488 14182 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.832170 14945 ts_tablet_manager.cc:1434] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:19:05.794337 14956 raft_consensus.cc:515] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.834890 14923 raft_consensus.cc:2804] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.835168 14945 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:05.835798 14923 raft_consensus.cc:697] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:05.836177 14956 leader_election.cc:290] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.837216 14970 raft_consensus.cc:515] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.839249 14970 leader_election.cc:290] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:05.839607 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:05.841886 14334 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.839236 14923 consensus_queue.cc:237] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:19:05.844239 14151 leader_election.cc:336] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.844810 14151 consensus_peers.cc:597] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:05.845968 14225 leader_election.cc:336] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.845384 14328 raft_consensus.cc:2468] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
W20260709 13:19:05.850610 14225 leader_election.cc:336] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.855578 14227 leader_election.cc:304] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.852392 14182 raft_consensus.cc:2468] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:05.865142 15002 raft_consensus.cc:2804] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.865782 14226 leader_election.cc:304] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
W20260709 13:19:05.870474 14299 leader_election.cc:336] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.872872 14225 leader_election.cc:336] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:05.873829 14225 leader_election.cc:336] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.873893 14999 raft_consensus.cc:515] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.874845 14994 raft_consensus.cc:2804] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.875402 14994 raft_consensus.cc:697] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:05.876305 14994 consensus_queue.cc:237] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.879165 14989 raft_consensus.cc:515] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.866324 15002 raft_consensus.cc:697] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:05.880931 15002 consensus_queue.cc:237] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
W20260709 13:19:05.884176 14225 leader_election.cc:336] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.890848 14334 raft_consensus.cc:2468] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:05.899820 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965959c6060c4e31872a4d63bb4cc3d8" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:05.900504 14253 raft_consensus.cc:3060] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.904464 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dfcde74e8344c17a4afcd878be63bbb" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:05.905099 14261 raft_consensus.cc:3060] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.908927 14253 raft_consensus.cc:2468] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 2.
I20260709 13:19:05.913683 14261 raft_consensus.cc:2468] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 2.
I20260709 13:19:05.927449 14989 leader_election.cc:290] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.927884 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:05.928579 14184 raft_consensus.cc:3060] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:05.932389 14225 leader_election.cc:336] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:05.934585 14253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb043e88ddb1409188b19489adb77959" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:05.935374 14253 raft_consensus.cc:2468] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 1.
I20260709 13:19:05.934801 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fc5acb16ea44ef882abb6d9013b2848" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:05.937148 14255 raft_consensus.cc:3060] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.940500 14184 raft_consensus.cc:2468] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:05.941893 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc372b890581484a9c147f584264c31f" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:05.942229 14226 leader_election.cc:304] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.942752 14182 raft_consensus.cc:3060] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.943524 14989 raft_consensus.cc:2804] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.944326 14989 raft_consensus.cc:697] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:05.944408 14255 raft_consensus.cc:2468] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 2.
I20260709 13:19:05.945466 14989 consensus_queue.cc:237] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:05.959865 14227 leader_election.cc:304] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.961668 14914 raft_consensus.cc:2804] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:19:05.966346 14151 consensus_peers.cc:597] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:05.966168 14914 raft_consensus.cc:697] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:05.970544 14914 consensus_queue.cc:237] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:05.941249 14999 leader_election.cc:290] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:05.971987 14261 raft_consensus.cc:1275] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:05.980944 14152 leader_election.cc:304] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.985545 14152 leader_election.cc:304] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.976408 14182 raft_consensus.cc:2468] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:05.990550 14300 leader_election.cc:304] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.995788 14300 leader_election.cc:304] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:06.006927 14987 raft_consensus.cc:2804] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.007712 14987 raft_consensus.cc:697] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:06.008865 14987 consensus_queue.cc:237] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:06.011557 14226 leader_election.cc:304] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:05.996814 14978 raft_consensus.cc:2804] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:05.996084 14923 consensus_queue.cc:1048] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:19:06.005894 14981 raft_consensus.cc:2804] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:06.015220 14981 raft_consensus.cc:493] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:06.015587 14981 raft_consensus.cc:3060] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.019562 14945 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:06.006263 14967 raft_consensus.cc:2804] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.020299 14978 raft_consensus.cc:697] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:06.020973 14967 raft_consensus.cc:697] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
W20260709 13:19:06.049659 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 54314.3us
I20260709 13:19:06.052981 14945 tablet_bootstrap.cc:492] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
W20260709 13:19:06.050379 14152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 57349.1us
I20260709 13:19:06.053978 14945 ts_tablet_manager.cc:1403] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.219s	user 0.022s	sys 0.011s
I20260709 13:19:06.046712 15002 raft_consensus.cc:2804] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.065303 14010 catalog_manager.cc:5697] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.073624 14010 catalog_manager.cc:5697] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.074572 14261 raft_consensus.cc:1275] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.075996 15002 raft_consensus.cc:697] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:06.075135 14010 catalog_manager.cc:5697] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.070250 14008 catalog_manager.cc:5697] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 2 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.086530 14008 catalog_manager.cc:5697] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 2 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.089689 14008 catalog_manager.cc:5697] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 2 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.090848 14008 catalog_manager.cc:5697] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 2 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.055626 14967 consensus_queue.cc:237] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.088807 14947 consensus_queue.cc:1048] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:19:06.103513 15011 log.cc:927] Time spent T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:06.107751 14334 raft_consensus.cc:1275] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.113130 14981 raft_consensus.cc:515] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:06.114284 14914 consensus_queue.cc:1048] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:06.099750 14945 raft_consensus.cc:359] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:06.117301 14945 raft_consensus.cc:740] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.118919 14945 consensus_queue.cc:260] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:06.144254 14945 ts_tablet_manager.cc:1434] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 13:19:06.146935 14945 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:06.131271 14978 consensus_queue.cc:237] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.153271 14981 leader_election.cc:290] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Requested vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:06.148809 15002 consensus_queue.cc:237] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:19:06.206048 14225 consensus_peers.cc:597] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.223008 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb043e88ddb1409188b19489adb77959" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:06.223706 14261 raft_consensus.cc:3060] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.263164 14261 raft_consensus.cc:2468] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 2.
I20260709 13:19:06.269794 14152 leader_election.cc:304] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:06.277884 14331 raft_consensus.cc:1275] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:06.278095 14225 consensus_peers.cc:597] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.318485 14151 leader_election.cc:336] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:06.295701 14335 raft_consensus.cc:1275] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.300781 14945 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:06.321900 14945 tablet_bootstrap.cc:492] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
W20260709 13:19:06.314453 14299 consensus_peers.cc:597] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:06.320823 14151 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 50918.3us
I20260709 13:19:06.322584 14945 ts_tablet_manager.cc:1403] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.001s
I20260709 13:19:06.325245 14945 raft_consensus.cc:359] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.325927 14945 raft_consensus.cc:740] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.325063 14010 catalog_manager.cc:5697] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.326694 14945 consensus_queue.cc:260] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.328845 14945 ts_tablet_manager.cc:1434] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:19:06.329576 14945 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:19:06.334280 14299 consensus_peers.cc:597] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:06.337716 15029 consensus_queue.cc:1048] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:06.339215 15029 consensus_queue.cc:1048] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:06.341501 14225 consensus_peers.cc:597] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.344794 14151 consensus_peers.cc:597] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.345484 14151 consensus_peers.cc:597] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.350499 14980 raft_consensus.cc:2804] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.351140 14980 raft_consensus.cc:697] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:06.352294 14980 consensus_queue.cc:237] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:19:06.360387 14152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 90741.9us
I20260709 13:19:06.326936 14010 catalog_manager.cc:5697] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:06.369328 14225 consensus_peers.cc:597] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.377431 14328 raft_consensus.cc:1275] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.371507 14010 catalog_manager.cc:5697] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.380843 15002 consensus_queue.cc:1048] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:06.385870 14334 raft_consensus.cc:1275] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.388870 14008 catalog_manager.cc:5697] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.373966 14009 catalog_manager.cc:5697] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 2 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.401149 14008 catalog_manager.cc:5697] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.409190 15002 consensus_queue.cc:1048] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:06.409963 14299 consensus_peers.cc:597] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:06.406409 14225 consensus_peers.cc:597] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:06.410593 14945 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:06.412325 14945 tablet_bootstrap.cc:492] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:06.412985 14945 ts_tablet_manager.cc:1403] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.000s
I20260709 13:19:06.414440 14256 raft_consensus.cc:1275] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.416564 14945 raft_consensus.cc:359] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:06.417280 14945 raft_consensus.cc:740] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.418128 14945 consensus_queue.cc:260] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:06.419737 14945 ts_tablet_manager.cc:1434] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:06.420476 14945 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:06.457331 15019 consensus_queue.cc:1048] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:06.456868 14256 raft_consensus.cc:1275] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:06.455041 14151 consensus_peers.cc:597] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.465548 14299 consensus_peers.cc:597] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:06.471619 14225 consensus_peers.cc:597] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.485440 14181 raft_consensus.cc:1275] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.487480 15002 consensus_queue.cc:1048] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.488217 14945 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:06.489233 14945 tablet_bootstrap.cc:492] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:06.489876 14945 ts_tablet_manager.cc:1403] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.000s
I20260709 13:19:06.493268 14945 raft_consensus.cc:359] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.493942 14945 raft_consensus.cc:740] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.494697 14945 consensus_queue.cc:260] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.499006 14945 ts_tablet_manager.cc:1434] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:06.499797 14945 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:06.509322 14184 raft_consensus.cc:1275] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.511219 14914 consensus_queue.cc:1048] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.526818 14945 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:06.527864 14945 tablet_bootstrap.cc:492] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:06.528532 14945 ts_tablet_manager.cc:1403] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.004s
I20260709 13:19:06.531141 14945 raft_consensus.cc:359] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.531826 14945 raft_consensus.cc:740] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
W20260709 13:19:06.531976 14225 consensus_peers.cc:597] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:06.532765 14945 consensus_queue.cc:260] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.535086 14945 ts_tablet_manager.cc:1434] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:06.535869 14945 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:19:06.538836 14225 consensus_peers.cc:597] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.551136 14008 catalog_manager.cc:5697] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 1 to 2, leader changed from 675788979b2e4a89be45b2af4fa3141a (127.6.233.1) to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 2 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:06.556746 14945 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:06.557696 14945 tablet_bootstrap.cc:492] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:06.558300 14945 ts_tablet_manager.cc:1403] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 13:19:06.560922 14945 raft_consensus.cc:359] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:06.561570 14945 raft_consensus.cc:740] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.562486 14945 consensus_queue.cc:260] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:06.564800 14945 ts_tablet_manager.cc:1434] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:06.565793 14945 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:06.588984 14945 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:06.590197 14945 tablet_bootstrap.cc:492] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:06.590976 14945 ts_tablet_manager.cc:1403] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:19:06.594115 14945 raft_consensus.cc:359] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:06.594962 14945 raft_consensus.cc:740] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:06.595745 14945 consensus_queue.cc:260] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:06.596459 15033 consensus_queue.cc:1048] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.598297 14945 ts_tablet_manager.cc:1434] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:06.598459 14958 raft_consensus.cc:493] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.599326 14945 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:06.599035 14958 raft_consensus.cc:515] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:06.615549 14958 leader_election.cc:290] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:06.616103 14958 raft_consensus.cc:493] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.616561 14958 raft_consensus.cc:515] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:06.619388 14958 leader_election.cc:290] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
W20260709 13:19:06.632759 14299 consensus_peers.cc:597] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:06.655567 14252 raft_consensus.cc:1275] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 0646b0acb9c943b59389eace852a5215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:06.681156 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 48462us
I20260709 13:19:06.655681 14255 raft_consensus.cc:1275] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 0646b0acb9c943b59389eace852a5215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.663893 14332 raft_consensus.cc:1275] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.672621 15073 raft_consensus.cc:493] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.683121 15073 raft_consensus.cc:515] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:06.686452 15073 leader_election.cc:290] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:06.696234 15016 consensus_queue.cc:1048] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:06.698906 15016 consensus_queue.cc:1048] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:06.672935 14225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 51886.2us
W20260709 13:19:06.755069 14299 consensus_peers.cc:597] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:06.790798 14999 consensus_queue.cc:1048] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:06.824401 14225 consensus_peers.cc:597] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:06.831614 14945 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:06.833129 14945 tablet_bootstrap.cc:492] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:06.833199 14181 raft_consensus.cc:1275] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.834163 14945 ts_tablet_manager.cc:1403] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.235s	user 0.065s	sys 0.093s
I20260709 13:19:06.835289 14914 consensus_queue.cc:1048] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:06.837821 14945 raft_consensus.cc:359] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.838842 14945 raft_consensus.cc:740] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
W20260709 13:19:06.855526 14151 consensus_peers.cc:597] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:06.856674 14151 consensus_peers.cc:597] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:06.864189 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 108608us
I20260709 13:19:06.839869 14945 consensus_queue.cc:260] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:06.874486 14945 ts_tablet_manager.cc:1434] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:19:06.955518 14945 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:19:06.958297 14151 consensus_peers.cc:597] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:06.958954 14151 consensus_peers.cc:597] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:06.959446 14151 consensus_peers.cc:597] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:06.962679 14227 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.4:40795, user_credentials={real_user=slave}} blocked reactor thread for 59596.6us
W20260709 13:19:06.965094 14151 consensus_peers.cc:597] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:06.965646 14151 consensus_peers.cc:597] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:06.987974 15073 raft_consensus.cc:493] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.003657 15073 raft_consensus.cc:515] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.006348 15073 leader_election.cc:290] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
W20260709 13:19:07.013612 14225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 124103us
W20260709 13:19:07.025301 14151 consensus_peers.cc:597] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:07.051434 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e519b3fde754be785619f806259cbcb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:07.059826 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
W20260709 13:19:07.058177 14300 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:35883, user_credentials={real_user=slave}} blocked reactor thread for 81433.5us
I20260709 13:19:07.043001 15073 raft_consensus.cc:493] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.070046 15073 raft_consensus.cc:515] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.072036 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:07.074281 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:07.076241 15073 leader_election.cc:290] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
W20260709 13:19:07.092451 14151 consensus_peers.cc:597] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:07.093320 14151 consensus_peers.cc:597] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:07.068950 14299 consensus_peers.cc:597] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:07.109287 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44db1fb7c007438398ce78e1bf686291" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:07.112985 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e519b3fde754be785619f806259cbcb" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:07.113343 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:07.107620 15073 raft_consensus.cc:493] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.116015 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2074eb6b644c7f926c78e9ded22c1c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:07.117617 15073 raft_consensus.cc:515] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.119639 15073 leader_election.cc:290] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
W20260709 13:19:07.120615 14225 consensus_peers.cc:597] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:07.121343 14225 consensus_peers.cc:597] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:07.121769 14225 consensus_peers.cc:597] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:07.122207 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:07.125885 14258 raft_consensus.cc:1275] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.129612 14941 leader_election.cc:304] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:07.130990 15073 raft_consensus.cc:2749] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.132205 14941 leader_election.cc:304] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:07.133370 15073 raft_consensus.cc:2749] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:07.135277 14225 consensus_peers.cc:597] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:07.137122 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
I20260709 13:19:07.141111 14941 leader_election.cc:304] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:07.150791 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6" is_pre_election: true
W20260709 13:19:07.155968 14299 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 55208.8us
I20260709 13:19:07.148070 15073 raft_consensus.cc:2749] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.170058 15092 consensus_queue.cc:1048] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:19:07.177049 14942 leader_election.cc:304] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
W20260709 13:19:07.182900 14225 consensus_peers.cc:597] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:07.184319 14945 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.189864 14942 leader_election.cc:304] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:07.190400 14945 tablet_bootstrap.cc:492] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.191148 14945 ts_tablet_manager.cc:1403] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.236s	user 0.018s	sys 0.007s
I20260709 13:19:07.191143 15073 raft_consensus.cc:2749] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.193104 15073 raft_consensus.cc:2749] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:07.194998 14299 consensus_peers.cc:597] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:07.198128 14945 raft_consensus.cc:359] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.199091 14945 raft_consensus.cc:740] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.200027 14945 consensus_queue.cc:260] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.204524 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:07.208352 14945 ts_tablet_manager.cc:1434] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:19:07.209625 14945 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:19:07.212330 14299 consensus_peers.cc:597] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:07.226336 14942 leader_election.cc:304] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:07.227571 15107 raft_consensus.cc:2749] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:07.241775 14299 consensus_peers.cc:597] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:07.244342 14299 consensus_peers.cc:597] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:07.244784 14299 consensus_peers.cc:597] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:07.245297 14299 consensus_peers.cc:597] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:07.245666 14299 consensus_peers.cc:597] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:07.246619 14299 consensus_peers.cc:597] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:07.241806 14151 consensus_peers.cc:597] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:07.251216 14945 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.252024 14945 tablet_bootstrap.cc:492] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.252691 14945 ts_tablet_manager.cc:1403] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.003s
I20260709 13:19:07.255748 14945 raft_consensus.cc:359] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.256412 14945 raft_consensus.cc:740] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.257171 14945 consensus_queue.cc:260] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.259776 14945 ts_tablet_manager.cc:1434] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:07.260504 14945 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.292156 14945 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.293179 14945 tablet_bootstrap.cc:492] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.293845 14945 ts_tablet_manager.cc:1403] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.001s
I20260709 13:19:07.295183  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:34585
I20260709 13:19:07.295315 15124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:34585 every 8 connection(s)
I20260709 13:19:07.296767 14945 raft_consensus.cc:359] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.297600 14945 raft_consensus.cc:740] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.298339 14945 consensus_queue.cc:260] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.300557 14945 ts_tablet_manager.cc:1434] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:07.301391 14945 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.354310 14945 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.355285 14945 tablet_bootstrap.cc:492] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.355937 14945 ts_tablet_manager.cc:1403] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.009s
I20260709 13:19:07.358887 14945 raft_consensus.cc:359] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.359573 14945 raft_consensus.cc:740] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.359633 15125 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33061
I20260709 13:19:07.360244 15125 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:07.360214 14945 consensus_queue.cc:260] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.361369 15125 heartbeater.cc:507] Master 127.6.233.62:33061 requested a full tablet report, sending...
I20260709 13:19:07.361886 14945 ts_tablet_manager.cc:1434] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:07.362556 14945 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.370743 15059 raft_consensus.cc:3060] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.374780 15056 raft_consensus.cc:3060] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.412561 14945 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.413471 14945 tablet_bootstrap.cc:492] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.414124 14945 ts_tablet_manager.cc:1403] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.027s
I20260709 13:19:07.416662 14945 raft_consensus.cc:359] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.417320 14945 raft_consensus.cc:740] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.417960 14945 consensus_queue.cc:260] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.420362 14945 ts_tablet_manager.cc:1434] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:07.421250 14945 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.443517 14945 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.444615 14945 tablet_bootstrap.cc:492] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.445297 14945 ts_tablet_manager.cc:1403] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:19:07.448922 14945 raft_consensus.cc:359] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.449664 14945 raft_consensus.cc:740] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.450419 14945 consensus_queue.cc:260] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.454902 14945 ts_tablet_manager.cc:1434] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:19:07.456679 14945 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.460796 14009 ts_manager.cc:194] Re-registered known tserver with Master: 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:07.497586 15045 raft_consensus.cc:3060] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.527173 15059 raft_consensus.cc:3060] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.572073 14945 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.573098 14945 tablet_bootstrap.cc:492] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.574211 14945 ts_tablet_manager.cc:1403] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.118s	user 0.041s	sys 0.042s
I20260709 13:19:07.578322 14945 raft_consensus.cc:359] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.580088 14945 raft_consensus.cc:740] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.581159 14945 consensus_queue.cc:260] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.583648 14945 ts_tablet_manager.cc:1434] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:19:07.584542 14945 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.620574 14945 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.622704 15107 raft_consensus.cc:493] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.627413 15107 raft_consensus.cc:515] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.629134 14945 tablet_bootstrap.cc:492] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.629758 15107 leader_election.cc:290] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:07.631150 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddcb989aef4c9fa869766c3682632c" is_pre_election: true
I20260709 13:19:07.632366 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d4f8d14e954ef5af8eb1736629b53b" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0646b0acb9c943b59389eace852a5215" is_pre_election: true
I20260709 13:19:07.636237 14941 leader_election.cc:304] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a; no voters: 0646b0acb9c943b59389eace852a5215, 45ddcb989aef4c9fa869766c3682632c
I20260709 13:19:07.641307 15073 raft_consensus.cc:2749] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.643285 15059 raft_consensus.cc:3060] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.624249 14009 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33600
I20260709 13:19:07.629935 14945 ts_tablet_manager.cc:1403] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.010s
I20260709 13:19:07.647724 14945 raft_consensus.cc:359] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.648397 14945 raft_consensus.cc:740] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.649307 14945 consensus_queue.cc:260] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:07.651515 14945 ts_tablet_manager.cc:1434] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:07.652307 14945 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.664953 15125 heartbeater.cc:499] Master 127.6.233.62:33061 was elected leader, sending a full tablet report...
I20260709 13:19:07.677510 15045 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.679411 15056 raft_consensus.cc:3060] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.735018 14945 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.736037 14945 tablet_bootstrap.cc:492] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.736727 14945 ts_tablet_manager.cc:1403] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.007s
I20260709 13:19:07.739712 14945 raft_consensus.cc:359] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.741245 14945 raft_consensus.cc:740] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.741896 14945 consensus_queue.cc:260] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.744515 14945 ts_tablet_manager.cc:1434] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:19:07.745785 14945 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.762804 14945 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.763687 14945 tablet_bootstrap.cc:492] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.764394 14945 ts_tablet_manager.cc:1403] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:19:07.767149 14945 raft_consensus.cc:359] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.767849 14945 raft_consensus.cc:740] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.768617 14945 consensus_queue.cc:260] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.771695 14945 ts_tablet_manager.cc:1434] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:07.772578 14945 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.788916 14945 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.789883 14945 tablet_bootstrap.cc:492] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.790573 14945 ts_tablet_manager.cc:1403] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:19:07.793183 14945 raft_consensus.cc:359] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.793905 14945 raft_consensus.cc:740] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.794634 14945 consensus_queue.cc:260] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.796898 14945 ts_tablet_manager.cc:1434] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:07.800534 14945 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.815721 14945 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.817036 14945 tablet_bootstrap.cc:492] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.817649 14945 ts_tablet_manager.cc:1403] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:19:07.819798 14945 raft_consensus.cc:359] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.820353 14945 raft_consensus.cc:740] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.820989 14945 consensus_queue.cc:260] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.822765 14945 ts_tablet_manager.cc:1434] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:19:07.823803 14945 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.856120 14945 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.856959 14945 tablet_bootstrap.cc:492] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.857560 14945 ts_tablet_manager.cc:1403] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.010s
I20260709 13:19:07.861796 14945 raft_consensus.cc:359] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.862466 14945 raft_consensus.cc:740] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.863099 14945 consensus_queue.cc:260] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.864989 14945 ts_tablet_manager.cc:1434] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:07.866307 14945 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.891047 14945 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.892097 14945 tablet_bootstrap.cc:492] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.892788 14945 ts_tablet_manager.cc:1403] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.001s
I20260709 13:19:07.895478 14945 raft_consensus.cc:359] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.896261 14945 raft_consensus.cc:740] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.896929 14945 consensus_queue.cc:260] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:07.899560 14945 ts_tablet_manager.cc:1434] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:07.900380 14945 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.917934 14945 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.919014 14945 tablet_bootstrap.cc:492] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.919625 14945 ts_tablet_manager.cc:1403] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:19:07.921774 14945 raft_consensus.cc:359] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.922266 14945 raft_consensus.cc:740] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.922926 14945 consensus_queue.cc:260] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.924516 14945 ts_tablet_manager.cc:1434] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:19:07.925390 14945 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:07.980504 14945 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:07.981405 14945 tablet_bootstrap.cc:492] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:07.982046 14945 ts_tablet_manager.cc:1403] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.017s
I20260709 13:19:07.984581 14945 raft_consensus.cc:359] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.985245 14945 raft_consensus.cc:740] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.985889 14945 consensus_queue.cc:260] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:07.987891 14945 ts_tablet_manager.cc:1434] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:07.989143 14945 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.050107 14945 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.051100 14945 tablet_bootstrap.cc:492] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.051762 14945 ts_tablet_manager.cc:1403] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.000s
I20260709 13:19:08.054821 14945 raft_consensus.cc:359] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.055542 14945 raft_consensus.cc:740] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.056670 14945 consensus_queue.cc:260] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.059026 14945 ts_tablet_manager.cc:1434] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:19:08.059801 14945 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.104146 14945 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.105767 14945 tablet_bootstrap.cc:492] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.106427 14945 ts_tablet_manager.cc:1403] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.002s
I20260709 13:19:08.108882 14945 raft_consensus.cc:359] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:08.109506 14945 raft_consensus.cc:740] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.110271 14945 consensus_queue.cc:260] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:08.112116 14945 ts_tablet_manager.cc:1434] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:19:08.119959 14945 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:19:08.125598 14225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 65676.9us
I20260709 13:19:08.157711 15056 raft_consensus.cc:3060] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.232687 15056 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.265054 14945 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.266018 14945 tablet_bootstrap.cc:492] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.266654 14945 ts_tablet_manager.cc:1403] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.147s	user 0.051s	sys 0.045s
I20260709 13:19:08.273823 14945 raft_consensus.cc:359] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:08.275473 14945 raft_consensus.cc:740] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.276249 14945 consensus_queue.cc:260] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:08.278420 14945 ts_tablet_manager.cc:1434] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:19:08.279201 14945 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.307394 14945 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.309170 14945 tablet_bootstrap.cc:492] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.309887 14945 ts_tablet_manager.cc:1403] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.005s
I20260709 13:19:08.312611 14945 raft_consensus.cc:359] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.313459 14945 raft_consensus.cc:740] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.314198 14945 consensus_queue.cc:260] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.316015 14945 ts_tablet_manager.cc:1434] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:19:08.317216 14945 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.331555 14945 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.332589 14945 tablet_bootstrap.cc:492] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.333266 14945 ts_tablet_manager.cc:1403] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:19:08.336131 14945 raft_consensus.cc:359] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.336681 14945 raft_consensus.cc:740] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.337210 14945 consensus_queue.cc:260] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.339231 14945 ts_tablet_manager.cc:1434] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:19:08.340060 14945 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.368428 14945 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.369482 14945 tablet_bootstrap.cc:492] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.370255 14945 ts_tablet_manager.cc:1403] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.002s
I20260709 13:19:08.373394 14945 raft_consensus.cc:359] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.374277 14945 raft_consensus.cc:740] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.375111 14945 consensus_queue.cc:260] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.377238 14945 ts_tablet_manager.cc:1434] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:08.381645 14945 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.398090 15056 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.423777 14945 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.424775 14945 tablet_bootstrap.cc:492] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.463778 14945 ts_tablet_manager.cc:1403] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.016s
W20260709 13:19:08.478556 14225 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:34585, user_credentials={real_user=slave}} blocked reactor thread for 50805.4us
W20260709 13:19:08.479636 14151 consensus_peers.cc:597] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:08.501259 14945 raft_consensus.cc:359] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.501986 14945 raft_consensus.cc:740] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.502506 14945 consensus_queue.cc:260] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.504500 14945 ts_tablet_manager.cc:1434] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 13:19:08.505257 14945 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.533838 14945 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.539409 14945 tablet_bootstrap.cc:492] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.540119 14945 ts_tablet_manager.cc:1403] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.005s
I20260709 13:19:08.542704 14945 raft_consensus.cc:359] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.543345 14945 raft_consensus.cc:740] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.544015 14945 consensus_queue.cc:260] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
W20260709 13:19:08.556828 14299 consensus_peers.cc:597] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:08.557461 14945 ts_tablet_manager.cc:1434] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:19:08.559346 14945 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
W20260709 13:19:08.578903 14299 consensus_peers.cc:597] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:08.602435 14945 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.603477 14945 tablet_bootstrap.cc:492] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.604166 14945 ts_tablet_manager.cc:1403] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.023s
I20260709 13:19:08.607962 14945 raft_consensus.cc:359] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.608692 14945 raft_consensus.cc:740] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.609345 14945 consensus_queue.cc:260] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.612206 14945 ts_tablet_manager.cc:1434] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:08.616391 14945 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.632092 14945 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.632997 14945 tablet_bootstrap.cc:492] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.633630 14945 ts_tablet_manager.cc:1403] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 13:19:08.635975 14945 raft_consensus.cc:359] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.636677 14945 raft_consensus.cc:740] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.637332 14945 consensus_queue.cc:260] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.639307 14945 ts_tablet_manager.cc:1434] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:08.640166 14945 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.657641 14945 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.658350 14945 tablet_bootstrap.cc:492] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.658933 14945 ts_tablet_manager.cc:1403] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:19:08.660725 14945 raft_consensus.cc:359] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:08.661202 14945 raft_consensus.cc:740] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.661713 14945 consensus_queue.cc:260] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:08.663726 14945 ts_tablet_manager.cc:1434] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:08.665246 14945 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.680402 14945 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.681463 14945 tablet_bootstrap.cc:492] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.682183 14945 ts_tablet_manager.cc:1403] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:19:08.684294 14945 raft_consensus.cc:359] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.685065 14945 raft_consensus.cc:740] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.685755 14945 consensus_queue.cc:260] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:08.687851 14945 ts_tablet_manager.cc:1434] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:08.688544 14945 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.722797 14945 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.723691 14945 tablet_bootstrap.cc:492] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.724404 14945 ts_tablet_manager.cc:1403] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.008s
I20260709 13:19:08.726949 14945 raft_consensus.cc:359] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.727722 14945 raft_consensus.cc:740] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.728454 14945 consensus_queue.cc:260] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:08.730577 14945 ts_tablet_manager.cc:1434] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 13:19:08.734871 14225 consensus_peers.cc:597] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:08.735117 14945 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.754482 15056 raft_consensus.cc:3060] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.797102 14945 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.798338 14945 tablet_bootstrap.cc:492] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.798957 14945 ts_tablet_manager.cc:1403] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.000s
I20260709 13:19:08.801303 14945 raft_consensus.cc:359] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:08.803980 14945 raft_consensus.cc:740] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.809494 14945 consensus_queue.cc:260] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:08.811766 14945 ts_tablet_manager.cc:1434] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:08.813874 14945 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap starting.
I20260709 13:19:08.830626 14945 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:08.831663 14945 tablet_bootstrap.cc:492] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Bootstrap complete.
I20260709 13:19:08.832429 14945 ts_tablet_manager.cc:1403] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:19:08.835310 14945 raft_consensus.cc:359] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:08.836150 14945 raft_consensus.cc:740] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Initialized, Role: FOLLOWER
I20260709 13:19:08.836956 14945 consensus_queue.cc:260] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:08.839565 14945 ts_tablet_manager.cc:1434] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:19:08.925794 15056 raft_consensus.cc:3060] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.936312 15045 raft_consensus.cc:3060] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.953651 15056 raft_consensus.cc:3060] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.974502 15056 raft_consensus.cc:3060] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.117267 15056 raft_consensus.cc:3060] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.317545  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:17.371001 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "183a076c0e614a54b0a8875f351528a3"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:17.371726 14331 raft_consensus.cc:606] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:17.388620 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1"
dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:56086
I20260709 13:19:17.389253 14181 raft_consensus.cc:606] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:17.395223 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:17.395823 14331 raft_consensus.cc:606] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:17.398638 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54d9e8510eb240098e1916592b497767"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:17.399087 14332 raft_consensus.cc:606] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:17.401691 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:17.402179 14332 raft_consensus.cc:606] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:17.404788 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:17.405283 14332 raft_consensus.cc:606] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:17.406250  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:17.407855  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:17.441555 15203 raft_consensus.cc:993] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.448740 15197 raft_consensus.cc:1081] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.452301 15056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40808
I20260709 13:19:17.452924 15056 raft_consensus.cc:493] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:17.453323 15056 raft_consensus.cc:3060] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.464600 15194 raft_consensus.cc:993] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.465126 15194 raft_consensus.cc:1081] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.466492 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54d9e8510eb240098e1916592b497767"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40812
I20260709 13:19:17.466934 15044 raft_consensus.cc:493] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:17.467278 15044 raft_consensus.cc:3060] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.466676 15056 raft_consensus.cc:515] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.469113 15056 leader_election.cc:290] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:17.469863 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:17.470628 14332 raft_consensus.cc:3060] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.471220 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34dc4074ff05452dbda3ce53bbc859f1" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:17.471814 14184 raft_consensus.cc:3055] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:17.472105 14184 raft_consensus.cc:740] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:17.472986 14184 consensus_queue.cc:260] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.474346 14184 raft_consensus.cc:3060] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.473323 15044 raft_consensus.cc:515] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:17.477977 15193 raft_consensus.cc:993] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.478416 15194 raft_consensus.cc:1081] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.479830 14332 raft_consensus.cc:2468] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.480508 15045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "183a076c0e614a54b0a8875f351528a3"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40812
I20260709 13:19:17.481005 15045 raft_consensus.cc:493] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:17.481364 15045 raft_consensus.cc:3060] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.481808 14942 leader_election.cc:304] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:17.482506 14184 raft_consensus.cc:2468] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.483690 15044 leader_election.cc:290] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:17.485088 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:17.485646 14258 raft_consensus.cc:3060] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.494720 14258 raft_consensus.cc:2468] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.496165 14941 leader_election.cc:304] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:17.496342 15045 raft_consensus.cc:515] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.498404 15045 leader_election.cc:290] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:17.499833 15207 raft_consensus.cc:2804] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:17.500931 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d9e8510eb240098e1916592b497767" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:17.501405 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183a076c0e614a54b0a8875f351528a3" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:17.502337 14332 raft_consensus.cc:3055] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:17.502626 14331 raft_consensus.cc:3055] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:17.502725 15209 raft_consensus.cc:2804] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:17.503230 14331 raft_consensus.cc:740] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:17.504799 14331 consensus_queue.cc:260] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.502678 14332 raft_consensus.cc:740] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:17.506366 14331 raft_consensus.cc:3060] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.507210 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "183a076c0e614a54b0a8875f351528a3" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:17.507784 14184 raft_consensus.cc:3060] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.508435 15194 raft_consensus.cc:993] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.506033 15207 raft_consensus.cc:697] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:17.508949 15194 raft_consensus.cc:1081] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.508209 14332 consensus_queue.cc:260] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:17.509768 15207 consensus_queue.cc:237] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.510510 15045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40812
I20260709 13:19:17.511011 15045 raft_consensus.cc:493] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:17.511343 15045 raft_consensus.cc:3060] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.506366 15209 raft_consensus.cc:697] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:17.516394 14332 raft_consensus.cc:3060] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.517412 14184 raft_consensus.cc:2468] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.515444 15209 consensus_queue.cc:237] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:17.518321 14941 leader_election.cc:304] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:17.520466 15045 raft_consensus.cc:515] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.522156 15211 raft_consensus.cc:2804] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:17.522691 15211 raft_consensus.cc:697] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:17.524281 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:17.524367 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9afc388a1546c28fcf9777a5e31674" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:17.524932 14184 raft_consensus.cc:3060] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.525004 14335 raft_consensus.cc:3055] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:17.525374 14335 raft_consensus.cc:740] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:17.526127 14335 consensus_queue.cc:260] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.527197 14335 raft_consensus.cc:3060] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.528003 15211 consensus_queue.cc:237] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.532712 14331 raft_consensus.cc:2468] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.536147 15193 raft_consensus.cc:993] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215: : Instructing follower c19f7f4ddb074bd8997d01296c3080d6 to start an election
I20260709 13:19:17.536548 15194 raft_consensus.cc:1081] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer c19f7f4ddb074bd8997d01296c3080d6 to start an election
I20260709 13:19:17.536656 14332 raft_consensus.cc:2468] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.538630 14258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9"
dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
 from {username='slave'} at 127.0.0.1:55592
I20260709 13:19:17.538859 14335 raft_consensus.cc:2468] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.539139 14258 raft_consensus.cc:493] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:17.539505 14258 raft_consensus.cc:3060] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.539575 15045 leader_election.cc:290] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:17.540104 14942 leader_election.cc:304] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:17.544201 15209 raft_consensus.cc:2804] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:17.544873 15209 raft_consensus.cc:697] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:17.545773 15209 consensus_queue.cc:237] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:17.546710 14258 raft_consensus.cc:515] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:17.570616 14258 leader_election.cc:290] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:17.571233 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:17.571969 14181 raft_consensus.cc:3060] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.572808 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a98c83dfc34effa3050c2c8c0121f9" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:17.573434 14335 raft_consensus.cc:3055] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:17.573715 14335 raft_consensus.cc:740] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:17.573040 14009 catalog_manager.cc:5697] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 45ddcb989aef4c9fa869766c3682632c (127.6.233.2) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.574508 14335 consensus_queue.cc:260] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:17.575821 14335 raft_consensus.cc:3060] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.579263 14181 raft_consensus.cc:2468] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:17.580478 14226 leader_election.cc:304] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:17.581365 15198 raft_consensus.cc:2804] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:17.582123 15198 raft_consensus.cc:697] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:17.583022 15198 consensus_queue.cc:237] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:17.585909 14184 raft_consensus.cc:2468] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.589359 14335 raft_consensus.cc:2468] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:17.596836 15193 raft_consensus.cc:993] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.597491 15193 raft_consensus.cc:1081] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:17.599218 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40812
I20260709 13:19:17.599884 15044 raft_consensus.cc:493] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:17.600291 15044 raft_consensus.cc:3060] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.606539 14010 catalog_manager.cc:5697] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.607586 15044 raft_consensus.cc:515] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:17.610790 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:17.611279 14184 raft_consensus.cc:3060] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.618984 15044 leader_election.cc:290] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:17.619122 14184 raft_consensus.cc:2468] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.619997 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ccef079cb964f8a83bfcafbe3f15e74" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:17.620667 14335 raft_consensus.cc:3055] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:17.620981 14335 raft_consensus.cc:740] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:17.621219 14941 leader_election.cc:304] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:17.622044 15207 raft_consensus.cc:2804] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:17.621615 14009 catalog_manager.cc:5697] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.622560 15207 raft_consensus.cc:697] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:17.621776 14335 consensus_queue.cc:260] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:17.623560 15207 consensus_queue.cc:237] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:17.623354 14009 catalog_manager.cc:5697] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.625198 14335 raft_consensus.cc:3060] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:17.625269 14009 catalog_manager.cc:5697] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.632609 14335 raft_consensus.cc:2468] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:17.643647 14009 catalog_manager.cc:5697] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.896705 14185 raft_consensus.cc:1275] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:17.897907 15207 consensus_queue.cc:1048] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:17.907790 14335 raft_consensus.cc:1275] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:17.914093 15211 consensus_queue.cc:1048] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:17.948865 14335 raft_consensus.cc:1275] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:17.950026 15211 consensus_queue.cc:1048] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:17.954411 14331 raft_consensus.cc:1275] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:17.957240 15211 consensus_queue.cc:1048] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:17.962047 14258 raft_consensus.cc:1275] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:17.963609 15209 consensus_queue.cc:1048] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:17.976742 14185 raft_consensus.cc:1275] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:17.979583 15209 consensus_queue.cc:1048] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:18.094439 14185 raft_consensus.cc:1275] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:18.096225 15209 consensus_queue.cc:1048] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:18.106419 14331 raft_consensus.cc:1275] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:18.108222 15211 consensus_queue.cc:1048] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:18.109808 14331 raft_consensus.cc:1275] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:18.112385 15199 consensus_queue.cc:1048] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:18.118646 14185 raft_consensus.cc:1275] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:18.120122 15199 consensus_queue.cc:1048] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:18.181986 14331 raft_consensus.cc:1275] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:18.186015 15211 consensus_queue.cc:1048] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:18.206998 14184 raft_consensus.cc:1275] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:18.208431 15209 consensus_queue.cc:1048] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:18.408994  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:18.445420  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:18.495553 14184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c"
dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
mode: GRACEFUL
new_leader_uuid: "0646b0acb9c943b59389eace852a5215"
 from {username='slave'} at 127.0.0.1:56086
I20260709 13:19:18.496167 14184 raft_consensus.cc:606] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Received request to transfer leadership to TS 0646b0acb9c943b59389eace852a5215
I20260709 13:19:18.498773 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f560b8d81584651b4720691469eca98"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:18.499217 14332 raft_consensus.cc:606] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:18.501576 14184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8"
dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
mode: GRACEFUL
new_leader_uuid: "0646b0acb9c943b59389eace852a5215"
 from {username='slave'} at 127.0.0.1:56086
I20260709 13:19:18.502108 14184 raft_consensus.cc:606] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Received request to transfer leadership to TS 0646b0acb9c943b59389eace852a5215
I20260709 13:19:18.517655 14258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6"
dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:41178
I20260709 13:19:18.518208 14258 raft_consensus.cc:606] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:18.520565 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:18.521031 14332 raft_consensus.cc:606] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:18.523494 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:18.523988 14332 raft_consensus.cc:606] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS c19f7f4ddb074bd8997d01296c3080d6
I20260709 13:19:18.525204  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:18.526795  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:18.541793 15238 raft_consensus.cc:993] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:18.542429 15198 raft_consensus.cc:1081] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:18.544066 15045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40800
I20260709 13:19:18.544675 15045 raft_consensus.cc:493] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:18.545053 15045 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:18.551311 15045 raft_consensus.cc:515] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:18.553328 15045 leader_election.cc:290] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 3 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:18.553846 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:18.554459 14258 raft_consensus.cc:3055] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:18.554337 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3935d54132d142e595008d4783fa0ab6" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:18.554909 14258 raft_consensus.cc:740] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:18.555143 14332 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:18.555722 14258 consensus_queue.cc:260] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:18.556672 14258 raft_consensus.cc:3060] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:18.560954 14332 raft_consensus.cc:2468] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 3.
I20260709 13:19:18.562371 14942 leader_election.cc:304] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:18.564339 15209 raft_consensus.cc:2804] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:18.564826 14258 raft_consensus.cc:2468] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 3.
I20260709 13:19:18.564872 15209 raft_consensus.cc:697] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 3 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:18.566138 15209 consensus_queue.cc:237] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:18.577720 14010 catalog_manager.cc:5697] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 2 to 3, leader changed from c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 3 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.586400 15233 raft_consensus.cc:993] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c: : Instructing follower 0646b0acb9c943b59389eace852a5215 to start an election
I20260709 13:19:18.586922 15203 raft_consensus.cc:1081] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Signalling peer 0646b0acb9c943b59389eace852a5215 to start an election
I20260709 13:19:18.588476 14332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:19:18.589015 14332 raft_consensus.cc:493] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:18.589376 14332 raft_consensus.cc:3060] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.601235 14332 raft_consensus.cc:515] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.603313 14332 leader_election.cc:290] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:18.603957 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:18.604261 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a720a9f0d4319a36fe8b4b060a5d8" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:18.604609 14184 raft_consensus.cc:3055] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:18.604866 14258 raft_consensus.cc:3060] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.604983 14184 raft_consensus.cc:740] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:18.605967 14184 consensus_queue.cc:260] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.607182 14184 raft_consensus.cc:3060] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.610332 14258 raft_consensus.cc:2468] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 2.
I20260709 13:19:18.611732 14300 leader_election.cc:304] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:18.612746 15193 raft_consensus.cc:2804] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:18.613173 15193 raft_consensus.cc:697] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:18.613884 15193 consensus_queue.cc:237] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.619982 14184 raft_consensus.cc:2468] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 2.
I20260709 13:19:18.636108 15233 raft_consensus.cc:993] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c: : Instructing follower 0646b0acb9c943b59389eace852a5215 to start an election
I20260709 13:19:18.635573 14009 catalog_manager.cc:5697] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 1 to 2, leader changed from 45ddcb989aef4c9fa869766c3682632c (127.6.233.2) to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.636653 15233 raft_consensus.cc:1081] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Signalling peer 0646b0acb9c943b59389eace852a5215 to start an election
I20260709 13:19:18.639147 14331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:19:18.639711 14331 raft_consensus.cc:493] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:18.640280 14331 raft_consensus.cc:3060] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.649847 14331 raft_consensus.cc:515] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.651621 14331 leader_election.cc:290] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:18.652194 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:18.652557 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27f20266f4854ae8ae019ba0cb907c7c" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:18.652822 14184 raft_consensus.cc:3055] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:18.653169 14184 raft_consensus.cc:740] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:18.653219 14258 raft_consensus.cc:3060] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.653864 14184 consensus_queue.cc:260] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.654783 14184 raft_consensus.cc:3060] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.657886 14258 raft_consensus.cc:2468] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 2.
I20260709 13:19:18.658950 14300 leader_election.cc:304] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:18.659870 15208 raft_consensus.cc:2804] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:18.660352 15208 raft_consensus.cc:697] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:18.661175 15208 consensus_queue.cc:237] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.660823 14184 raft_consensus.cc:2468] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 2.
I20260709 13:19:18.670832 14009 catalog_manager.cc:5697] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 1 to 2, leader changed from 45ddcb989aef4c9fa869766c3682632c (127.6.233.2) to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.815531 15208 raft_consensus.cc:993] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215: : Instructing follower c19f7f4ddb074bd8997d01296c3080d6 to start an election
I20260709 13:19:18.816075 15208 raft_consensus.cc:1081] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer c19f7f4ddb074bd8997d01296c3080d6 to start an election
I20260709 13:19:18.817572 14258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f560b8d81584651b4720691469eca98"
dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
 from {username='slave'} at 127.0.0.1:55592
I20260709 13:19:18.818081 14258 raft_consensus.cc:493] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:18.818361 14258 raft_consensus.cc:3060] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.822507 14258 raft_consensus.cc:515] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.823768 14258 leader_election.cc:290] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:18.824661 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f560b8d81584651b4720691469eca98" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:18.825230 14331 raft_consensus.cc:3055] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:18.825871 14331 raft_consensus.cc:740] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:18.825227 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f560b8d81584651b4720691469eca98" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:18.826480 14184 raft_consensus.cc:3060] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.826783 14331 consensus_queue.cc:260] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.828169 14331 raft_consensus.cc:3060] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.831983 14184 raft_consensus.cc:2468] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:18.833271 14226 leader_election.cc:304] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:18.834218 15198 raft_consensus.cc:2804] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:18.834751 15198 raft_consensus.cc:697] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:18.835664 15198 consensus_queue.cc:237] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:18.836251 14331 raft_consensus.cc:2468] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:18.844651 14009 catalog_manager.cc:5697] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.038512 15249 raft_consensus.cc:993] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:19.038942 15208 raft_consensus.cc:1081] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:19.040333 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40812
I20260709 13:19:19.040808 15044 raft_consensus.cc:493] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.041077 15044 raft_consensus.cc:3060] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.046355 15044 raft_consensus.cc:515] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:19.048010 15044 leader_election.cc:290] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:19.049018 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:19.049353 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac90eaea6aa409d802a00c504d1c104" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:19.049696 14332 raft_consensus.cc:3055] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.049965 14184 raft_consensus.cc:3060] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.050195 14332 raft_consensus.cc:740] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:19.051079 14332 consensus_queue.cc:260] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:19.052418 14332 raft_consensus.cc:3060] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.053192 14331 raft_consensus.cc:1275] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 3 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:19.054474 15209 consensus_queue.cc:1048] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:19.056018 14184 raft_consensus.cc:2468] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:19.057053 14941 leader_election.cc:304] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:19.057349 14181 raft_consensus.cc:1275] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 0646b0acb9c943b59389eace852a5215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.057756 15209 raft_consensus.cc:2804] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.058816 14332 raft_consensus.cc:2468] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:19.059540 15209 raft_consensus.cc:697] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:19.059386 15208 consensus_queue.cc:1048] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.061604 15209 consensus_queue.cc:237] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:19.068094 14256 raft_consensus.cc:1275] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:19.076478 15207 consensus_queue.cc:1048] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:19:19.089700 15249 raft_consensus.cc:993] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215: : Instructing follower c19f7f4ddb074bd8997d01296c3080d6 to start an election
I20260709 13:19:19.090405 15249 raft_consensus.cc:1081] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer c19f7f4ddb074bd8997d01296c3080d6 to start an election
I20260709 13:19:19.093026 14258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0"
dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
 from {username='slave'} at 127.0.0.1:55592
I20260709 13:19:19.093748 14258 raft_consensus.cc:493] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.094177 14258 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.088840 14010 catalog_manager.cc:5697] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.103193 14258 raft_consensus.cc:515] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:19.107015 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:19.107560 14332 raft_consensus.cc:3055] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.107862 14332 raft_consensus.cc:740] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:19.108659 14332 consensus_queue.cc:260] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:19.109773 14332 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.112814 14258 leader_election.cc:290] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:19.122115 14332 raft_consensus.cc:2468] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:19.124583 14227 leader_election.cc:304] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:19.126338 15238 raft_consensus.cc:2804] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.126868 15238 raft_consensus.cc:697] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Leader. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:19.127786 15238 consensus_queue.cc:237] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:19.152105 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0" candidate_uuid: "c19f7f4ddb074bd8997d01296c3080d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:19.152851 14179 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.170004 14179 raft_consensus.cc:2468] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19f7f4ddb074bd8997d01296c3080d6 in term 2.
I20260709 13:19:19.181913 14010 catalog_manager.cc:5697] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "c19f7f4ddb074bd8997d01296c3080d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.189930 14258 raft_consensus.cc:1275] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 0646b0acb9c943b59389eace852a5215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.195757 14184 raft_consensus.cc:1275] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 0646b0acb9c943b59389eace852a5215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.198396 15208 consensus_queue.cc:1048] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.203222 15262 consensus_queue.cc:1048] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:19.203464 14258 raft_consensus.cc:1275] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 0646b0acb9c943b59389eace852a5215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.207969 15262 consensus_queue.cc:1048] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.328125 14331 raft_consensus.cc:1275] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.329295 15238 consensus_queue.cc:1048] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.340684 14179 raft_consensus.cc:1275] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.342128 15198 consensus_queue.cc:1048] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.527609  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:19.562517 14179 raft_consensus.cc:1275] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.564963 15207 consensus_queue.cc:1048] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.583153 14331 raft_consensus.cc:1275] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.584828 15207 consensus_queue.cc:1048] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.613176 14179 raft_consensus.cc:1275] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.617095 15270 consensus_queue.cc:1048] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.622807  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:19.647626 14331 raft_consensus.cc:1275] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer c19f7f4ddb074bd8997d01296c3080d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:19.649118 15261 consensus_queue.cc:1048] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:19.683704 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "190dd92193fb44399a0922353ce78a02"
dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
mode: GRACEFUL
new_leader_uuid: "0646b0acb9c943b59389eace852a5215"
 from {username='slave'} at 127.0.0.1:56086
I20260709 13:19:19.684345 14181 raft_consensus.cc:606] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Received request to transfer leadership to TS 0646b0acb9c943b59389eace852a5215
I20260709 13:19:19.690162 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c"
dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:56086
I20260709 13:19:19.690809 14181 raft_consensus.cc:606] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:19.694015 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c732e8e709f497eaee427bcad377540"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:19.694571 14332 raft_consensus.cc:606] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:19.698154 15268 raft_consensus.cc:993] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c: : Instructing follower 0646b0acb9c943b59389eace852a5215 to start an election
I20260709 13:19:19.698608 15268 raft_consensus.cc:1081] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Signalling peer 0646b0acb9c943b59389eace852a5215 to start an election
I20260709 13:19:19.701071 14331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "190dd92193fb44399a0922353ce78a02"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:19:19.701216 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e"
dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:56086
I20260709 13:19:19.701825 14331 raft_consensus.cc:493] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.701930 14181 raft_consensus.cc:606] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:19.702198 14331 raft_consensus.cc:3060] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.706925 14256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0"
dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
mode: GRACEFUL
new_leader_uuid: "45ddcb989aef4c9fa869766c3682632c"
 from {username='slave'} at 127.0.0.1:41178
I20260709 13:19:19.707496 14256 raft_consensus.cc:606] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Received request to transfer leadership to TS 45ddcb989aef4c9fa869766c3682632c
I20260709 13:19:19.710882 14331 raft_consensus.cc:515] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:19.713363 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190dd92193fb44399a0922353ce78a02" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:19.713902 14184 raft_consensus.cc:3055] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.714170 14184 raft_consensus.cc:740] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:19.714938 14184 consensus_queue.cc:260] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:19.715528 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:19.716006 14184 raft_consensus.cc:3060] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.716156 14332 raft_consensus.cc:606] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:19.717566  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:19.719516  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:19.714129 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190dd92193fb44399a0922353ce78a02" candidate_uuid: "0646b0acb9c943b59389eace852a5215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:19.720726 14256 raft_consensus.cc:3060] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.727365 14331 leader_election.cc:290] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:19.728107 14256 raft_consensus.cc:2468] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 2.
I20260709 13:19:19.729666 14300 leader_election.cc:304] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:19.730415 15262 raft_consensus.cc:2804] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.730486 14184 raft_consensus.cc:2468] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0646b0acb9c943b59389eace852a5215 in term 2.
I20260709 13:19:19.730862 15262 raft_consensus.cc:697] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Becoming Leader. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:19.731767 15262 consensus_queue.cc:237] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:19.742023 14007 catalog_manager.cc:5697] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 reported cstate change: term changed from 1 to 2, leader changed from 45ddcb989aef4c9fa869766c3682632c (127.6.233.2) to 0646b0acb9c943b59389eace852a5215 (127.6.233.4). New cstate: current_term: 2 leader_uuid: "0646b0acb9c943b59389eace852a5215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:19.785005 15233 raft_consensus.cc:993] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:19.785547 15268 raft_consensus.cc:1081] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:19.787135 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40808
I20260709 13:19:19.787649 15044 raft_consensus.cc:493] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.787982 15044 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:19.793133 15044 raft_consensus.cc:515] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:19.794754 15044 leader_election.cc:290] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 3 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:19.795331 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:19.796089 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d48bba4064b47cca8fada00e303488c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:19.796886 14256 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:19.798141 14184 raft_consensus.cc:3055] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:19.798430 14184 raft_consensus.cc:740] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:19.799155 14184 consensus_queue.cc:260] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:19.800365 14184 raft_consensus.cc:3060] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:19.802987 14256 raft_consensus.cc:2468] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 3.
I20260709 13:19:19.804273 14941 leader_election.cc:304] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:19.805028 15207 raft_consensus.cc:2804] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:19.805163 14184 raft_consensus.cc:2468] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 3.
I20260709 13:19:19.805538 15207 raft_consensus.cc:697] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 3 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:19.806442 15207 consensus_queue.cc:237] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:19.815865 14007 catalog_manager.cc:5697] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 2 to 3, leader changed from 45ddcb989aef4c9fa869766c3682632c (127.6.233.2) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 3 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.937711 15193 raft_consensus.cc:993] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:19.938187 15262 raft_consensus.cc:1081] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:19.939572 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40812
I20260709 13:19:19.940135 15044 raft_consensus.cc:493] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.940397 15044 raft_consensus.cc:3060] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.944687 15044 raft_consensus.cc:515] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:19.946115 15044 leader_election.cc:290] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:19.946784 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:19.947088 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa77825c4a1b4199b0876c76e8ed77aa" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:19.947405 14331 raft_consensus.cc:3055] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.947618 14184 raft_consensus.cc:3060] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.947786 14331 raft_consensus.cc:740] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:19.948638 14331 consensus_queue.cc:260] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:19.949872 14331 raft_consensus.cc:3060] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.953838 14184 raft_consensus.cc:2468] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:19.954975 14941 leader_election.cc:304] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:19.955734 15207 raft_consensus.cc:2804] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.956236 15207 raft_consensus.cc:697] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:19.956324 14331 raft_consensus.cc:2468] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:19.957147 15207 consensus_queue.cc:237] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:19.965339 14007 catalog_manager.cc:5697] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.971681 15193 raft_consensus.cc:993] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:19.972174 15193 raft_consensus.cc:1081] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:19.973632 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c732e8e709f497eaee427bcad377540"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40812
I20260709 13:19:19.974174 15044 raft_consensus.cc:493] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:19.974546 15044 raft_consensus.cc:3060] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.980922 15044 raft_consensus.cc:515] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:19.983453 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c732e8e709f497eaee427bcad377540" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:19.983664 15044 leader_election.cc:290] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:19.984017 14332 raft_consensus.cc:3055] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:19.984360 14332 raft_consensus.cc:740] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:19.985102 14332 consensus_queue.cc:260] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:19.985733 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c732e8e709f497eaee427bcad377540" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:19.986316 14184 raft_consensus.cc:3060] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.986456 14332 raft_consensus.cc:3060] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.992740 14184 raft_consensus.cc:2468] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:19.992740 14332 raft_consensus.cc:2468] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:19.993929 14942 leader_election.cc:304] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:19.994709 15207 raft_consensus.cc:2804] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:19.995170 15207 raft_consensus.cc:697] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:19.995950 15207 consensus_queue.cc:237] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:20.010114 14007 catalog_manager.cc:5697] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.074844 15268 raft_consensus.cc:993] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:20.075284 15267 raft_consensus.cc:1081] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:20.076881 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40808
I20260709 13:19:20.077481 15044 raft_consensus.cc:493] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.077854 15044 raft_consensus.cc:3060] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.079227 15261 raft_consensus.cc:993] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6: : Instructing follower 45ddcb989aef4c9fa869766c3682632c to start an election
I20260709 13:19:20.080075 15198 raft_consensus.cc:1081] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Signalling peer 45ddcb989aef4c9fa869766c3682632c to start an election
I20260709 13:19:20.081560 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0"
dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
 from {username='slave'} at 127.0.0.1:39316
I20260709 13:19:20.082068 14181 raft_consensus.cc:493] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.082384 14181 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:20.084755 15044 raft_consensus.cc:515] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:20.087296 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:20.087443 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9490553a32884f388ba3fcdc7ae7ac6e" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:20.087882 14332 raft_consensus.cc:3060] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.088351 15044 leader_election.cc:290] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:20.088527 14181 raft_consensus.cc:515] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:20.088028 14184 raft_consensus.cc:3055] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:20.089991 14184 raft_consensus.cc:740] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:20.090977 14184 consensus_queue.cc:260] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:20.092355 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:20.092960 14256 raft_consensus.cc:3055] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:20.093302 14256 raft_consensus.cc:740] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:20.094177 14256 consensus_queue.cc:260] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:20.095167 14332 raft_consensus.cc:2468] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:20.095219 14256 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:20.096078 14181 leader_election.cc:290] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 3 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:20.096725 14184 raft_consensus.cc:3060] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.098438 14942 leader_election.cc:304] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0646b0acb9c943b59389eace852a5215, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:20.099536 15207 raft_consensus.cc:2804] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:20.099557 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9141f0570cd47eeb0583a4a7ca21ea0" candidate_uuid: "45ddcb989aef4c9fa869766c3682632c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:20.101130 14331 raft_consensus.cc:3060] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:20.103323 14256 raft_consensus.cc:2468] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 3.
I20260709 13:19:20.104410 14152 leader_election.cc:304] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:20.105350 15267 raft_consensus.cc:2804] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:20.105815 15267 raft_consensus.cc:697] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 3 LEADER]: Becoming Leader. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:20.106577 15267 consensus_queue.cc:237] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:20.109894 15207 raft_consensus.cc:697] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:20.111235 14331 raft_consensus.cc:2468] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddcb989aef4c9fa869766c3682632c in term 3.
I20260709 13:19:20.110854 15207 consensus_queue.cc:237] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:20.116700 14184 raft_consensus.cc:2468] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:20.117327 14007 catalog_manager.cc:5697] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c reported cstate change: term changed from 2 to 3, leader changed from c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3) to 45ddcb989aef4c9fa869766c3682632c (127.6.233.2). New cstate: current_term: 3 leader_uuid: "45ddcb989aef4c9fa869766c3682632c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.123265 14010 catalog_manager.cc:5697] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 45ddcb989aef4c9fa869766c3682632c (127.6.233.2) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.138935 14184 raft_consensus.cc:1275] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 0646b0acb9c943b59389eace852a5215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.140494 15193 consensus_queue.cc:1048] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.149278 14261 raft_consensus.cc:1275] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 0646b0acb9c943b59389eace852a5215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.150393 15263 consensus_queue.cc:1048] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.351922 14261 raft_consensus.cc:1275] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:20.353057 15207 consensus_queue.cc:1048] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:20.370087 14184 raft_consensus.cc:1275] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:20.373329 15207 consensus_queue.cc:1048] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:20.402395 14331 raft_consensus.cc:1275] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.403561 15207 consensus_queue.cc:1048] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.419243 14181 raft_consensus.cc:1275] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.421033 15285 consensus_queue.cc:1048] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.491122 14184 raft_consensus.cc:1275] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.492327 15285 consensus_queue.cc:1048] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.506076 14331 raft_consensus.cc:1275] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.508808 15207 consensus_queue.cc:1048] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.529027 14256 raft_consensus.cc:1275] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:20.532436 15268 consensus_queue.cc:1048] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:20.545059 14331 raft_consensus.cc:1275] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 3 FOLLOWER]: Refusing update from remote peer 45ddcb989aef4c9fa869766c3682632c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:20.547087 15267 consensus_queue.cc:1048] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:20.558938 14335 raft_consensus.cc:1275] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.560611 15273 consensus_queue.cc:1048] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.582690 14184 raft_consensus.cc:1275] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:20.584378 15285 consensus_queue.cc:1048] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:20.720463  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:20.767428  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:20.809329 14261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c"
dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:41178
I20260709 13:19:20.809923 14261 raft_consensus.cc:606] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:20.812456 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44"
dest_uuid: "0646b0acb9c943b59389eace852a5215"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:39586
I20260709 13:19:20.812918 14331 raft_consensus.cc:606] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:20.815585 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a"
dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
mode: GRACEFUL
new_leader_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:56086
I20260709 13:19:20.816156 14181 raft_consensus.cc:606] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Received request to transfer leadership to TS 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:20.817299  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:20.818429  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:20.891062 15193 raft_consensus.cc:993] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:20.891696 15263 raft_consensus.cc:1081] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:20.893224 15045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40812
I20260709 13:19:20.893827 15045 raft_consensus.cc:493] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.894119 15045 raft_consensus.cc:3060] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.900897 15045 raft_consensus.cc:515] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:20.902788 15045 leader_election.cc:290] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883), 0646b0acb9c943b59389eace852a5215 (127.6.233.4:40795)
I20260709 13:19:20.903371 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:20.903973 14256 raft_consensus.cc:3060] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.904242 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e833ae6b3ffa414fb4f0f04c981b4e44" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0646b0acb9c943b59389eace852a5215"
I20260709 13:19:20.904814 14335 raft_consensus.cc:3055] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:20.905113 14335 raft_consensus.cc:740] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0646b0acb9c943b59389eace852a5215, State: Running, Role: LEADER
I20260709 13:19:20.905853 14335 consensus_queue.cc:260] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:20.907035 14335 raft_consensus.cc:3060] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.910491 14256 raft_consensus.cc:2468] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:20.911652 14941 leader_election.cc:304] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:20.912434 15207 raft_consensus.cc:2804] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:20.912833 15207 raft_consensus.cc:697] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:20.913446 14335 raft_consensus.cc:2468] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:20.913641 15207 consensus_queue.cc:237] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } }
I20260709 13:19:20.923563 14009 catalog_manager.cc:5697] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 0646b0acb9c943b59389eace852a5215 (127.6.233.4) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.197561 15198 raft_consensus.cc:993] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:21.198740 15270 raft_consensus.cc:1081] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:21.201404 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40800
I20260709 13:19:21.202234 15044 raft_consensus.cc:493] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:21.202659 15044 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.210589 15044 raft_consensus.cc:515] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:21.213366 15044 leader_election.cc:290] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 3 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:21.214075 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:21.214993 14179 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.215061 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0dc0a81dec54a3496bdc7a82d00614c" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:21.215691 14256 raft_consensus.cc:3055] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:21.215934 14256 raft_consensus.cc:740] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c19f7f4ddb074bd8997d01296c3080d6, State: Running, Role: LEADER
I20260709 13:19:21.216890 14256 consensus_queue.cc:260] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:21.218186 14256 raft_consensus.cc:3060] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:21.221287 14179 raft_consensus.cc:2468] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 3.
I20260709 13:19:21.222556 14941 leader_election.cc:304] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a; no voters: 
I20260709 13:19:21.223506 15207 raft_consensus.cc:2804] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:21.223970 15207 raft_consensus.cc:697] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 3 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:21.224936 14256 raft_consensus.cc:2468] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 3.
I20260709 13:19:21.225071 15207 consensus_queue.cc:237] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:21.236944 14009 catalog_manager.cc:5697] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 2 to 3, leader changed from c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 3 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.276738 15233 raft_consensus.cc:993] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c: : Instructing follower 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:21.277426 15268 raft_consensus.cc:1081] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Signalling peer 675788979b2e4a89be45b2af4fa3141a to start an election
I20260709 13:19:21.278861 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a"
dest_uuid: "675788979b2e4a89be45b2af4fa3141a"
 from {username='slave'} at 127.0.0.1:40808
I20260709 13:19:21.279317 15044 raft_consensus.cc:493] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:21.279652 15044 raft_consensus.cc:3060] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:21.286147 15044 raft_consensus.cc:515] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:21.288134 15044 leader_election.cc:290] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Requested vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883)
I20260709 13:19:21.289809 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddcb989aef4c9fa869766c3682632c"
I20260709 13:19:21.290045 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1f2f59055e248e889af1b4a2e30f27a" candidate_uuid: "675788979b2e4a89be45b2af4fa3141a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19f7f4ddb074bd8997d01296c3080d6"
I20260709 13:19:21.290467 14179 raft_consensus.cc:3055] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:21.290937 14179 raft_consensus.cc:740] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddcb989aef4c9fa869766c3682632c, State: Running, Role: LEADER
I20260709 13:19:21.290966 14256 raft_consensus.cc:3060] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:21.292223 14179 consensus_queue.cc:260] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:21.293735 14179 raft_consensus.cc:3060] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:21.298133 14256 raft_consensus.cc:2468] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:21.299242 14941 leader_election.cc:304] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 675788979b2e4a89be45b2af4fa3141a, c19f7f4ddb074bd8997d01296c3080d6; no voters: 
I20260709 13:19:21.299990 15207 raft_consensus.cc:2804] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:21.300487 15207 raft_consensus.cc:697] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Becoming Leader. State: Replica: 675788979b2e4a89be45b2af4fa3141a, State: Running, Role: LEADER
I20260709 13:19:21.300712 14179 raft_consensus.cc:2468] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675788979b2e4a89be45b2af4fa3141a in term 2.
I20260709 13:19:21.301549 15207 consensus_queue.cc:237] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } }
I20260709 13:19:21.310840 14009 catalog_manager.cc:5697] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a reported cstate change: term changed from 1 to 2, leader changed from 45ddcb989aef4c9fa869766c3682632c (127.6.233.2) to 675788979b2e4a89be45b2af4fa3141a (127.6.233.1). New cstate: current_term: 2 leader_uuid: "675788979b2e4a89be45b2af4fa3141a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.377539 14256 raft_consensus.cc:1275] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:21.380745 15285 consensus_queue.cc:1048] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:21.401197 14331 raft_consensus.cc:1275] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:21.405130 15207 consensus_queue.cc:1048] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:21.704613 14256 raft_consensus.cc:1275] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:21.705849 15207 consensus_queue.cc:1048] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:21.717293 14181 raft_consensus.cc:1275] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:21.719235 15285 consensus_queue.cc:1048] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:21.819401  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:21.857384  7076 tablet_server.cc:179] TabletServer@127.6.233.1:34585 shutting down...
W20260709 13:19:21.874456 14151 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 276 similar messages]
W20260709 13:19:21.879510 14151 consensus_peers.cc:597] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:21.896324 14181 raft_consensus.cc:1275] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:21.901945 15207 consensus_queue.cc:1048] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:21.909983 14261 raft_consensus.cc:1275] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Refusing update from remote peer 675788979b2e4a89be45b2af4fa3141a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:21.911315  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:21.912588 15316 consensus_queue.cc:1048] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19f7f4ddb074bd8997d01296c3080d6" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:21.915948  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.917344  7076 raft_consensus.cc:2243] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.918079  7076 raft_consensus.cc:2272] T 8465239326774a1386ddba99f9e50efb P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.922478  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.923688  7076 raft_consensus.cc:2243] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.924381  7076 raft_consensus.cc:2272] T 965959c6060c4e31872a4d63bb4cc3d8 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.927781  7076 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:21.928508 14299 consensus_peers.cc:597] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:21.928789  7076 raft_consensus.cc:2243] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.931496  7076 raft_consensus.cc:2272] T fb043e88ddb1409188b19489adb77959 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.934796  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.935957  7076 raft_consensus.cc:2243] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:21.938235  7076 raft_consensus.cc:2272] T 3c732e8e709f497eaee427bcad377540 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.941809  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.942903  7076 raft_consensus.cc:2243] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:21.944159  7076 raft_consensus.cc:2272] T fa77825c4a1b4199b0876c76e8ed77aa P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.948252  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.949327  7076 raft_consensus.cc:2243] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:21.949543 14299 consensus_peers.cc:597] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:21.950093  7076 raft_consensus.cc:2272] T 80d51f9492d6490eb3724b897994f107 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.954990  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.955876  7076 raft_consensus.cc:2243] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.957356  7076 raft_consensus.cc:2272] T 82c6d6688efe44588062121fe1de87d2 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.960840  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.961781  7076 raft_consensus.cc:2243] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:21.963043  7076 raft_consensus.cc:2272] T 3ccef079cb964f8a83bfcafbe3f15e74 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.966874  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.967796  7076 raft_consensus.cc:2243] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.968382  7076 raft_consensus.cc:2272] T f71afc145d3844248a07bbf2114fbd5f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.971526  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.972288  7076 raft_consensus.cc:2243] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:21.974601  7076 raft_consensus.cc:2272] T d0dc0a81dec54a3496bdc7a82d00614c P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:21.975602 14225 consensus_peers.cc:597] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:21.979801  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.980873  7076 raft_consensus.cc:2243] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.981462  7076 raft_consensus.cc:2272] T 0464e1aacb18475980f90e52a22f5c55 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:21.982559 14299 consensus_peers.cc:597] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:21.985723  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.987033  7076 raft_consensus.cc:2243] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:19:21.987353 14225 consensus_peers.cc:597] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:21.985824 14151 consensus_peers.cc:597] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:21.988401  7076 raft_consensus.cc:2272] T 7ac90eaea6aa409d802a00c504d1c104 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.990780  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.991400  7076 raft_consensus.cc:2243] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.991863  7076 raft_consensus.cc:2272] T fc372b890581484a9c147f584264c31f P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.994128  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.994750  7076 raft_consensus.cc:2243] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.995142  7076 raft_consensus.cc:2272] T c9aa82f67f724a9789d4486481fc7f6a P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.997867  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:21.998564  7076 raft_consensus.cc:2243] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.999017  7076 raft_consensus.cc:2272] T e96808d860d8457caea08dbac23516b3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:21.999260 14225 consensus_peers.cc:597] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.001816  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.002681  7076 raft_consensus.cc:2243] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.003207  7076 raft_consensus.cc:2272] T fa413bb6214043609003b441decca56f P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.004910 14151 consensus_peers.cc:597] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.006464  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.007318  7076 raft_consensus.cc:2243] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.007836  7076 raft_consensus.cc:2272] T f7ca8839d60a4089a7ff40ba299f1b71 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.009071 14225 consensus_peers.cc:597] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.011929  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.012814  7076 raft_consensus.cc:2243] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.013777  7076 raft_consensus.cc:2272] T f1f2f59055e248e889af1b4a2e30f27a P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.016906  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.017813  7076 raft_consensus.cc:2243] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.018831  7076 raft_consensus.cc:2272] T 183a076c0e614a54b0a8875f351528a3 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.021190  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.021797  7076 raft_consensus.cc:2243] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.022185  7076 raft_consensus.cc:2272] T a7b2ad2ed67144c6b9baffea26c9ae16 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.024426  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.024984  7076 raft_consensus.cc:2243] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.025388  7076 raft_consensus.cc:2272] T 876b3eb00a984f94a6d6df1d7472bedb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.027621  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.028293  7076 raft_consensus.cc:2243] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.028816  7076 raft_consensus.cc:2272] T 8e519b3fde754be785619f806259cbcb P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.030743 14225 consensus_peers.cc:597] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.031404  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.032121  7076 raft_consensus.cc:2243] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.032606  7076 raft_consensus.cc:2272] T df25294a6ce4432cbffe41a0bee4c8b8 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.035223  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.036001  7076 raft_consensus.cc:2243] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.036578  7076 raft_consensus.cc:2272] T cb9f8d4bb28b4564a44774231b92f8c9 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.039232  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.039959  7076 raft_consensus.cc:2243] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.040884  7076 raft_consensus.cc:2272] T 34dc4074ff05452dbda3ce53bbc859f1 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.043067  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.043638  7076 raft_consensus.cc:2243] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.044535  7076 raft_consensus.cc:2272] T e833ae6b3ffa414fb4f0f04c981b4e44 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.048271  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.049111  7076 raft_consensus.cc:2243] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.049619  7076 raft_consensus.cc:2272] T 9dd224c5b12246cf83abcd8530f9e091 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.052400  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.053249  7076 raft_consensus.cc:2243] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.054360  7076 raft_consensus.cc:2272] T ed9afc388a1546c28fcf9777a5e31674 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.054788 14225 consensus_peers.cc:597] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.057387  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.058507  7076 raft_consensus.cc:2243] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.059139  7076 raft_consensus.cc:2272] T a95255a6465943e199a2aa0b7601bf32 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.059819 14151 consensus_peers.cc:597] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.062340  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.063064  7076 raft_consensus.cc:2243] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.063534  7076 raft_consensus.cc:2272] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.065956  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.066581  7076 raft_consensus.cc:2243] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.067046  7076 raft_consensus.cc:2272] T 3dfcde74e8344c17a4afcd878be63bbb P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.069638  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.070403  7076 raft_consensus.cc:2243] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.071056  7076 raft_consensus.cc:2272] T 5fc5acb16ea44ef882abb6d9013b2848 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.073565 14299 consensus_peers.cc:597] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.074424  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.075184  7076 raft_consensus.cc:2243] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.075672  7076 raft_consensus.cc:2272] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.078438  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.079275  7076 raft_consensus.cc:2243] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.080484  7076 raft_consensus.cc:2272] T 54d9e8510eb240098e1916592b497767 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.080616 14225 consensus_peers.cc:597] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.083668  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.084604  7076 raft_consensus.cc:2243] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.085184  7076 raft_consensus.cc:2272] T 14767c1f0196445ea4a179965d06965f P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.088094  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.088692  7076 raft_consensus.cc:2243] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.089622  7076 raft_consensus.cc:2272] T 2d48bba4064b47cca8fada00e303488c P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.091979  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.092571  7076 raft_consensus.cc:2243] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.092962  7076 raft_consensus.cc:2272] T cb81836efc194afea3e9a9b0a1e5d000 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.095536  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.096288  7076 raft_consensus.cc:2243] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.096846  7076 raft_consensus.cc:2272] T 29a259ed126849a0a6653f5d96884b87 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.099220  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.099674  7076 raft_consensus.cc:2243] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.100476  7076 raft_consensus.cc:2272] T 3935d54132d142e595008d4783fa0ab6 P 675788979b2e4a89be45b2af4fa3141a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.102864  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.103436  7076 raft_consensus.cc:2243] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.103806  7076 raft_consensus.cc:2272] T 44db1fb7c007438398ce78e1bf686291 P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.105960  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.106603  7076 raft_consensus.cc:2243] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.107547  7076 raft_consensus.cc:2272] T 9490553a32884f388ba3fcdc7ae7ac6e P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.110138  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.110747  7076 raft_consensus.cc:2243] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.111146  7076 raft_consensus.cc:2272] T 847793586a524d1e9df7a07c31f2d186 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.113233  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.113932  7076 raft_consensus.cc:2243] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.114435  7076 raft_consensus.cc:2272] T d3d4f8d14e954ef5af8eb1736629b53b P 675788979b2e4a89be45b2af4fa3141a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.116237 14151 consensus_peers.cc:597] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.117028  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.117596  7076 raft_consensus.cc:2243] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.117996  7076 raft_consensus.cc:2272] T 9b052613656f42f19ebcb9c59686e9a3 P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.120814  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:22.121385  7076 raft_consensus.cc:2243] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.121850  7076 raft_consensus.cc:2272] T cf2074eb6b644c7f926c78e9ded22c1c P 675788979b2e4a89be45b2af4fa3141a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.130972 14299 consensus_peers.cc:597] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.145622 14225 consensus_peers.cc:597] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.153168 14225 consensus_peers.cc:597] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.157444 14299 consensus_peers.cc:597] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.194345 14151 consensus_peers.cc:597] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.198066  7076 tablet_server.cc:196] TabletServer@127.6.233.1:34585 shutdown complete.
W20260709 13:19:22.210418 14225 consensus_peers.cc:597] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.217900 14225 consensus_peers.cc:597] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.228938 14151 consensus_peers.cc:597] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.231631 14151 consensus_peers.cc:597] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.285586  7076 tablet_server.cc:179] TabletServer@127.6.233.2:0 shutting down...
W20260709 13:19:22.300743 14151 consensus_peers.cc:597] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.315649 14226 consensus_peers.cc:597] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.327499 14299 consensus_peers.cc:597] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.329209 14151 consensus_peers.cc:597] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.329654  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:22.330605  7076 tablet_replica.cc:333] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.331566  7076 raft_consensus.cc:2243] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.332221  7076 raft_consensus.cc:2272] T c9aa82f67f724a9789d4486481fc7f6a P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.333549 14300 consensus_peers.cc:597] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.334753  7076 tablet_replica.cc:333] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.335451  7076 raft_consensus.cc:2243] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.336243  7076 raft_consensus.cc:2272] T 80d51f9492d6490eb3724b897994f107 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.338361  7076 tablet_replica.cc:333] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.338894  7076 raft_consensus.cc:2243] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.339277  7076 raft_consensus.cc:2272] T 34dc4074ff05452dbda3ce53bbc859f1 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.341465  7076 tablet_replica.cc:333] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.341958  7076 raft_consensus.cc:2243] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.342415  7076 raft_consensus.cc:2272] T cb9f8d4bb28b4564a44774231b92f8c9 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.344379  7076 tablet_replica.cc:333] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.345285  7076 raft_consensus.cc:2243] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.345834  7076 raft_consensus.cc:2272] T f4709c305db34d068e37448bc1462f47 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.348219 14300 consensus_peers.cc:597] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.348675  7076 tablet_replica.cc:333] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.349303  7076 raft_consensus.cc:2243] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.349680  7076 raft_consensus.cc:2272] T ef01c7e413414a618fc490804422f834 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.351722  7076 tablet_replica.cc:333] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.352366  7076 raft_consensus.cc:2243] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.352782  7076 raft_consensus.cc:2272] T 3c732e8e709f497eaee427bcad377540 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.354696  7076 tablet_replica.cc:333] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.355273  7076 raft_consensus.cc:2243] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.355711  7076 raft_consensus.cc:2272] T f71afc145d3844248a07bbf2114fbd5f P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.357697  7076 tablet_replica.cc:333] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.358287  7076 raft_consensus.cc:2243] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.358716  7076 raft_consensus.cc:2272] T 183f0c224f074c99903307d0678a8ccf P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.360735  7076 tablet_replica.cc:333] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.361284  7076 raft_consensus.cc:2243] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.361711  7076 raft_consensus.cc:2272] T 2d48bba4064b47cca8fada00e303488c P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.363695  7076 tablet_replica.cc:333] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.364362  7076 raft_consensus.cc:2243] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.364916  7076 raft_consensus.cc:2272] T 374a720a9f0d4319a36fe8b4b060a5d8 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.367748  7076 tablet_replica.cc:333] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
W20260709 13:19:22.368427 14226 consensus_peers.cc:597] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.368593  7076 raft_consensus.cc:2243] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.369194  7076 raft_consensus.cc:2272] T 9490553a32884f388ba3fcdc7ae7ac6e P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.372222  7076 tablet_replica.cc:333] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.373095  7076 raft_consensus.cc:2243] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.374174  7076 raft_consensus.cc:2272] T cf2074eb6b644c7f926c78e9ded22c1c P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.376670  7076 tablet_replica.cc:333] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.377250  7076 raft_consensus.cc:2243] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.377712  7076 raft_consensus.cc:2272] T 9b052613656f42f19ebcb9c59686e9a3 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.379637  7076 tablet_replica.cc:333] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.380412  7076 raft_consensus.cc:2243] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.380825  7076 raft_consensus.cc:2272] T 6a68e63a39ca44319695c6f4e9937912 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.383284  7076 tablet_replica.cc:333] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.384043  7076 raft_consensus.cc:2243] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.384935  7076 raft_consensus.cc:2272] T 82c6d6688efe44588062121fe1de87d2 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.386667  7076 tablet_replica.cc:333] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.387164  7076 raft_consensus.cc:2243] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.387912  7076 raft_consensus.cc:2272] T a7b2ad2ed67144c6b9baffea26c9ae16 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.390592  7076 tablet_replica.cc:333] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.391384  7076 raft_consensus.cc:2243] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.391969  7076 raft_consensus.cc:2272] T 44db1fb7c007438398ce78e1bf686291 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.394164  7076 tablet_replica.cc:333] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.394658  7076 raft_consensus.cc:2243] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.395015  7076 raft_consensus.cc:2272] T 8c9282e9c78a46a6a3bba23269e7adc7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.397148  7076 tablet_replica.cc:333] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.397800  7076 raft_consensus.cc:2243] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.398658  7076 raft_consensus.cc:2272] T 9dd224c5b12246cf83abcd8530f9e091 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.401243  7076 tablet_replica.cc:333] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
W20260709 13:19:22.401974 14225 consensus_peers.cc:597] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.401988  7076 raft_consensus.cc:2243] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.402840  7076 raft_consensus.cc:2272] T fc372b890581484a9c147f584264c31f P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.404963  7076 tablet_replica.cc:333] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.405704  7076 raft_consensus.cc:2243] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.406302  7076 raft_consensus.cc:2272] T 7ac90eaea6aa409d802a00c504d1c104 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.408939  7076 tablet_replica.cc:333] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.409512  7076 raft_consensus.cc:2243] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.410024  7076 raft_consensus.cc:2272] T d0dc0a81dec54a3496bdc7a82d00614c P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.409979 14151 consensus_peers.cc:597] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c -> Peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Couldn't send request to peer 675788979b2e4a89be45b2af4fa3141a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.412750  7076 tablet_replica.cc:333] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.413261  7076 raft_consensus.cc:2243] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.413928  7076 raft_consensus.cc:2272] T b9141f0570cd47eeb0583a4a7ca21ea0 P 45ddcb989aef4c9fa869766c3682632c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.415763  7076 tablet_replica.cc:333] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.416445  7076 raft_consensus.cc:2243] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.416909  7076 raft_consensus.cc:2272] T 63a98c83dfc34effa3050c2c8c0121f9 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.419279  7076 tablet_replica.cc:333] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.419770  7076 raft_consensus.cc:2243] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.420258  7076 raft_consensus.cc:2272] T 2f560b8d81584651b4720691469eca98 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.422319  7076 tablet_replica.cc:333] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.423053  7076 raft_consensus.cc:2243] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.423826  7076 raft_consensus.cc:2272] T df25294a6ce4432cbffe41a0bee4c8b8 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.426069  7076 tablet_replica.cc:333] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.426728  7076 raft_consensus.cc:2243] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.427558  7076 raft_consensus.cc:2272] T 8e519b3fde754be785619f806259cbcb P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.429565  7076 tablet_replica.cc:333] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.430181  7076 raft_consensus.cc:2243] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.431258  7076 raft_consensus.cc:2272] T e9e2af9154cf4749976dc55b506018e5 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.433077 14226 consensus_peers.cc:597] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.434018  7076 tablet_replica.cc:333] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.434672  7076 raft_consensus.cc:2243] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.435127  7076 raft_consensus.cc:2272] T 27f20266f4854ae8ae019ba0cb907c7c P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.437955  7076 tablet_replica.cc:333] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.438544  7076 raft_consensus.cc:2243] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.439549  7076 raft_consensus.cc:2272] T 847793586a524d1e9df7a07c31f2d186 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.441956  7076 tablet_replica.cc:333] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.442494  7076 raft_consensus.cc:2243] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.442958  7076 raft_consensus.cc:2272] T fa77825c4a1b4199b0876c76e8ed77aa P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.445097  7076 tablet_replica.cc:333] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.445613  7076 raft_consensus.cc:2243] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.446498  7076 raft_consensus.cc:2272] T d3d4f8d14e954ef5af8eb1736629b53b P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.449290  7076 tablet_replica.cc:333] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.449957  7076 raft_consensus.cc:2243] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.450963  7076 raft_consensus.cc:2272] T 39f9212333fa40979fd9596511ba43b7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.453686  7076 tablet_replica.cc:333] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.454422  7076 raft_consensus.cc:2243] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.454937  7076 raft_consensus.cc:2272] T 190dd92193fb44399a0922353ce78a02 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.457520  7076 tablet_replica.cc:333] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.458206  7076 raft_consensus.cc:2243] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.459188  7076 raft_consensus.cc:2272] T 5fc5acb16ea44ef882abb6d9013b2848 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.461651  7076 tablet_replica.cc:333] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.462328  7076 raft_consensus.cc:2243] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.463227  7076 raft_consensus.cc:2272] T fb043e88ddb1409188b19489adb77959 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.465919  7076 tablet_replica.cc:333] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.466511  7076 raft_consensus.cc:2243] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.467085  7076 raft_consensus.cc:2272] T 3ccef079cb964f8a83bfcafbe3f15e74 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.469655  7076 tablet_replica.cc:333] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.470352  7076 raft_consensus.cc:2243] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.470882  7076 raft_consensus.cc:2272] T f7ca8839d60a4089a7ff40ba299f1b71 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.473297  7076 tablet_replica.cc:333] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.473918  7076 raft_consensus.cc:2243] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.474874  7076 raft_consensus.cc:2272] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.477360  7076 tablet_replica.cc:333] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.478003  7076 raft_consensus.cc:2243] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.478490  7076 raft_consensus.cc:2272] T ed9afc388a1546c28fcf9777a5e31674 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.479138 14226 consensus_peers.cc:597] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.481115  7076 tablet_replica.cc:333] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.481825  7076 raft_consensus.cc:2243] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.482316  7076 raft_consensus.cc:2272] T 183a076c0e614a54b0a8875f351528a3 P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.485075  7076 tablet_replica.cc:333] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.485745  7076 raft_consensus.cc:2243] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.486199  7076 raft_consensus.cc:2272] T f1f2f59055e248e889af1b4a2e30f27a P 45ddcb989aef4c9fa869766c3682632c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.489010  7076 tablet_replica.cc:333] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c: stopping tablet replica
I20260709 13:19:22.489583  7076 raft_consensus.cc:2243] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.490136  7076 raft_consensus.cc:2272] T d4848588d16a4c4f89e884a9f15ff4a7 P 45ddcb989aef4c9fa869766c3682632c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.492941 14300 consensus_peers.cc:597] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.538499 14226 consensus_peers.cc:597] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.541090 14300 consensus_peers.cc:597] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.547997 14226 consensus_peers.cc:597] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.562650 14300 consensus_peers.cc:597] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.569756 14300 consensus_peers.cc:597] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.573819  7076 tablet_server.cc:196] TabletServer@127.6.233.2:0 shutdown complete.
W20260709 13:19:22.576992 14300 consensus_peers.cc:597] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.583216 14226 consensus_peers.cc:597] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.586339 14300 consensus_peers.cc:597] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.650254  7076 tablet_server.cc:179] TabletServer@127.6.233.3:0 shutting down...
W20260709 13:19:22.658901 14300 consensus_peers.cc:597] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.678705 14300 consensus_peers.cc:597] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.699652  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:22.701174  7076 tablet_replica.cc:333] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.702215  7076 raft_consensus.cc:2243] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.702714  7076 raft_consensus.cc:2272] T 80d51f9492d6490eb3724b897994f107 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.702893 14226 consensus_peers.cc:597] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.705164  7076 tablet_replica.cc:333] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.706077  7076 raft_consensus.cc:2243] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.706624  7076 raft_consensus.cc:2272] T 54d9e8510eb240098e1916592b497767 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.709116  7076 tablet_replica.cc:333] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.709668  7076 raft_consensus.cc:2243] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.710081  7076 raft_consensus.cc:2272] T ef01c7e413414a618fc490804422f834 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.712025  7076 tablet_replica.cc:333] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.712658  7076 raft_consensus.cc:2243] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.713081  7076 raft_consensus.cc:2272] T 27f20266f4854ae8ae019ba0cb907c7c P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.714916  7076 tablet_replica.cc:333] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.715536  7076 raft_consensus.cc:2243] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.716357  7076 raft_consensus.cc:2272] T c9aa82f67f724a9789d4486481fc7f6a P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.718243  7076 tablet_replica.cc:333] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.718775  7076 raft_consensus.cc:2243] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.719259  7076 raft_consensus.cc:2272] T cb81836efc194afea3e9a9b0a1e5d000 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.721643  7076 tablet_replica.cc:333] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.722306  7076 raft_consensus.cc:2243] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.722774  7076 raft_consensus.cc:2272] T 2d48bba4064b47cca8fada00e303488c P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.725104  7076 tablet_replica.cc:333] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
W20260709 13:19:22.725440 14300 consensus_peers.cc:597] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.725917  7076 raft_consensus.cc:2243] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.726361  7076 raft_consensus.cc:2272] T 183f0c224f074c99903307d0678a8ccf P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.728248  7076 tablet_replica.cc:333] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.728752  7076 raft_consensus.cc:2243] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.729118  7076 raft_consensus.cc:2272] T a95255a6465943e199a2aa0b7601bf32 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.730960  7076 tablet_replica.cc:333] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.731418  7076 raft_consensus.cc:2243] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.731791  7076 raft_consensus.cc:2272] T 6dfb3a603d584bcabbf0c9f0d3594ff7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.733625  7076 tablet_replica.cc:333] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.734119  7076 raft_consensus.cc:2243] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.734755  7076 raft_consensus.cc:2272] T 29a259ed126849a0a6653f5d96884b87 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.736632  7076 tablet_replica.cc:333] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.737082  7076 raft_consensus.cc:2243] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.737411  7076 raft_consensus.cc:2272] T cf2074eb6b644c7f926c78e9ded22c1c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.739120  7076 tablet_replica.cc:333] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.739563  7076 raft_consensus.cc:2243] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.740398  7076 raft_consensus.cc:2272] T 9b052613656f42f19ebcb9c59686e9a3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.742964  7076 tablet_replica.cc:333] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.743695  7076 raft_consensus.cc:2243] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:22.743750 14300 consensus_peers.cc:597] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.744292  7076 raft_consensus.cc:2272] T 82c6d6688efe44588062121fe1de87d2 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.746716  7076 tablet_replica.cc:333] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.747272  7076 raft_consensus.cc:2243] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.748030  7076 raft_consensus.cc:2272] T 6a68e63a39ca44319695c6f4e9937912 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.749976  7076 tablet_replica.cc:333] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.750511  7076 raft_consensus.cc:2243] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.751228  7076 raft_consensus.cc:2272] T f7ca8839d60a4089a7ff40ba299f1b71 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.753219  7076 tablet_replica.cc:333] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.753720  7076 raft_consensus.cc:2243] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.754426  7076 raft_consensus.cc:2272] T fa413bb6214043609003b441decca56f P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.756304  7076 tablet_replica.cc:333] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.756834  7076 raft_consensus.cc:2243] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.757218  7076 raft_consensus.cc:2272] T e833ae6b3ffa414fb4f0f04c981b4e44 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.759020  7076 tablet_replica.cc:333] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.759557  7076 raft_consensus.cc:2243] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.759953  7076 raft_consensus.cc:2272] T 9dd224c5b12246cf83abcd8530f9e091 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.761736  7076 tablet_replica.cc:333] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.762284  7076 raft_consensus.cc:2243] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.763010  7076 raft_consensus.cc:2272] T 44db1fb7c007438398ce78e1bf686291 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.764896  7076 tablet_replica.cc:333] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.765416  7076 raft_consensus.cc:2243] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.765831  7076 raft_consensus.cc:2272] T 8c9282e9c78a46a6a3bba23269e7adc7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.767669  7076 tablet_replica.cc:333] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.768242  7076 raft_consensus.cc:2243] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.768641  7076 raft_consensus.cc:2272] T 0464e1aacb18475980f90e52a22f5c55 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.770361  7076 tablet_replica.cc:333] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.770850  7076 raft_consensus.cc:2243] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.771253  7076 raft_consensus.cc:2272] T b9141f0570cd47eeb0583a4a7ca21ea0 P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.773149  7076 tablet_replica.cc:333] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.773660  7076 raft_consensus.cc:2243] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.774394  7076 raft_consensus.cc:2272] T 63a98c83dfc34effa3050c2c8c0121f9 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.776381  7076 tablet_replica.cc:333] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.776916  7076 raft_consensus.cc:2243] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.777639  7076 raft_consensus.cc:2272] T 2f560b8d81584651b4720691469eca98 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.779450  7076 tablet_replica.cc:333] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.779990  7076 raft_consensus.cc:2243] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.780730  7076 raft_consensus.cc:2272] T 876b3eb00a984f94a6d6df1d7472bedb P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.782652  7076 tablet_replica.cc:333] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.783164  7076 raft_consensus.cc:2243] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.783553  7076 raft_consensus.cc:2272] T e9e2af9154cf4749976dc55b506018e5 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.785447  7076 tablet_replica.cc:333] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.785985  7076 raft_consensus.cc:2243] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.786363  7076 raft_consensus.cc:2272] T 39f9212333fa40979fd9596511ba43b7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.788157  7076 tablet_replica.cc:333] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.788661  7076 raft_consensus.cc:2243] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.789373  7076 raft_consensus.cc:2272] T 8465239326774a1386ddba99f9e50efb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.791230  7076 tablet_replica.cc:333] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.791730  7076 raft_consensus.cc:2243] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.792141  7076 raft_consensus.cc:2272] T 965959c6060c4e31872a4d63bb4cc3d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.793999  7076 tablet_replica.cc:333] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.794490  7076 raft_consensus.cc:2243] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.795234  7076 raft_consensus.cc:2272] T fc372b890581484a9c147f584264c31f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.797281  7076 tablet_replica.cc:333] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.797825  7076 raft_consensus.cc:2243] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.798274  7076 raft_consensus.cc:2272] T d4848588d16a4c4f89e884a9f15ff4a7 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.800092 14300 consensus_peers.cc:597] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 -> Peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Couldn't send request to peer 45ddcb989aef4c9fa869766c3682632c. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.800485  7076 tablet_replica.cc:333] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.801295  7076 raft_consensus.cc:2243] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.802170  7076 raft_consensus.cc:2272] T 14767c1f0196445ea4a179965d06965f P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.804216 14300 consensus_peers.cc:597] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.804713  7076 tablet_replica.cc:333] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
W20260709 13:19:22.804877 14300 consensus_peers.cc:597] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.805496  7076 raft_consensus.cc:2243] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.805882  7076 raft_consensus.cc:2272] T d0dc0a81dec54a3496bdc7a82d00614c P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.808125  7076 tablet_replica.cc:333] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.808806  7076 raft_consensus.cc:2243] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.809382  7076 raft_consensus.cc:2272] T fb043e88ddb1409188b19489adb77959 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.811597  7076 tablet_replica.cc:333] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.812191  7076 raft_consensus.cc:2243] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.812621  7076 raft_consensus.cc:2272] T 3dfcde74e8344c17a4afcd878be63bbb P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.814563  7076 tablet_replica.cc:333] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.815066  7076 raft_consensus.cc:2243] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.815455  7076 raft_consensus.cc:2272] T 5fc5acb16ea44ef882abb6d9013b2848 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.817359  7076 tablet_replica.cc:333] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.817938  7076 raft_consensus.cc:2243] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.818313  7076 raft_consensus.cc:2272] T 190dd92193fb44399a0922353ce78a02 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.820580  7076 tablet_replica.cc:333] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.821165  7076 raft_consensus.cc:2243] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.821604  7076 raft_consensus.cc:2272] T f4709c305db34d068e37448bc1462f47 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.821615 14300 consensus_peers.cc:597] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.823755  7076 tablet_replica.cc:333] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.824349  7076 raft_consensus.cc:2243] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.825086  7076 raft_consensus.cc:2272] T 6e1e37d29fe1480da8cf0ccc966e8f5c P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.827119  7076 tablet_replica.cc:333] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.827654  7076 raft_consensus.cc:2243] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.828106  7076 raft_consensus.cc:2272] T 374a720a9f0d4319a36fe8b4b060a5d8 P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.830003  7076 tablet_replica.cc:333] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.830468  7076 raft_consensus.cc:2243] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.830928  7076 raft_consensus.cc:2272] T 3935d54132d142e595008d4783fa0ab6 P c19f7f4ddb074bd8997d01296c3080d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.833048  7076 tablet_replica.cc:333] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.833629  7076 raft_consensus.cc:2243] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.834528  7076 raft_consensus.cc:2272] T e96808d860d8457caea08dbac23516b3 P c19f7f4ddb074bd8997d01296c3080d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.837078  7076 tablet_replica.cc:333] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6: stopping tablet replica
I20260709 13:19:22.837628  7076 raft_consensus.cc:2243] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.838089  7076 raft_consensus.cc:2272] T f1f2f59055e248e889af1b4a2e30f27a P c19f7f4ddb074bd8997d01296c3080d6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.903965 14300 consensus_peers.cc:597] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:35883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.919893  7076 tablet_server.cc:196] TabletServer@127.6.233.3:0 shutdown complete.
I20260709 13:19:22.942984 15329 raft_consensus.cc:493] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:22.944670 15329 raft_consensus.cc:515] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:22.946974 15329 leader_election.cc:290] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
W20260709 13:19:22.952242 14300 leader_election.cc:336] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111)
W20260709 13:19:22.954954 14299 leader_election.cc:336] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:22.955376 14299 leader_election.cc:304] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:22.956166 15329 raft_consensus.cc:2749] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:22.970566 14300 consensus_peers.cc:597] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:35883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:23.003504  7076 tablet_server.cc:179] TabletServer@127.6.233.4:0 shutting down...
W20260709 13:19:23.010152 14300 consensus_peers.cc:597] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:35883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:23.035918 14300 consensus_peers.cc:597] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:35883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:23.043980 14300 consensus_peers.cc:597] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:35883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:23.056277  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:23.057265  7076 tablet_replica.cc:333] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.058421  7076 raft_consensus.cc:2243] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.058894  7076 raft_consensus.cc:2272] T 54d9e8510eb240098e1916592b497767 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.061197  7076 tablet_replica.cc:333] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.061787  7076 raft_consensus.cc:2243] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.062513  7076 raft_consensus.cc:2272] T f71afc145d3844248a07bbf2114fbd5f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.064607  7076 tablet_replica.cc:333] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.065178  7076 raft_consensus.cc:2243] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.065938  7076 raft_consensus.cc:2272] T ef01c7e413414a618fc490804422f834 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.068104  7076 tablet_replica.cc:333] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.068637  7076 raft_consensus.cc:2243] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.069042  7076 raft_consensus.cc:2272] T 3c732e8e709f497eaee427bcad377540 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.071022  7076 tablet_replica.cc:333] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.071574  7076 raft_consensus.cc:2243] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.072413  7076 raft_consensus.cc:2272] T cb81836efc194afea3e9a9b0a1e5d000 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.074296  7076 tablet_replica.cc:333] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.074838  7076 raft_consensus.cc:2243] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.075577  7076 raft_consensus.cc:2272] T 183f0c224f074c99903307d0678a8ccf P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.077491  7076 tablet_replica.cc:333] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.078019  7076 raft_consensus.cc:2243] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.078720  7076 raft_consensus.cc:2272] T cb9f8d4bb28b4564a44774231b92f8c9 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.080806  7076 tablet_replica.cc:333] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.081336  7076 raft_consensus.cc:2243] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.081765  7076 raft_consensus.cc:2272] T 34dc4074ff05452dbda3ce53bbc859f1 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.084277  7076 tablet_replica.cc:333] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.085016  7076 raft_consensus.cc:2243] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.086012  7076 raft_consensus.cc:2272] T a95255a6465943e199a2aa0b7601bf32 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:23.086572 14300 consensus_peers.cc:597] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 -> Peer c19f7f4ddb074bd8997d01296c3080d6 (127.6.233.3:35883): Couldn't send request to peer c19f7f4ddb074bd8997d01296c3080d6. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.3:35883: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:23.088335  7076 tablet_replica.cc:333] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.089011  7076 raft_consensus.cc:2243] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.089454  7076 raft_consensus.cc:2272] T fa413bb6214043609003b441decca56f P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.091575  7076 tablet_replica.cc:333] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.092293  7076 raft_consensus.cc:2243] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.092725  7076 raft_consensus.cc:2272] T 9490553a32884f388ba3fcdc7ae7ac6e P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.094841  7076 tablet_replica.cc:333] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.095431  7076 raft_consensus.cc:2243] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.095883  7076 raft_consensus.cc:2272] T 183a076c0e614a54b0a8875f351528a3 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.098075  7076 tablet_replica.cc:333] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.098649  7076 raft_consensus.cc:2243] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.099458  7076 raft_consensus.cc:2272] T 3dfcde74e8344c17a4afcd878be63bbb P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.101588  7076 tablet_replica.cc:333] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.102180  7076 raft_consensus.cc:2243] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.102632  7076 raft_consensus.cc:2272] T 29a259ed126849a0a6653f5d96884b87 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.105396  7076 tablet_replica.cc:333] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.106065  7076 raft_consensus.cc:2243] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.106864  7076 raft_consensus.cc:2272] T 8c9282e9c78a46a6a3bba23269e7adc7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.107678 15193 raft_consensus.cc:493] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:23.108108 15193 raft_consensus.cc:515] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:23.109092  7076 tablet_replica.cc:333] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.109738 15193 leader_election.cc:290] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:23.109997  7076 raft_consensus.cc:2243] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.110638  7076 raft_consensus.cc:2272] T e96808d860d8457caea08dbac23516b3 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.113663  7076 tablet_replica.cc:333] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
W20260709 13:19:23.113792 14299 leader_election.cc:336] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
W20260709 13:19:23.114471 14300 leader_election.cc:336] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111)
I20260709 13:19:23.114480  7076 raft_consensus.cc:2243] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.114838 14300 leader_election.cc:304] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:23.115180  7076 raft_consensus.cc:2272] T a7b2ad2ed67144c6b9baffea26c9ae16 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.115447 15193 raft_consensus.cc:2749] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:23.117368  7076 tablet_replica.cc:333] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.118202  7076 raft_consensus.cc:2243] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.118681  7076 raft_consensus.cc:2272] T 8465239326774a1386ddba99f9e50efb P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.120925  7076 tablet_replica.cc:333] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.121498  7076 raft_consensus.cc:2243] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.122323  7076 raft_consensus.cc:2272] T 965959c6060c4e31872a4d63bb4cc3d8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.124392  7076 tablet_replica.cc:333] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.124964  7076 raft_consensus.cc:2243] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.125434  7076 raft_consensus.cc:2272] T 7ac90eaea6aa409d802a00c504d1c104 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.127306  7076 tablet_replica.cc:333] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.127882  7076 raft_consensus.cc:2243] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.129245  7076 raft_consensus.cc:2272] T 190dd92193fb44399a0922353ce78a02 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.131321  7076 tablet_replica.cc:333] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.131875  7076 raft_consensus.cc:2243] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.132324  7076 raft_consensus.cc:2272] T 6a68e63a39ca44319695c6f4e9937912 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.134121  7076 tablet_replica.cc:333] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.134622  7076 raft_consensus.cc:2243] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.135380  7076 raft_consensus.cc:2272] T 374a720a9f0d4319a36fe8b4b060a5d8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.137392  7076 tablet_replica.cc:333] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.137898  7076 raft_consensus.cc:2243] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.138324  7076 raft_consensus.cc:2272] T 3935d54132d142e595008d4783fa0ab6 P 0646b0acb9c943b59389eace852a5215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.140153  7076 tablet_replica.cc:333] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.140683  7076 raft_consensus.cc:2243] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.141093  7076 raft_consensus.cc:2272] T e833ae6b3ffa414fb4f0f04c981b4e44 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.142819  7076 tablet_replica.cc:333] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.143319  7076 raft_consensus.cc:2243] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.143697  7076 raft_consensus.cc:2272] T 876b3eb00a984f94a6d6df1d7472bedb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.145486  7076 tablet_replica.cc:333] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.145994  7076 raft_consensus.cc:2243] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.146418  7076 raft_consensus.cc:2272] T df25294a6ce4432cbffe41a0bee4c8b8 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.148185  7076 tablet_replica.cc:333] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.148670  7076 raft_consensus.cc:2243] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.149135  7076 raft_consensus.cc:2272] T e9e2af9154cf4749976dc55b506018e5 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.151005  7076 tablet_replica.cc:333] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.151522  7076 raft_consensus.cc:2243] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.151988  7076 raft_consensus.cc:2272] T 8e519b3fde754be785619f806259cbcb P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.152165 15193 raft_consensus.cc:493] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:23.152652 15193 raft_consensus.cc:515] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } }
I20260709 13:19:23.154102  7076 tablet_replica.cc:333] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.154306 15193 leader_election.cc:290] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091), 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585)
I20260709 13:19:23.154881  7076 raft_consensus.cc:2243] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.155387  7076 raft_consensus.cc:2272] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.154914 15193 raft_consensus.cc:493] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 675788979b2e4a89be45b2af4fa3141a)
I20260709 13:19:23.156608 15193 raft_consensus.cc:515] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0646b0acb9c943b59389eace852a5215" member_type: VOTER last_known_addr { host: "127.6.233.4" port: 40795 } } peers { permanent_uuid: "675788979b2e4a89be45b2af4fa3141a" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34585 } } peers { permanent_uuid: "45ddcb989aef4c9fa869766c3682632c" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46091 } }
I20260709 13:19:23.157846  7076 tablet_replica.cc:333] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
W20260709 13:19:23.158595 14299 leader_election.cc:336] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:23.158625  7076 raft_consensus.cc:2243] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.158660 15193 leader_election.cc:290] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585), 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091)
I20260709 13:19:23.159932  7076 raft_consensus.cc:2272] T d4848588d16a4c4f89e884a9f15ff4a7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:23.159608 14300 leader_election.cc:336] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111)
I20260709 13:19:23.160724 14300 leader_election.cc:304] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
W20260709 13:19:23.161212 14300 raft_consensus.cc:2686] T 3ccef079cb964f8a83bfcafbe3f15e74 P 0646b0acb9c943b59389eace852a5215: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:19:23.162629  7076 tablet_replica.cc:333] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.163446  7076 raft_consensus.cc:2243] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:23.163506 14299 leader_election.cc:336] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 675788979b2e4a89be45b2af4fa3141a (127.6.233.1:34585): Network error: Client connection negotiation failed: client connection to 127.6.233.1:34585: connect: Connection refused (error 111)
I20260709 13:19:23.164067  7076 raft_consensus.cc:2272] T 14767c1f0196445ea4a179965d06965f P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:23.164494 14300 leader_election.cc:336] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 45ddcb989aef4c9fa869766c3682632c (127.6.233.2:46091): Network error: Client connection negotiation failed: client connection to 127.6.233.2:46091: connect: Connection refused (error 111)
I20260709 13:19:23.164831 14300 leader_election.cc:304] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0646b0acb9c943b59389eace852a5215; no voters: 45ddcb989aef4c9fa869766c3682632c, 675788979b2e4a89be45b2af4fa3141a
I20260709 13:19:23.165383 15193 raft_consensus.cc:2749] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:23.166283  7076 tablet_replica.cc:333] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.166851  7076 raft_consensus.cc:2243] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.167280  7076 raft_consensus.cc:2272] T b9141f0570cd47eeb0583a4a7ca21ea0 P 0646b0acb9c943b59389eace852a5215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.169121  7076 tablet_replica.cc:333] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.169607  7076 raft_consensus.cc:2243] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.170008  7076 raft_consensus.cc:2272] T 63a98c83dfc34effa3050c2c8c0121f9 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.171736  7076 tablet_replica.cc:333] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.172281  7076 raft_consensus.cc:2243] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.172688  7076 raft_consensus.cc:2272] T 2f560b8d81584651b4720691469eca98 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.174394  7076 tablet_replica.cc:333] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.174882  7076 raft_consensus.cc:2243] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.175333  7076 raft_consensus.cc:2272] T fa77825c4a1b4199b0876c76e8ed77aa P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.176986  7076 tablet_replica.cc:333] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.177426  7076 raft_consensus.cc:2243] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.177776  7076 raft_consensus.cc:2272] T d3d4f8d14e954ef5af8eb1736629b53b P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.179461  7076 tablet_replica.cc:333] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.179905  7076 raft_consensus.cc:2243] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.180311  7076 raft_consensus.cc:2272] T 39f9212333fa40979fd9596511ba43b7 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.182005  7076 tablet_replica.cc:333] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.182416  7076 raft_consensus.cc:2243] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.183104  7076 raft_consensus.cc:2272] T 27f20266f4854ae8ae019ba0cb907c7c P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.184963  7076 tablet_replica.cc:333] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.185387  7076 raft_consensus.cc:2243] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.185694  7076 raft_consensus.cc:2272] T 847793586a524d1e9df7a07c31f2d186 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.187418  7076 tablet_replica.cc:333] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.187827  7076 raft_consensus.cc:2243] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.188553  7076 raft_consensus.cc:2272] T 0464e1aacb18475980f90e52a22f5c55 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.190287  7076 tablet_replica.cc:333] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.190831  7076 raft_consensus.cc:2243] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.191277  7076 raft_consensus.cc:2272] T ed9afc388a1546c28fcf9777a5e31674 P 0646b0acb9c943b59389eace852a5215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.193303  7076 tablet_replica.cc:333] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.193746  7076 raft_consensus.cc:2243] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.194535  7076 raft_consensus.cc:2272] T f4709c305db34d068e37448bc1462f47 P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.196419  7076 tablet_replica.cc:333] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215: stopping tablet replica
I20260709 13:19:23.196838  7076 raft_consensus.cc:2243] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.197217  7076 raft_consensus.cc:2272] T 6e1e37d29fe1480da8cf0ccc966e8f5c P 0646b0acb9c943b59389eace852a5215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.265551  7076 tablet_server.cc:196] TabletServer@127.6.233.4:0 shutdown complete.
I20260709 13:19:23.332115  7076 master.cc:562] Master@127.6.233.62:33061 shutting down...
I20260709 13:19:23.359349  7076 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.359927  7076 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.360369  7076 tablet_replica.cc:333] T 00000000000000000000000000000000 P b1775a7361c44e159677c5147165954e: stopping tablet replica
I20260709 13:19:23.417362  7076 master.cc:584] Master@127.6.233.62:33061 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34352 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:19:23.506069  7076 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.233.62:43277
I20260709 13:19:23.507344  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:23.513191 15331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:23.513458 15332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:23.514046 15334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:23.516213  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:23.517398  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:23.517606  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:23.517769  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603163517752 us; error 0 us; skew 500 ppm
I20260709 13:19:23.518301  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:23.520730  7076 webserver.cc:533] Webserver started at http://127.6.233.62:36083/ using document root <none> and password file <none>
I20260709 13:19:23.521214  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:23.521415  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:23.521684  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:23.522754  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/master-0-root/instance:
uuid: "3e381a20642f412c863fea57071b9c7a"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:23.527247  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:23.530462 15339 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.531186  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:23.531463  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/master-0-root
uuid: "3e381a20642f412c863fea57071b9c7a"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:23.531755  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:23.558754  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:23.559993  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:23.599511  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.62:43277
I20260709 13:19:23.599622 15390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.62:43277 every 8 connection(s)
I20260709 13:19:23.603384 15391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:23.614234 15391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a: Bootstrap starting.
I20260709 13:19:23.619223 15391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:23.623672 15391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a: No bootstrap required, opened a new log
I20260709 13:19:23.625880 15391 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e381a20642f412c863fea57071b9c7a" member_type: VOTER }
I20260709 13:19:23.626416 15391 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:23.626690 15391 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e381a20642f412c863fea57071b9c7a, State: Initialized, Role: FOLLOWER
I20260709 13:19:23.627379 15391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e381a20642f412c863fea57071b9c7a" member_type: VOTER }
I20260709 13:19:23.627818 15391 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:23.628072 15391 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:23.628376 15391 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.633050 15391 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e381a20642f412c863fea57071b9c7a" member_type: VOTER }
I20260709 13:19:23.633667 15391 leader_election.cc:304] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e381a20642f412c863fea57071b9c7a; no voters: 
I20260709 13:19:23.634871 15391 leader_election.cc:290] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:23.635246 15394 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:23.636649 15394 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 1 LEADER]: Becoming Leader. State: Replica: 3e381a20642f412c863fea57071b9c7a, State: Running, Role: LEADER
I20260709 13:19:23.637319 15394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e381a20642f412c863fea57071b9c7a" member_type: VOTER }
I20260709 13:19:23.637780 15391 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:23.641933 15395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e381a20642f412c863fea57071b9c7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e381a20642f412c863fea57071b9c7a" member_type: VOTER } }
I20260709 13:19:23.642518 15395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:23.643623 15396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e381a20642f412c863fea57071b9c7a. Latest consensus state: current_term: 1 leader_uuid: "3e381a20642f412c863fea57071b9c7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e381a20642f412c863fea57071b9c7a" member_type: VOTER } }
I20260709 13:19:23.644236 15396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:23.648948 15401 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:23.656479 15401 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:23.657461  7076 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:23.664829 15401 catalog_manager.cc:1383] Generated new cluster ID: 79ece51a3a0c441284135301ce90d952
I20260709 13:19:23.665104 15401 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:23.680708 15401 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:23.681982 15401 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:23.701606 15401 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a: Generated new TSK 0
I20260709 13:19:23.702216 15401 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:23.723933  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:23.729964 15412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:23.730741 15413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:23.733366  7076 server_base.cc:1061] running on GCE node
W20260709 13:19:23.735193 15415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:23.738682  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:23.738950  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:23.739117  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603163739104 us; error 0 us; skew 500 ppm
I20260709 13:19:23.739696  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:23.742033  7076 webserver.cc:533] Webserver started at http://127.6.233.1:36277/ using document root <none> and password file <none>
I20260709 13:19:23.742506  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:23.742694  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:23.742985  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:23.744024  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root/instance:
uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:23.748436  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:19:23.751552 15420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.752421  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:19:23.752661  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:23.752907  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:23.774987  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:23.776247  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:23.777662  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:23.779989  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:23.780213  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.780483  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:23.780655  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.820415  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:45251
I20260709 13:19:23.820521 15482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:45251 every 8 connection(s)
I20260709 13:19:23.825376  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:23.832585 15487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:23.834388 15488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:23.836447 15490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:23.836529  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:23.837845  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:23.838078  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:23.838275  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603163838257 us; error 0 us; skew 500 ppm
I20260709 13:19:23.838795  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:23.841632  7076 webserver.cc:533] Webserver started at http://127.6.233.2:33785/ using document root <none> and password file <none>
I20260709 13:19:23.842182  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:23.842402  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:23.842725  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:23.843319 15483 heartbeater.cc:344] Connected to a master server at 127.6.233.62:43277
I20260709 13:19:23.843786 15483 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:23.844173  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-1-root/instance:
uuid: "6cafb1b5fa254559a839a39f95b9a19a"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:23.844697 15483 heartbeater.cc:507] Master 127.6.233.62:43277 requested a full tablet report, sending...
I20260709 13:19:23.847091 15356 ts_manager.cc:194] Registered new tserver with Master: 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251)
I20260709 13:19:23.849583 15356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48360
I20260709 13:19:23.850128  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:23.854185 15495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.855059  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:23.855316  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-1-root
uuid: "6cafb1b5fa254559a839a39f95b9a19a"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:23.855561  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:23.872861  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:23.873986  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:23.875340  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:23.877491  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:23.877693  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.877972  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:23.878134  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.918644  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.2:46415
I20260709 13:19:23.918754 15557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.2:46415 every 8 connection(s)
I20260709 13:19:23.923398  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:23.930768 15561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:23.931310 15562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:23.934247  7076 server_base.cc:1061] running on GCE node
W20260709 13:19:23.934463 15565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:23.935669  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:23.935945  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:23.936185  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603163936165 us; error 0 us; skew 500 ppm
I20260709 13:19:23.936911  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:23.936942 15558 heartbeater.cc:344] Connected to a master server at 127.6.233.62:43277
I20260709 13:19:23.937435 15558 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:23.938313 15558 heartbeater.cc:507] Master 127.6.233.62:43277 requested a full tablet report, sending...
I20260709 13:19:23.939846  7076 webserver.cc:533] Webserver started at http://127.6.233.3:41377/ using document root <none> and password file <none>
I20260709 13:19:23.940478  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:23.940459 15356 ts_manager.cc:194] Registered new tserver with Master: 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:23.940871  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:23.941183  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:23.942025 15356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48374
I20260709 13:19:23.942310  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-2-root/instance:
uuid: "6730ecd4b1d5461997d975e1e0e93917"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:23.946835  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:23.950034 15569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.950757  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:23.951047  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-2-root
uuid: "6730ecd4b1d5461997d975e1e0e93917"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:23.951356  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:23.968834  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:23.970007  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:23.971412  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:23.973565  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:23.973793  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:23.974040  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:23.974212  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:24.012876  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.3:33797
I20260709 13:19:24.012993 15631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.3:33797 every 8 connection(s)
I20260709 13:19:24.026787 15632 heartbeater.cc:344] Connected to a master server at 127.6.233.62:43277
I20260709 13:19:24.027247 15632 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:24.027973 15632 heartbeater.cc:507] Master 127.6.233.62:43277 requested a full tablet report, sending...
I20260709 13:19:24.030092 15356 ts_manager.cc:194] Registered new tserver with Master: 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:24.030728  7076 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01468207s
I20260709 13:19:24.031519 15356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48384
I20260709 13:19:24.056905 15356 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48388:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:24.059942 15356 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:24.137786 15596 tablet_service.cc:1511] Processing CreateTablet for tablet 366512517bb54846832acb3aa279aeb4 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:24.137786 15597 tablet_service.cc:1511] Processing CreateTablet for tablet 49dae0aab0d740888c95b1d0a26d62c7 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:24.139312 15596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366512517bb54846832acb3aa279aeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.141268 15597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49dae0aab0d740888c95b1d0a26d62c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.152917 15595 tablet_service.cc:1511] Processing CreateTablet for tablet d2090e23184548509734e73d7676a1c9 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:24.154366 15595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2090e23184548509734e73d7676a1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.158367 15594 tablet_service.cc:1511] Processing CreateTablet for tablet c65b1035590e41cbbc5b51a8c3e5e0b4 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:24.160214 15594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b1035590e41cbbc5b51a8c3e5e0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.166458 15593 tablet_service.cc:1511] Processing CreateTablet for tablet a5cda7404bba4460b66b3e328e320c39 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:24.166833 15447 tablet_service.cc:1511] Processing CreateTablet for tablet 366512517bb54846832acb3aa279aeb4 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:24.168015 15593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cda7404bba4460b66b3e328e320c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.175906 15591 tablet_service.cc:1511] Processing CreateTablet for tablet 7746ae5a62294618aa5b1024e2183248 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:24.177486 15591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7746ae5a62294618aa5b1024e2183248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.168275 15447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366512517bb54846832acb3aa279aeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.182727 15441 tablet_service.cc:1511] Processing CreateTablet for tablet 904af91a3bcf498fae5d1d5fc130072d (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:24.184248 15441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904af91a3bcf498fae5d1d5fc130072d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.169317 15448 tablet_service.cc:1511] Processing CreateTablet for tablet 49dae0aab0d740888c95b1d0a26d62c7 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:24.170565 15446 tablet_service.cc:1511] Processing CreateTablet for tablet d2090e23184548509734e73d7676a1c9 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:24.171144 15592 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5ba5a7dc9d4324b7bd5b73a51d9369 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:24.188015 15592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5ba5a7dc9d4324b7bd5b73a51d9369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.189018 15590 tablet_service.cc:1511] Processing CreateTablet for tablet 904af91a3bcf498fae5d1d5fc130072d (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:24.190478 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904af91a3bcf498fae5d1d5fc130072d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.171867 15445 tablet_service.cc:1511] Processing CreateTablet for tablet c65b1035590e41cbbc5b51a8c3e5e0b4 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:24.172714 15442 tablet_service.cc:1511] Processing CreateTablet for tablet 7746ae5a62294618aa5b1024e2183248 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:24.193307 15440 tablet_service.cc:1511] Processing CreateTablet for tablet eaa3cf8c223242aa9d4af09b802e0976 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:24.195456 15589 tablet_service.cc:1511] Processing CreateTablet for tablet eaa3cf8c223242aa9d4af09b802e0976 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:24.195842 15439 tablet_service.cc:1511] Processing CreateTablet for tablet 1728ef80cec94c2da5abafaca79cfb9a (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:24.196944 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa3cf8c223242aa9d4af09b802e0976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.199717 15588 tablet_service.cc:1511] Processing CreateTablet for tablet 1728ef80cec94c2da5abafaca79cfb9a (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:24.173151 15444 tablet_service.cc:1511] Processing CreateTablet for tablet a5cda7404bba4460b66b3e328e320c39 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:24.174407 15443 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5ba5a7dc9d4324b7bd5b73a51d9369 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:24.201175 15588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1728ef80cec94c2da5abafaca79cfb9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.202596 15448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49dae0aab0d740888c95b1d0a26d62c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.207307 15443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5ba5a7dc9d4324b7bd5b73a51d9369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.208082 15444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cda7404bba4460b66b3e328e320c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.209594 15440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa3cf8c223242aa9d4af09b802e0976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.210337 15442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7746ae5a62294618aa5b1024e2183248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.212369 15439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1728ef80cec94c2da5abafaca79cfb9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.217136 15446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2090e23184548509734e73d7676a1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.218607 15445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b1035590e41cbbc5b51a8c3e5e0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.290107 15647 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:24.305662 15647 tablet_bootstrap.cc:654] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.332221 15523 tablet_service.cc:1511] Processing CreateTablet for tablet 49dae0aab0d740888c95b1d0a26d62c7 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:24.332897 15520 tablet_service.cc:1511] Processing CreateTablet for tablet c65b1035590e41cbbc5b51a8c3e5e0b4 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:24.333338 15521 tablet_service.cc:1511] Processing CreateTablet for tablet d2090e23184548509734e73d7676a1c9 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:24.333870 15523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49dae0aab0d740888c95b1d0a26d62c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.336809 15521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2090e23184548509734e73d7676a1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.334687 15518 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5ba5a7dc9d4324b7bd5b73a51d9369 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:24.335076 15522 tablet_service.cc:1511] Processing CreateTablet for tablet 366512517bb54846832acb3aa279aeb4 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:24.335569 15519 tablet_service.cc:1511] Processing CreateTablet for tablet a5cda7404bba4460b66b3e328e320c39 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:24.338267 15522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366512517bb54846832acb3aa279aeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.338099 15516 tablet_service.cc:1511] Processing CreateTablet for tablet 904af91a3bcf498fae5d1d5fc130072d (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:24.338958 15518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5ba5a7dc9d4324b7bd5b73a51d9369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.340534 15515 tablet_service.cc:1511] Processing CreateTablet for tablet eaa3cf8c223242aa9d4af09b802e0976 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:24.341123 15519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5cda7404bba4460b66b3e328e320c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.341828 15515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaa3cf8c223242aa9d4af09b802e0976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.336434 15517 tablet_service.cc:1511] Processing CreateTablet for tablet 7746ae5a62294618aa5b1024e2183248 (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:24.344527 15517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7746ae5a62294618aa5b1024e2183248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.345106 15520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b1035590e41cbbc5b51a8c3e5e0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.345785 15516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 904af91a3bcf498fae5d1d5fc130072d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.348644 15648 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:24.349779 15647 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:24.350339 15647 ts_tablet_manager.cc:1403] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.000s
I20260709 13:19:24.353315 15514 tablet_service.cc:1511] Processing CreateTablet for tablet 1728ef80cec94c2da5abafaca79cfb9a (DEFAULT_TABLE table=test-workload [id=73e2df03b8e94d22b28d9a2106e733fc]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:24.353718 15647 raft_consensus.cc:359] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.354581 15647 raft_consensus.cc:385] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.354671 15514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1728ef80cec94c2da5abafaca79cfb9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:24.354959 15647 raft_consensus.cc:740] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.360828 15647 consensus_queue.cc:260] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.400607 15648 tablet_bootstrap.cc:654] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.410737 15632 heartbeater.cc:499] Master 127.6.233.62:43277 was elected leader, sending a full tablet report...
I20260709 13:19:24.414582 15647 ts_tablet_manager.cc:1434] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.064s	user 0.020s	sys 0.000s
I20260709 13:19:24.415740 15647 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:24.422735 15647 tablet_bootstrap.cc:654] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.435144 15647 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:24.439908 15647 ts_tablet_manager.cc:1403] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.006s
I20260709 13:19:24.440629 15651 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:24.443463 15647 raft_consensus.cc:359] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.444268 15648 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:24.444325 15647 raft_consensus.cc:385] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.445026 15648 ts_tablet_manager.cc:1403] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.000s
I20260709 13:19:24.444943 15647 raft_consensus.cc:740] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.445839 15651 tablet_bootstrap.cc:654] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.446205 15647 consensus_queue.cc:260] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.448729 15647 ts_tablet_manager.cc:1434] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:24.450098 15647 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:24.452136 15648 raft_consensus.cc:359] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.456207 15648 raft_consensus.cc:385] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.457275 15647 tablet_bootstrap.cc:654] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.457273 15648 raft_consensus.cc:740] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.461284 15648 consensus_queue.cc:260] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.492004 15651 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:24.492236 15483 heartbeater.cc:499] Master 127.6.233.62:43277 was elected leader, sending a full tablet report...
I20260709 13:19:24.492635 15651 ts_tablet_manager.cc:1403] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.034s
I20260709 13:19:24.492744 15648 ts_tablet_manager.cc:1434] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.025s
I20260709 13:19:24.493834 15648 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:24.496345 15647 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:24.496201 15651 raft_consensus.cc:359] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.496951 15647 ts_tablet_manager.cc:1403] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.014s
I20260709 13:19:24.497012 15651 raft_consensus.cc:385] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.497507 15651 raft_consensus.cc:740] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.498415 15651 consensus_queue.cc:260] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.500486 15648 tablet_bootstrap.cc:654] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.500348 15647 raft_consensus.cc:359] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.501304 15647 raft_consensus.cc:385] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.501669 15647 raft_consensus.cc:740] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.502663 15647 consensus_queue.cc:260] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.505146 15647 ts_tablet_manager.cc:1434] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:24.506219 15647 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:24.513033 15647 tablet_bootstrap.cc:654] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.517683 15651 ts_tablet_manager.cc:1434] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.011s
I20260709 13:19:24.518100 15558 heartbeater.cc:499] Master 127.6.233.62:43277 was elected leader, sending a full tablet report...
I20260709 13:19:24.518874 15651 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
W20260709 13:19:24.519464 15633 tablet.cc:2406] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:24.519583 15648 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:24.520293 15648 ts_tablet_manager.cc:1403] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 13:19:24.523409 15648 raft_consensus.cc:359] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.524192 15648 raft_consensus.cc:385] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.524546 15648 raft_consensus.cc:740] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.525766 15651 tablet_bootstrap.cc:654] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.525339 15648 consensus_queue.cc:260] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.527891 15648 ts_tablet_manager.cc:1434] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:19:24.528832 15648 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:24.532737 15657 raft_consensus.cc:493] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.536295 15648 tablet_bootstrap.cc:654] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.533370 15657 raft_consensus.cc:515] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.546463 15647 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:24.547065 15647 ts_tablet_manager.cc:1403] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 13:19:24.548447 15651 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:24.549089 15651 ts_tablet_manager.cc:1403] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.019s
I20260709 13:19:24.549476 15648 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:24.550047 15648 ts_tablet_manager.cc:1403] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.015s
I20260709 13:19:24.550194 15647 raft_consensus.cc:359] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.550963 15647 raft_consensus.cc:385] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.551257 15647 raft_consensus.cc:740] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.552207 15651 raft_consensus.cc:359] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.552997 15651 raft_consensus.cc:385] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.553321 15651 raft_consensus.cc:740] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.553467 15648 raft_consensus.cc:359] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.554293 15648 raft_consensus.cc:385] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.554231 15651 consensus_queue.cc:260] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.554801 15648 raft_consensus.cc:740] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.555763 15648 consensus_queue.cc:260] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.556596 15651 ts_tablet_manager.cc:1434] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:24.557657 15651 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:24.557822 15657 leader_election.cc:290] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:24.558588 15648 ts_tablet_manager.cc:1434] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:24.559684 15648 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:24.562373 15647 consensus_queue.cc:260] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.565136 15651 tablet_bootstrap.cc:654] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.566783 15648 tablet_bootstrap.cc:654] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.574539 15647 ts_tablet_manager.cc:1434] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:19:24.576556 15647 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:24.579010 15651 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:24.585675 15651 ts_tablet_manager.cc:1403] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 13:19:24.589411 15651 raft_consensus.cc:359] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.590337 15651 raft_consensus.cc:385] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.590750 15651 raft_consensus.cc:740] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.591660 15651 consensus_queue.cc:260] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.593902 15647 tablet_bootstrap.cc:654] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.594010 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
W20260709 13:19:24.596410 15496 leader_election.cc:343] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.598906 15651 ts_tablet_manager.cc:1434] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:19:24.600061 15651 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:24.607265 15651 tablet_bootstrap.cc:654] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.616627 15650 raft_consensus.cc:493] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.617374 15650 raft_consensus.cc:515] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.620575 15651 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:24.621228 15651 ts_tablet_manager.cc:1403] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:19:24.622924 15650 leader_election.cc:290] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.620592 15648 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:24.623797 15651 raft_consensus.cc:359] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.624583 15651 raft_consensus.cc:385] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.624758 15648 ts_tablet_manager.cc:1403] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.065s	user 0.036s	sys 0.022s
I20260709 13:19:24.624939 15651 raft_consensus.cc:740] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.626096 15651 consensus_queue.cc:260] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.628535 15651 ts_tablet_manager.cc:1434] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:19:24.628597 15648 raft_consensus.cc:359] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.629621 15648 raft_consensus.cc:385] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.629765 15651 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:24.630076 15648 raft_consensus.cc:740] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.630964 15647 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:24.631506 15647 ts_tablet_manager.cc:1403] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.009s
I20260709 13:19:24.631108 15648 consensus_queue.cc:260] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.634145 15648 ts_tablet_manager.cc:1434] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 13:19:24.635316 15648 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:24.640972 15651 tablet_bootstrap.cc:654] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.642601 15648 tablet_bootstrap.cc:654] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.645701 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
W20260709 13:19:24.647806 15499 leader_election.cc:343] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.648491 15499 leader_election.cc:304] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a; no voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e
I20260709 13:19:24.649765 15661 raft_consensus.cc:2749] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:24.651453 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:24.651368 15647 raft_consensus.cc:359] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.657640 15647 raft_consensus.cc:385] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.657971 15647 raft_consensus.cc:740] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.658834 15647 consensus_queue.cc:260] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.660450 15650 raft_consensus.cc:493] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.660931 15650 raft_consensus.cc:515] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.665263 15650 leader_election.cc:290] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.667279 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366512517bb54846832acb3aa279aeb4" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:24.668255 15458 raft_consensus.cc:2468] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 0.
I20260709 13:19:24.669951 15647 ts_tablet_manager.cc:1434] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.004s
I20260709 13:19:24.670073 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cda7404bba4460b66b3e328e320c39" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:24.670778 15458 raft_consensus.cc:2468] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 0.
I20260709 13:19:24.671185 15647 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:24.672256 15570 leader_election.cc:304] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:24.673421 15650 raft_consensus.cc:2804] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.673902 15650 raft_consensus.cc:493] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.674234 15650 raft_consensus.cc:3060] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.676436 15648 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:24.678786 15648 ts_tablet_manager.cc:1403] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.012s
I20260709 13:19:24.679677 15533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366512517bb54846832acb3aa279aeb4" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
I20260709 13:19:24.680420 15570 leader_election.cc:304] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:24.681321 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cda7404bba4460b66b3e328e320c39" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
I20260709 13:19:24.681562 15651 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
W20260709 13:19:24.682838 15572 leader_election.cc:343] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.682544 15648 raft_consensus.cc:359] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.683770 15648 raft_consensus.cc:385] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.683911 15650 raft_consensus.cc:515] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
W20260709 13:19:24.684185 15572 leader_election.cc:343] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.684248 15648 raft_consensus.cc:740] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.683102 15651 ts_tablet_manager.cc:1403] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.011s
I20260709 13:19:24.685657 15648 consensus_queue.cc:260] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.686980 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366512517bb54846832acb3aa279aeb4" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:24.687588 15458 raft_consensus.cc:3060] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.688447 15651 raft_consensus.cc:359] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.689321 15651 raft_consensus.cc:385] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.689670 15651 raft_consensus.cc:740] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.689122 15673 raft_consensus.cc:2804] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.690586 15673 raft_consensus.cc:493] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.690914 15673 raft_consensus.cc:3060] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.692086 15648 ts_tablet_manager.cc:1434] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:24.693403 15648 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:24.699993 15458 raft_consensus.cc:2468] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 1.
I20260709 13:19:24.702240 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366512517bb54846832acb3aa279aeb4" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:24.702404 15570 leader_election.cc:304] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:24.702778 15651 consensus_queue.cc:260] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
W20260709 13:19:24.704077 15572 leader_election.cc:343] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.700621 15648 tablet_bootstrap.cc:654] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.705564 15651 ts_tablet_manager.cc:1434] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:24.705525 15673 raft_consensus.cc:515] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.706948 15651 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:24.708972 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cda7404bba4460b66b3e328e320c39" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
W20260709 13:19:24.710635 15572 leader_election.cc:343] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.711994 15661 raft_consensus.cc:493] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.712541 15661 raft_consensus.cc:515] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.714740 15661 leader_election.cc:290] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797), 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251)
I20260709 13:19:24.700857 15650 leader_election.cc:290] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.717042 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:24.720322 15651 tablet_bootstrap.cc:654] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.720744 15647 tablet_bootstrap.cc:654] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.719928 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
I20260709 13:19:24.718894 15661 raft_consensus.cc:493] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.717767 15648 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:24.722018 15648 ts_tablet_manager.cc:1403] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.000s
I20260709 13:19:24.721668 15661 raft_consensus.cc:515] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.720809 15457 raft_consensus.cc:2468] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 0.
I20260709 13:19:24.719575 15674 raft_consensus.cc:2804] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.725229 15648 raft_consensus.cc:359] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.725957 15648 raft_consensus.cc:385] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.726033 15496 leader_election.cc:304] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:24.726290 15648 raft_consensus.cc:740] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.726608 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:24.726011 15674 raft_consensus.cc:697] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:24.718142 15675 raft_consensus.cc:493] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.748338 15675 raft_consensus.cc:515] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.726969 15657 raft_consensus.cc:2804] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.749656 15657 raft_consensus.cc:493] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.749907 15607 raft_consensus.cc:2468] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 0.
I20260709 13:19:24.719025 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cda7404bba4460b66b3e328e320c39" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:24.730342 15606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
I20260709 13:19:24.752144 15458 raft_consensus.cc:3060] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:24.756114 15499 leader_election.cc:343] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.730018 15661 leader_election.cc:290] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:24.747560 15457 raft_consensus.cc:2468] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 0.
I20260709 13:19:24.747944 15674 consensus_queue.cc:237] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.726707 15673 leader_election.cc:290] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.750221 15657 raft_consensus.cc:3060] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.744295 15648 consensus_queue.cc:260] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.762303 15648 ts_tablet_manager.cc:1434] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.002s
I20260709 13:19:24.763707 15648 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:24.771021 15496 leader_election.cc:304] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:24.772403 15661 raft_consensus.cc:2804] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.772823 15661 raft_consensus.cc:493] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.773165 15661 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.774915 15675 leader_election.cc:290] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.775599 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:24.775935 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
I20260709 13:19:24.781733 15457 raft_consensus.cc:2468] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 0.
I20260709 13:19:24.779103 15458 raft_consensus.cc:2468] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 1.
I20260709 13:19:24.783053 15570 leader_election.cc:304] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:24.780054 15648 tablet_bootstrap.cc:654] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.784195 15570 leader_election.cc:304] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:24.785396 15650 raft_consensus.cc:2804] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.785867 15650 raft_consensus.cc:493] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.786311 15650 raft_consensus.cc:3060] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.786473 15674 raft_consensus.cc:2804] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.787197 15674 raft_consensus.cc:697] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:24.788115 15674 consensus_queue.cc:237] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.779816 15657 raft_consensus.cc:515] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.792102 15532 raft_consensus.cc:2393] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6730ecd4b1d5461997d975e1e0e93917 in current term 1: Already voted for candidate 6cafb1b5fa254559a839a39f95b9a19a in this term.
I20260709 13:19:24.796890 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:24.804812 15647 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:24.805570 15647 ts_tablet_manager.cc:1403] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.135s	user 0.013s	sys 0.026s
I20260709 13:19:24.820787 15356 catalog_manager.cc:5697] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.822480 15675 raft_consensus.cc:493] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.823139 15675 raft_consensus.cc:515] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.824182 15657 leader_election.cc:290] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Requested vote from peers 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797), 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251)
I20260709 13:19:24.824488 15651 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:24.825047 15651 ts_tablet_manager.cc:1403] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.118s	user 0.025s	sys 0.059s
I20260709 13:19:24.825189 15675 leader_election.cc:290] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.827302 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:24.827878 15457 raft_consensus.cc:3060] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.828473 15661 raft_consensus.cc:515] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.830231 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:24.830935 15458 raft_consensus.cc:2468] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 0.
I20260709 13:19:24.831248 15661 leader_election.cc:290] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:24.833238 15570 leader_election.cc:304] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:24.833566 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
W20260709 13:19:24.834976 15572 leader_election.cc:343] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.835194 15675 raft_consensus.cc:2804] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.835762 15675 raft_consensus.cc:493] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.840353 15606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:24.840250 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:24.840771 15675 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.841187 15458 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:24.841813 15499 leader_election.cc:343] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.842094 15650 raft_consensus.cc:515] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.843367 15607 raft_consensus.cc:2393] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6cafb1b5fa254559a839a39f95b9a19a in current term 1: Already voted for candidate 6730ecd4b1d5461997d975e1e0e93917 in this term.
I20260709 13:19:24.845086 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:24.846611 15650 leader_election.cc:290] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.847395 15675 raft_consensus.cc:515] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.847735 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:24.848635 15532 raft_consensus.cc:2393] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6730ecd4b1d5461997d975e1e0e93917 in current term 1: Already voted for candidate 6cafb1b5fa254559a839a39f95b9a19a in this term.
I20260709 13:19:24.837697 15457 raft_consensus.cc:2468] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 1.
I20260709 13:19:24.850200 15572 leader_election.cc:304] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917; no voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e
I20260709 13:19:24.850328 15496 leader_election.cc:304] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:24.851161 15661 raft_consensus.cc:2804] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.851801 15458 raft_consensus.cc:2468] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 1.
I20260709 13:19:24.852546 15661 raft_consensus.cc:697] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:24.853048 15496 leader_election.cc:304] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:24.853857 15657 raft_consensus.cc:2804] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.853462 15661 consensus_queue.cc:237] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:24.855786 15650 raft_consensus.cc:2749] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:24.859659 15650 raft_consensus.cc:493] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.860113 15650 raft_consensus.cc:515] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.861627 15647 raft_consensus.cc:359] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.862362 15647 raft_consensus.cc:385] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.862651 15647 raft_consensus.cc:740] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.864820 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:24.865445 15457 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.866046 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
W20260709 13:19:24.867450 15572 leader_election.cc:343] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.867990 15675 leader_election.cc:290] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.868697 15647 consensus_queue.cc:260] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.871397 15647 ts_tablet_manager.cc:1434] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.002s
I20260709 13:19:24.872481 15647 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:24.873292 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:24.873621 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
I20260709 13:19:24.874271 15650 leader_election.cc:290] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
W20260709 13:19:24.874866 15570 leader_election.cc:343] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.875017 15657 raft_consensus.cc:697] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:24.863967 15651 raft_consensus.cc:359] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.874244 15532 raft_consensus.cc:2468] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 0.
I20260709 13:19:24.875731 15651 raft_consensus.cc:385] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.876107 15651 raft_consensus.cc:740] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.876011 15657 consensus_queue.cc:237] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.876783 15572 leader_election.cc:304] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 6cafb1b5fa254559a839a39f95b9a19a; no voters: 73099f2ede394d1f8cf0a0ed6d6d914e
I20260709 13:19:24.877218 15651 consensus_queue.cc:260] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.880014 15651 ts_tablet_manager.cc:1434] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:19:24.881259 15651 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:24.882795 15648 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:24.883509 15648 ts_tablet_manager.cc:1403] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.120s	user 0.023s	sys 0.020s
I20260709 13:19:24.885232 15457 raft_consensus.cc:2468] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 1.
I20260709 13:19:24.886757 15570 leader_election.cc:304] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:24.887279 15650 raft_consensus.cc:2804] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.887730 15650 raft_consensus.cc:493] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.887368 15648 raft_consensus.cc:359] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.887990 15675 raft_consensus.cc:2804] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.888166 15650 raft_consensus.cc:3060] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.888469 15648 raft_consensus.cc:385] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.888975 15648 raft_consensus.cc:740] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.889967 15648 consensus_queue.cc:260] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.891258 15675 raft_consensus.cc:697] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:24.892217 15648 ts_tablet_manager.cc:1434] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:19:24.892210 15675 consensus_queue.cc:237] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.893407 15648 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:24.895774 15354 catalog_manager.cc:5697] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 1 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.900359 15651 tablet_bootstrap.cc:654] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.906411 15656 raft_consensus.cc:493] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.906992 15656 raft_consensus.cc:515] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.915503 15650 raft_consensus.cc:515] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.919315 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
W20260709 13:19:24.921152 15570 leader_election.cc:343] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.924654 15656 leader_election.cc:290] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:24.925647 15355 catalog_manager.cc:5697] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 1 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.930999 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:24.931895 15532 raft_consensus.cc:3060] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.939040 15648 tablet_bootstrap.cc:654] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.944330 15532 raft_consensus.cc:2468] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 1.
I20260709 13:19:24.946282 15572 leader_election.cc:304] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 6cafb1b5fa254559a839a39f95b9a19a; no voters: 73099f2ede394d1f8cf0a0ed6d6d914e
I20260709 13:19:24.947491 15674 raft_consensus.cc:2804] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.948063 15674 raft_consensus.cc:697] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:24.948633 15650 leader_election.cc:290] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:24.949004 15674 consensus_queue.cc:237] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.950718 15647 tablet_bootstrap.cc:654] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.952229 15661 raft_consensus.cc:493] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.952807 15661 raft_consensus.cc:515] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.954522 15355 catalog_manager.cc:5697] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.955698 15661 leader_election.cc:290] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:24.957146 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa3cf8c223242aa9d4af09b802e0976" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
W20260709 13:19:24.958968 15499 leader_election.cc:343] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.957159 15355 catalog_manager.cc:5697] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:24.959851 15647 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:24.960383 15647 ts_tablet_manager.cc:1403] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.005s
I20260709 13:19:24.963414 15647 raft_consensus.cc:359] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.964110 15647 raft_consensus.cc:385] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.964411 15647 raft_consensus.cc:740] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.964533 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa3cf8c223242aa9d4af09b802e0976" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:24.965233 15457 raft_consensus.cc:2468] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 0.
I20260709 13:19:24.966482 15496 leader_election.cc:304] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:24.967803 15661 raft_consensus.cc:2804] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:24.968300 15661 raft_consensus.cc:493] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.968716 15661 raft_consensus.cc:3060] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.971313 15647 consensus_queue.cc:260] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.973811 15647 ts_tablet_manager.cc:1434] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:19:24.974826 15647 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:24.977075 15661 raft_consensus.cc:515] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.977828 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
W20260709 13:19:24.979672 15424 leader_election.cc:343] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.980353 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa3cf8c223242aa9d4af09b802e0976" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:24.980988 15457 raft_consensus.cc:3060] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:24.982537 15647 tablet_bootstrap.cc:654] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:24.989437 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
I20260709 13:19:24.991566 15651 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:24.992213 15648 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:24.992393 15651 ts_tablet_manager.cc:1403] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.111s	user 0.044s	sys 0.037s
I20260709 13:19:24.992750 15648 ts_tablet_manager.cc:1403] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.010s
I20260709 13:19:24.994158 15457 raft_consensus.cc:2468] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 1.
I20260709 13:19:24.994280 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa3cf8c223242aa9d4af09b802e0976" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:24.995561 15496 leader_election.cc:304] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:24.995858 15651 raft_consensus.cc:359] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
W20260709 13:19:24.996353 15499 leader_election.cc:343] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:24.996156 15648 raft_consensus.cc:359] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.996819 15651 raft_consensus.cc:385] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.997000 15648 raft_consensus.cc:385] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:24.997143 15657 raft_consensus.cc:2804] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:24.997304 15647 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:24.997546 15648 raft_consensus.cc:740] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.997377 15651 raft_consensus.cc:740] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:24.998188 15647 ts_tablet_manager.cc:1403] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 13:19:24.997906 15657 raft_consensus.cc:697] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:24.998569 15648 consensus_queue.cc:260] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.998781 15651 consensus_queue.cc:260] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:24.999714 15657 consensus_queue.cc:237] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.000900 15647 raft_consensus.cc:359] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.001296 15651 ts_tablet_manager.cc:1434] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:19:25.001603 15647 raft_consensus.cc:385] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.001906 15647 raft_consensus.cc:740] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.002524 15651 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:25.002668 15647 consensus_queue.cc:260] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.003302 15648 ts_tablet_manager.cc:1434] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:19:25.004419 15648 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:25.008199 15647 ts_tablet_manager.cc:1434] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:25.009193 15647 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:25.010700 15651 tablet_bootstrap.cc:654] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.011166 15648 tablet_bootstrap.cc:654] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.004323 15661 leader_election.cc:290] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:25.014621 15647 tablet_bootstrap.cc:654] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.023221 15661 raft_consensus.cc:493] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.023592 15651 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:25.024160 15648 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:25.023847 15661 raft_consensus.cc:515] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.024296 15651 ts_tablet_manager.cc:1403] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 13:19:25.024708 15648 ts_tablet_manager.cc:1403] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:19:25.026437 15661 leader_election.cc:290] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:25.027667 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
I20260709 13:19:25.027529 15651 raft_consensus.cc:359] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.028564 15651 raft_consensus.cc:385] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:25.029179 15499 leader_election.cc:343] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.032156 15651 raft_consensus.cc:740] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.028863 15648 raft_consensus.cc:359] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
W20260709 13:19:25.028070 15423 leader_election.cc:343] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.032929 15651 consensus_queue.cc:260] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.033408 15423 leader_election.cc:304] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6730ecd4b1d5461997d975e1e0e93917, 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:25.033936 15648 raft_consensus.cc:385] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.034368 15648 raft_consensus.cc:740] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.034408 15656 raft_consensus.cc:2749] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.035228 15648 consensus_queue.cc:260] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.036803 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:25.037526 15457 raft_consensus.cc:2468] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 0.
I20260709 13:19:25.037971 15651 ts_tablet_manager.cc:1434] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:25.039021 15651 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:25.038870 15354 catalog_manager.cc:5697] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.040164 15648 ts_tablet_manager.cc:1434] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:19:25.041263 15648 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:25.045449 15651 tablet_bootstrap.cc:654] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.035358 15355 catalog_manager.cc:5697] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 1 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.049244 15648 tablet_bootstrap.cc:654] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.052026 15496 leader_election.cc:304] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:25.053645 15657 raft_consensus.cc:2804] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.054143 15657 raft_consensus.cc:493] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.054590 15657 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.061210 15648 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: No bootstrap required, opened a new log
I20260709 13:19:25.061448 15647 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:25.061779 15648 ts_tablet_manager.cc:1403] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:19:25.062219 15647 ts_tablet_manager.cc:1403] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.007s
I20260709 13:19:25.064824 15648 raft_consensus.cc:359] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.065588 15648 raft_consensus.cc:385] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.065893 15648 raft_consensus.cc:740] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.065909 15647 raft_consensus.cc:359] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.067003 15647 raft_consensus.cc:385] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.066833 15648 consensus_queue.cc:260] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.067427 15647 raft_consensus.cc:740] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.068607 15647 consensus_queue.cc:260] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.069442 15648 ts_tablet_manager.cc:1434] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:25.070978 15647 ts_tablet_manager.cc:1434] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:25.078670 15647 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917: Bootstrap starting.
I20260709 13:19:25.083258 15657 raft_consensus.cc:515] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.084662 15647 tablet_bootstrap.cc:654] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.085717 15657 leader_election.cc:290] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:25.087342 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:25.088188 15657 raft_consensus.cc:493] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.087340 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:25.088866 15457 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.088783 15657 raft_consensus.cc:515] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.091580 15651 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:25.092190 15651 ts_tablet_manager.cc:1403] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.026s
W20260709 13:19:25.093214 15499 leader_election.cc:343] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:25.093477 15657 leader_election.cc:290] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:25.095095 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cda7404bba4460b66b3e328e320c39" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
I20260709 13:19:25.095300 15651 raft_consensus.cc:359] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.096171 15651 raft_consensus.cc:385] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.096524 15651 raft_consensus.cc:740] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.096840 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5cda7404bba4460b66b3e328e320c39" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:25.097297 15651 consensus_queue.cc:260] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.097959 15458 raft_consensus.cc:2393] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cafb1b5fa254559a839a39f95b9a19a in current term 1: Already voted for candidate 6730ecd4b1d5461997d975e1e0e93917 in this term.
I20260709 13:19:25.099699 15651 ts_tablet_manager.cc:1434] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:25.100768 15651 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a: Bootstrap starting.
I20260709 13:19:25.100488 15499 leader_election.cc:304] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a; no voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e
I20260709 13:19:25.101579 15657 raft_consensus.cc:3060] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.105711 15457 raft_consensus.cc:2468] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 1.
I20260709 13:19:25.107112 15651 tablet_bootstrap.cc:654] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:25.107741 15674 raft_consensus.cc:493] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.108242 15674 raft_consensus.cc:515] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.108701 15657 raft_consensus.cc:2749] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.110808 15674 leader_election.cc:290] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:25.106994 15496 leader_election.cc:304] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:25.113407 15657 raft_consensus.cc:2804] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.114600 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
I20260709 13:19:25.115324 15657 raft_consensus.cc:697] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:25.115510 15532 raft_consensus.cc:2468] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 0.
I20260709 13:19:25.117116 15657 consensus_queue.cc:237] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.118031 15572 leader_election.cc:304] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 6cafb1b5fa254559a839a39f95b9a19a; no voters: 
I20260709 13:19:25.119933 15674 raft_consensus.cc:2804] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.120446 15674 raft_consensus.cc:493] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.120868 15674 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.117036 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:25.124948 15458 raft_consensus.cc:2468] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 0.
I20260709 13:19:25.134533 15674 raft_consensus.cc:515] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.138437 15647 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917: No bootstrap required, opened a new log
I20260709 13:19:25.138960 15647 ts_tablet_manager.cc:1403] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917: Time spent bootstrapping tablet: real 0.061s	user 0.029s	sys 0.015s
I20260709 13:19:25.138881 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:25.139649 15457 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.141933 15647 raft_consensus.cc:359] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.142596 15647 raft_consensus.cc:385] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.142848 15647 raft_consensus.cc:740] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.143630 15647 consensus_queue.cc:260] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.145602 15647 ts_tablet_manager.cc:1434] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:25.149230 15457 raft_consensus.cc:2468] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 1.
I20260709 13:19:25.150496 15570 leader_election.cc:304] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:25.151371 15675 raft_consensus.cc:2804] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.151868 15675 raft_consensus.cc:697] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:25.152891 15675 consensus_queue.cc:237] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.158713 15674 leader_election.cc:290] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:25.161293 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:25.161993 15532 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.163957 15651 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a: No bootstrap required, opened a new log
I20260709 13:19:25.164603 15651 ts_tablet_manager.cc:1403] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent bootstrapping tablet: real 0.064s	user 0.040s	sys 0.021s
I20260709 13:19:25.165035 15354 catalog_manager.cc:5697] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.167382 15651 raft_consensus.cc:359] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.168005 15651 raft_consensus.cc:385] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:25.168329 15651 raft_consensus.cc:740] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Initialized, Role: FOLLOWER
I20260709 13:19:25.169323 15532 raft_consensus.cc:2468] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 1.
I20260709 13:19:25.169031 15651 consensus_queue.cc:260] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.171156 15651 ts_tablet_manager.cc:1434] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:19:25.174335 15356 catalog_manager.cc:5697] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 1 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.207952 15674 consensus_queue.cc:1048] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.209434 15657 raft_consensus.cc:493] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.209951 15657 raft_consensus.cc:515] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.212224 15657 leader_election.cc:290] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:25.213157 15458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366512517bb54846832acb3aa279aeb4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:25.213914 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366512517bb54846832acb3aa279aeb4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
I20260709 13:19:25.215487 15499 leader_election.cc:304] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a; no voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e
I20260709 13:19:25.216638 15657 raft_consensus.cc:2749] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.220741 15532 raft_consensus.cc:3060] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.228471 15674 consensus_queue.cc:1048] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.235342 15657 raft_consensus.cc:493] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.235831 15657 raft_consensus.cc:515] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.237896 15657 leader_election.cc:290] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:25.238842 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
I20260709 13:19:25.239341 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:25.239542 15607 raft_consensus.cc:2468] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 0.
I20260709 13:19:25.240020 15457 raft_consensus.cc:2468] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 0.
I20260709 13:19:25.240589 15499 leader_election.cc:304] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 6cafb1b5fa254559a839a39f95b9a19a; no voters: 
I20260709 13:19:25.241415 15657 raft_consensus.cc:2804] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:25.241802 15657 raft_consensus.cc:493] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.242100 15657 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.247184 15657 raft_consensus.cc:515] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.248764 15657 leader_election.cc:290] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:25.249450 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:25.249696 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:25.249977 15457 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.250321 15607 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.254868 15457 raft_consensus.cc:2468] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 1.
I20260709 13:19:25.255911 15607 raft_consensus.cc:2468] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 1.
I20260709 13:19:25.255911 15496 leader_election.cc:304] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:25.257269 15657 raft_consensus.cc:2804] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:25.257735 15657 raft_consensus.cc:697] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:25.258502 15657 consensus_queue.cc:237] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.265058 15354 catalog_manager.cc:5697] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 1 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.270680 15674 raft_consensus.cc:493] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.271219 15674 raft_consensus.cc:515] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.273216 15674 leader_election.cc:290] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:25.273895 15457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" is_pre_election: true
I20260709 13:19:25.274151 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
I20260709 13:19:25.274646 15457 raft_consensus.cc:2393] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6730ecd4b1d5461997d975e1e0e93917 in current term 1: Already voted for candidate 6cafb1b5fa254559a839a39f95b9a19a in this term.
I20260709 13:19:25.275591 15570 leader_election.cc:304] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917; no voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e
I20260709 13:19:25.276156 15674 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.281962 15674 raft_consensus.cc:2749] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.285190 15674 consensus_queue.cc:1048] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.291419 15656 raft_consensus.cc:493] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.291898 15656 raft_consensus.cc:515] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:25.293462 15532 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.294052 15656 leader_election.cc:290] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:25.295979 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6730ecd4b1d5461997d975e1e0e93917" is_pre_election: true
I20260709 13:19:25.297020 15533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a" is_pre_election: true
I20260709 13:19:25.297804 15533 raft_consensus.cc:2393] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73099f2ede394d1f8cf0a0ed6d6d914e in current term 1: Already voted for candidate 6730ecd4b1d5461997d975e1e0e93917 in this term.
I20260709 13:19:25.298945 15423 leader_election.cc:304] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 6730ecd4b1d5461997d975e1e0e93917, 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:25.299724 15656 raft_consensus.cc:3060] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.302810 15673 consensus_queue.cc:1048] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.306787 15656 raft_consensus.cc:2749] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:25.319577 15673 consensus_queue.cc:1048] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.331096 15650 consensus_queue.cc:1048] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.331828 15657 consensus_queue.cc:1048] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.342502 15683 consensus_queue.cc:1048] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.370188 15674 consensus_queue.cc:1048] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.375455 15674 consensus_queue.cc:1048] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.410032 15683 consensus_queue.cc:1048] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.414343 15606 raft_consensus.cc:3060] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:25.420575 15661 consensus_queue.cc:1048] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.425802 15657 consensus_queue.cc:1048] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.439339 15683 consensus_queue.cc:1048] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.509649 15683 consensus_queue.cc:1048] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:25.511363  7076 ts_manager.cc:295] Set tserver state for 73099f2ede394d1f8cf0a0ed6d6d914e to MAINTENANCE_MODE
I20260709 13:19:25.512280  7076 tablet_server.cc:179] TabletServer@127.6.233.1:0 shutting down...
I20260709 13:19:25.522886 15606 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:25.529465 15496 consensus_peers.cc:597] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.587831 15675 consensus_queue.cc:1048] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:19:25.594791 15570 consensus_peers.cc:597] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.594599 15683 consensus_queue.cc:1048] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:25.625476  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:25.626276  7076 tablet_replica.cc:333] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.627615  7076 raft_consensus.cc:2243] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.628173  7076 raft_consensus.cc:2272] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.631057  7076 tablet_replica.cc:333] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.631856  7076 raft_consensus.cc:2243] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.632364  7076 pending_rounds.cc:70] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Trying to abort 1 pending ops.
I20260709 13:19:25.632586  7076 pending_rounds.cc:77] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638564339052544 op_type: NO_OP noop_request { }
I20260709 13:19:25.632905  7076 raft_consensus.cc:2889] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:25.633240  7076 raft_consensus.cc:2272] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.635655  7076 tablet_replica.cc:333] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.636302  7076 raft_consensus.cc:2243] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.636682  7076 raft_consensus.cc:2272] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.638343  7076 tablet_replica.cc:333] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.638830  7076 raft_consensus.cc:2243] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.639281  7076 raft_consensus.cc:2272] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.641378  7076 tablet_replica.cc:333] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.641899  7076 raft_consensus.cc:2243] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.642304  7076 raft_consensus.cc:2272] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.644400  7076 tablet_replica.cc:333] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.644919  7076 raft_consensus.cc:2243] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.645309  7076 raft_consensus.cc:2272] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.647414  7076 tablet_replica.cc:333] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.647926  7076 raft_consensus.cc:2243] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.648363  7076 raft_consensus.cc:2272] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.649942  7076 tablet_replica.cc:333] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.650424  7076 raft_consensus.cc:2243] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.650803  7076 raft_consensus.cc:2272] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.652909  7076 tablet_replica.cc:333] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.653386  7076 raft_consensus.cc:2243] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:25.653704 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:25.653767  7076 raft_consensus.cc:2272] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.656330  7076 tablet_replica.cc:333] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: stopping tablet replica
I20260709 13:19:25.656873  7076 raft_consensus.cc:2243] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.657325  7076 raft_consensus.cc:2272] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.660526 15496 consensus_peers.cc:597] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.687680  7076 tablet_server.cc:196] TabletServer@127.6.233.1:0 shutdown complete.
W20260709 13:19:25.788196 15570 consensus_peers.cc:597] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.819470 15661 consensus_queue.cc:1048] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:25.834086 15496 consensus_peers.cc:597] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.840739 15570 consensus_peers.cc:597] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.872991 15496 consensus_peers.cc:597] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.894439 15570 consensus_peers.cc:597] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.917651 15496 consensus_peers.cc:597] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.943485 15570 consensus_peers.cc:597] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:26.654793 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:26.982884 15496 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111) [suppressed 126 similar messages]
W20260709 13:19:27.655867 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:28.011776 15496 consensus_peers.cc:597] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.128208 15570 consensus_peers.cc:597] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.237689 15496 consensus_peers.cc:597] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.288887 15570 consensus_peers.cc:597] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.300356 15570 consensus_peers.cc:597] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.303192 15496 consensus_peers.cc:597] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.384245 15570 consensus_peers.cc:597] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.421653 15496 consensus_peers.cc:597] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.464843 15496 consensus_peers.cc:597] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.657052 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:28.739420 15570 consensus_peers.cc:597] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:29.658056 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:30.419282 15496 consensus_peers.cc:597] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:30.565408 15570 consensus_peers.cc:597] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:30.625823 15496 consensus_peers.cc:597] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:30.658900 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:30.705631  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:30.711162 15737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:30.712007 15738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:30.714493 15740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:30.719058  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:30.722167  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:30.722399  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:30.722613  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603170722582 us; error 0 us; skew 500 ppm
I20260709 13:19:30.723219  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:30.725503  7076 webserver.cc:533] Webserver started at http://127.6.233.1:36277/ using document root <none> and password file <none>
I20260709 13:19:30.725991  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:30.726194  7076 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:30.729709  7076 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:19:30.733129 15745 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:30.734098  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:19:30.734442  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
format_stamp: "Formatted at 2026-07-09 13:19:23 on dist-test-slave-sjgx"
I20260709 13:19:30.734858  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:19:30.740139 15570 consensus_peers.cc:597] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.749678  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:30.750844  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:30.752369  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:30.755934 15752 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:19:30.800529  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:19:30.800899  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.046s	user 0.002s	sys 0.000s
I20260709 13:19:30.801195  7076 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:19:30.805390 15752 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.815726 15752 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.816545 15752 tablet_bootstrap.cc:492] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.817112 15752 ts_tablet_manager.cc:1403] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:19:30.819089 15752 raft_consensus.cc:359] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.819617 15752 raft_consensus.cc:740] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.820256 15752 consensus_queue.cc:260] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.822392 15752 ts_tablet_manager.cc:1434] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:30.823094 15752 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.836483 15752 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.837318 15752 tablet_bootstrap.cc:492] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.837857 15752 ts_tablet_manager.cc:1403] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:19:30.838831  7076 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:19:30.839159  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.038s	user 0.036s	sys 0.000s
I20260709 13:19:30.839901 15752 raft_consensus.cc:359] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.840592 15752 raft_consensus.cc:740] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.841295 15752 consensus_queue.cc:260] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.842746 15752 ts_tablet_manager.cc:1434] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:30.843389 15752 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.856436 15752 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.857400 15752 tablet_bootstrap.cc:492] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.857993 15752 ts_tablet_manager.cc:1403] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:19:30.860347 15752 raft_consensus.cc:359] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.860930 15752 raft_consensus.cc:740] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.861757 15752 consensus_queue.cc:260] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.864002 15752 ts_tablet_manager.cc:1434] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:19:30.864962 15752 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.877827 15752 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.878867 15752 tablet_bootstrap.cc:492] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.879561 15752 ts_tablet_manager.cc:1403] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:19:30.882149 15752 raft_consensus.cc:359] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:30.883720 15752 raft_consensus.cc:740] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.884531 15752 consensus_queue.cc:260] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:30.886478 15752 ts_tablet_manager.cc:1434] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:19:30.887167 15752 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.900652 15752 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.901656 15752 tablet_bootstrap.cc:492] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.901837  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:45251
I20260709 13:19:30.901932 15814 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:45251 every 8 connection(s)
I20260709 13:19:30.902324 15752 ts_tablet_manager.cc:1403] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:19:30.904711 15752 raft_consensus.cc:359] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.905252 15752 raft_consensus.cc:740] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.905962 15752 consensus_queue.cc:260] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.906780  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:30.907752 15752 ts_tablet_manager.cc:1434] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:30.908803 15752 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.925625 15815 heartbeater.cc:344] Connected to a master server at 127.6.233.62:43277
I20260709 13:19:30.926192 15815 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:30.927178 15815 heartbeater.cc:507] Master 127.6.233.62:43277 requested a full tablet report, sending...
I20260709 13:19:30.928179 15752 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.929029 15752 tablet_bootstrap.cc:492] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.929591 15752 ts_tablet_manager.cc:1403] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:19:30.931946 15752 raft_consensus.cc:359] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.932679 15752 raft_consensus.cc:740] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.933205 15356 ts_manager.cc:194] Re-registered known tserver with Master: 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251)
I20260709 13:19:30.933837 15752 consensus_queue.cc:260] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.935784 15752 ts_tablet_manager.cc:1434] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:30.936165 15607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
mode: GRACEFUL
new_leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:58456
I20260709 13:19:30.936614 15752 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.936865 15607 raft_consensus.cc:606] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Received request to transfer leadership to TS 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:30.943436 15356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48390
I20260709 13:19:30.946781 15815 heartbeater.cc:499] Master 127.6.233.62:43277 was elected leader, sending a full tablet report...
I20260709 13:19:30.953033 15752 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.952867 15533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
mode: GRACEFUL
new_leader_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:44984
I20260709 13:19:30.953573 15533 raft_consensus.cc:606] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Received request to transfer leadership to TS 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:30.953838 15752 tablet_bootstrap.cc:492] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.954526 15752 ts_tablet_manager.cc:1403] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:19:30.956403 15533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2090e23184548509734e73d7676a1c9"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
mode: GRACEFUL
new_leader_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:44984
I20260709 13:19:30.956589 15752 raft_consensus.cc:359] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.957156 15752 raft_consensus.cc:740] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.957067 15533 raft_consensus.cc:606] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Received request to transfer leadership to TS 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:30.957973 15752 consensus_queue.cc:260] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.958792  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:30.959455  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:30.959741 15752 ts_tablet_manager.cc:1434] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:30.960526 15752 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.960268  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:30.973981 15752 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.974714 15752 tablet_bootstrap.cc:492] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.975256 15752 ts_tablet_manager.cc:1403] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:19:30.977103 15752 raft_consensus.cc:359] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.977617 15752 raft_consensus.cc:740] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.978137 15752 consensus_queue.cc:260] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.980953 15752 ts_tablet_manager.cc:1434] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:19:30.981686 15752 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:30.995347 15752 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:19:30.996269 15752 tablet_bootstrap.cc:492] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:30.996897 15752 ts_tablet_manager.cc:1403] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
W20260709 13:19:30.997458 15570 consensus_peers.cc:597] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.999240 15752 raft_consensus.cc:359] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:30.999985 15752 raft_consensus.cc:740] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.000633 15752 consensus_queue.cc:260] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.002146 15752 ts_tablet_manager.cc:1434] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:19:31.002869 15752 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap starting.
I20260709 13:19:31.015120 15752 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.015836 15752 tablet_bootstrap.cc:492] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Bootstrap complete.
I20260709 13:19:31.016388 15752 ts_tablet_manager.cc:1403] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:19:31.018127 15752 raft_consensus.cc:359] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.018616 15752 raft_consensus.cc:740] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73099f2ede394d1f8cf0a0ed6d6d914e, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.019243 15752 consensus_queue.cc:260] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.020880 15752 ts_tablet_manager.cc:1434] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:19:31.039112 15735 raft_consensus.cc:993] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917: : Instructing follower 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:31.039664 15832 raft_consensus.cc:1081] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Signalling peer 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:31.041177 15533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:44964
I20260709 13:19:31.041738 15533 raft_consensus.cc:493] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:31.042222 15533 raft_consensus.cc:3060] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.094014 15533 raft_consensus.cc:515] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.098773 15533 leader_election.cc:290] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:31.099467 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:31.101557 15789 raft_consensus.cc:3060] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.101996 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "904af91a3bcf498fae5d1d5fc130072d" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:31.102905 15607 raft_consensus.cc:3055] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:31.103309 15607 raft_consensus.cc:740] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:31.104918 15607 consensus_queue.cc:260] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.107757 15607 raft_consensus.cc:3060] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.113772 15789 raft_consensus.cc:2468] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 2.
I20260709 13:19:31.115262 15496 leader_election.cc:304] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:31.115993 15607 raft_consensus.cc:2468] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 2.
I20260709 13:19:31.116173 15661 raft_consensus.cc:2804] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:31.117700 15661 raft_consensus.cc:697] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:31.118854 15661 consensus_queue.cc:237] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.128602 15356 catalog_manager.cc:5697] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 1 to 2, leader changed from 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3) to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 2 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:31.289616 15834 raft_consensus.cc:993] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a: : Instructing follower 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:31.290134 15661 raft_consensus.cc:1081] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Signalling peer 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:31.291683 15607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2090e23184548509734e73d7676a1c9"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:58428
I20260709 13:19:31.292315 15607 raft_consensus.cc:493] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:31.292645 15607 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.298173 15607 raft_consensus.cc:515] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.299844 15607 leader_election.cc:290] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:31.300681 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:31.300928 15533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:31.301414 15789 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.301555 15533 raft_consensus.cc:3055] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:31.301946 15533 raft_consensus.cc:740] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:31.302799 15533 consensus_queue.cc:260] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.303887 15533 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.306749 15789 raft_consensus.cc:2468] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:31.307981 15570 leader_election.cc:304] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:31.308810 15832 raft_consensus.cc:2804] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:31.309218 15832 raft_consensus.cc:697] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:31.310271 15832 consensus_queue.cc:237] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.310626 15533 raft_consensus.cc:2468] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:31.318133 15356 catalog_manager.cc:5697] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 1 to 2, leader changed from 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2) to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.533283 15842 raft_consensus.cc:993] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a: : Instructing follower 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:31.533892 15842 raft_consensus.cc:1081] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Signalling peer 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:31.535743 15607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:58428
I20260709 13:19:31.536561 15607 raft_consensus.cc:493] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:31.537065 15607 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.550362 15607 raft_consensus.cc:515] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.555588 15607 leader_election.cc:290] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:31.558198 15533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:31.558945 15533 raft_consensus.cc:3055] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:31.559305 15533 raft_consensus.cc:740] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:31.560225 15533 consensus_queue.cc:260] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.561375 15533 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.565831 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:31.566551 15788 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.569928 15533 raft_consensus.cc:2468] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:31.571830 15572 leader_election.cc:304] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 6cafb1b5fa254559a839a39f95b9a19a; no voters: 
I20260709 13:19:31.572868 15844 raft_consensus.cc:2804] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:31.573382 15844 raft_consensus.cc:697] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:31.574540 15844 consensus_queue.cc:237] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:31.579571 15788 raft_consensus.cc:2468] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:31.582984 15607 raft_consensus.cc:1275] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:31.584197 15842 consensus_queue.cc:1048] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:31.584110 15355 catalog_manager.cc:5697] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 1 to 2, leader changed from 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2) to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:31.598814 15788 raft_consensus.cc:1275] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:31.600169 15661 consensus_queue.cc:1048] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:31.660306 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:31.692741 15788 raft_consensus.cc:1275] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:31.693950 15844 consensus_queue.cc:1048] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:31.704289 15533 raft_consensus.cc:1275] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:31.706333 15851 consensus_queue.cc:1048] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:32.027261 15533 raft_consensus.cc:1275] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:32.028601 15851 consensus_queue.cc:1048] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:32.038046 15789 raft_consensus.cc:1275] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:32.039654 15851 consensus_queue.cc:1048] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:32.070104  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:32.077829 15607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
mode: GRACEFUL
new_leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:58456
I20260709 13:19:32.078444 15607 raft_consensus.cc:606] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Received request to transfer leadership to TS 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:32.080998 15607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2090e23184548509734e73d7676a1c9"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
mode: GRACEFUL
new_leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:58456
I20260709 13:19:32.081466 15607 raft_consensus.cc:606] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Received request to transfer leadership to TS 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:32.084214 15532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaa3cf8c223242aa9d4af09b802e0976"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
mode: GRACEFUL
new_leader_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:44984
I20260709 13:19:32.084777 15532 raft_consensus.cc:606] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Received request to transfer leadership to TS 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:32.087283 15832 raft_consensus.cc:993] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917: : Instructing follower 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:32.088658 15832 raft_consensus.cc:1081] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Signalling peer 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:32.090831 15532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:44964
I20260709 13:19:32.091369 15532 raft_consensus.cc:493] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:32.091776 15532 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:32.103333 15532 raft_consensus.cc:515] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.106264 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:32.106904 15789 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:32.107010 15532 leader_election.cc:290] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:32.107128 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:32.108026 15607 raft_consensus.cc:3055] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:32.108453 15607 raft_consensus.cc:740] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:32.109470 15607 consensus_queue.cc:260] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.110785 15607 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:32.119885 15607 raft_consensus.cc:2468] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 2.
I20260709 13:19:32.123067 15789 raft_consensus.cc:2468] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 2.
I20260709 13:19:32.142297 15496 leader_election.cc:304] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:32.146353 15842 raft_consensus.cc:2804] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:32.146903 15842 raft_consensus.cc:697] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:32.147945 15842 consensus_queue.cc:237] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.246996  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:32.247787  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:32.248673  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:32.250041 15661 raft_consensus.cc:993] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a: : Instructing follower 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:32.250561 15842 raft_consensus.cc:1081] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Signalling peer 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:32.252218 15606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaa3cf8c223242aa9d4af09b802e0976"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:58428
I20260709 13:19:32.252683 15606 raft_consensus.cc:493] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:32.253018 15606 raft_consensus.cc:3060] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:32.260169 15606 raft_consensus.cc:515] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.262005 15606 leader_election.cc:290] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:32.265625 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa3cf8c223242aa9d4af09b802e0976" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:32.266271 15789 raft_consensus.cc:3060] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:32.271780 15789 raft_consensus.cc:2468] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:32.272924 15570 leader_election.cc:304] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:32.273970 15843 raft_consensus.cc:2804] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:32.274437 15843 raft_consensus.cc:697] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:32.275432 15843 consensus_queue.cc:237] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.278581 15533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaa3cf8c223242aa9d4af09b802e0976" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:32.279340 15533 raft_consensus.cc:3055] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:32.279584 15533 raft_consensus.cc:740] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:32.283313 15533 consensus_queue.cc:260] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.284993 15533 raft_consensus.cc:3060] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:32.288343 15355 catalog_manager.cc:5697] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 1 to 2, leader changed from 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3) to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 2 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:32.291756 15832 raft_consensus.cc:993] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917: : Instructing follower 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:32.292320 15832 raft_consensus.cc:1081] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Signalling peer 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:32.294205 15532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2090e23184548509734e73d7676a1c9"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:44964
I20260709 13:19:32.293871 15356 catalog_manager.cc:5697] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 1 to 2, leader changed from 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2) to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:32.294871 15532 raft_consensus.cc:493] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:32.295288 15532 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:32.302022 15532 raft_consensus.cc:515] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.303717 15532 leader_election.cc:290] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 3 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:32.304447 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:32.305073 15789 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:32.307433 15533 raft_consensus.cc:2468] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:32.310587 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:32.311298 15607 raft_consensus.cc:3055] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:32.311614 15607 raft_consensus.cc:740] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:32.312377 15789 raft_consensus.cc:2468] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 3.
I20260709 13:19:32.312669 15607 consensus_queue.cc:260] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.314109 15607 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:32.314486 15496 leader_election.cc:304] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:32.315263 15834 raft_consensus.cc:2804] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:32.315732 15834 raft_consensus.cc:697] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:32.316603 15834 consensus_queue.cc:237] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:32.320640 15607 raft_consensus.cc:2468] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 3.
I20260709 13:19:32.323738 15356 catalog_manager.cc:5697] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 2 to 3, leader changed from 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3) to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 3 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:32.493453 15554 debug-util.cc:398] Leaking SignalData structure 0x7b080020c120 after lost signal to thread 7079
W20260709 13:19:32.494462 15554 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7da0 after lost signal to thread 15390
W20260709 13:19:32.495637 15554 debug-util.cc:398] Leaking SignalData structure 0x7b080038e780 after lost signal to thread 15557
W20260709 13:19:32.496884 15554 debug-util.cc:398] Leaking SignalData structure 0x7b0800406c80 after lost signal to thread 15631
W20260709 13:19:32.498186 15554 debug-util.cc:398] Leaking SignalData structure 0x7b08001140c0 after lost signal to thread 15814
I20260709 13:19:32.652486 15789 raft_consensus.cc:1275] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:32.654045 15834 consensus_queue.cc:1048] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:19:32.661636 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:32.669087 15607 raft_consensus.cc:1275] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:32.671026 15842 consensus_queue.cc:1048] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:32.734444 15532 raft_consensus.cc:1275] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:32.736079 15851 consensus_queue.cc:1048] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:32.749432 15789 raft_consensus.cc:1275] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:32.750833 15844 consensus_queue.cc:1048] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:32.789242 15607 raft_consensus.cc:1275] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:32.790712 15842 consensus_queue.cc:1048] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:32.799899 15789 raft_consensus.cc:1275] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:32.801383 15661 consensus_queue.cc:1048] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:19:33.150317 15387 debug-util.cc:398] Leaking SignalData structure 0x7b0800033180 after lost signal to thread 7079
W20260709 13:19:33.151420 15387 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec400 after lost signal to thread 15390
W20260709 13:19:33.152892 15387 debug-util.cc:398] Leaking SignalData structure 0x7b0800123ce0 after lost signal to thread 15557
W20260709 13:19:33.153981 15387 debug-util.cc:398] Leaking SignalData structure 0x7b080028c080 after lost signal to thread 15631
W20260709 13:19:33.155014 15387 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac400 after lost signal to thread 15814
I20260709 13:19:33.256265  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:33.267748 15533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
mode: GRACEFUL
new_leader_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:44984
I20260709 13:19:33.268430 15533 raft_consensus.cc:606] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Received request to transfer leadership to TS 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:33.271685 15533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
mode: GRACEFUL
new_leader_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:44984
I20260709 13:19:33.272347 15533 raft_consensus.cc:606] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Received request to transfer leadership to TS 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:33.275774 15607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
mode: GRACEFUL
new_leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:58456
I20260709 13:19:33.276428 15607 raft_consensus.cc:606] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Received request to transfer leadership to TS 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:33.297892  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:33.299057  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:33.300841  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:33.579905 15661 raft_consensus.cc:993] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a: : Instructing follower 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:33.580549 15834 raft_consensus.cc:1081] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Signalling peer 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:33.582373 15607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:58428
I20260709 13:19:33.582959 15607 raft_consensus.cc:493] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:33.583307 15607 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:33.590934 15607 raft_consensus.cc:515] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:33.592989 15607 leader_election.cc:290] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:33.594342 15533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:33.595201 15533 raft_consensus.cc:3055] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:33.596369 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:33.597589 15788 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:33.600678 15844 raft_consensus.cc:993] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917: : Instructing follower 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:33.601425 15832 raft_consensus.cc:1081] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Signalling peer 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:33.603482 15834 raft_consensus.cc:993] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a: : Instructing follower 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:33.606187 15834 raft_consensus.cc:1081] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Signalling peer 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:33.607086 15532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:44964
I20260709 13:19:33.605213 15533 raft_consensus.cc:740] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:33.607730 15532 raft_consensus.cc:493] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:33.608170 15532 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:33.608573 15533 consensus_queue.cc:260] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:33.610045 15533 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:33.612414 15607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:58428
I20260709 13:19:33.612994 15607 raft_consensus.cc:493] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:33.613341 15607 raft_consensus.cc:3060] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:33.620615 15607 raft_consensus.cc:515] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:33.622530 15788 raft_consensus.cc:2468] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:33.626207 15570 leader_election.cc:304] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:33.627120 15844 raft_consensus.cc:2804] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:33.627617 15844 raft_consensus.cc:697] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:33.624243 15532 raft_consensus.cc:515] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:33.629607 15844 consensus_queue.cc:237] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:33.630697 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:33.631378 15788 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:33.627633 15533 raft_consensus.cc:2468] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:33.634980 15606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b1035590e41cbbc5b51a8c3e5e0b4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:33.635634 15606 raft_consensus.cc:3055] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:33.635949 15606 raft_consensus.cc:740] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:33.636828 15606 consensus_queue.cc:260] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:33.637980 15606 raft_consensus.cc:3060] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:33.639586 15532 leader_election.cc:290] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 3 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:33.649739 15356 catalog_manager.cc:5697] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 1 to 2, leader changed from 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2) to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:33.650775 15607 leader_election.cc:290] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:33.653630 15786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:33.654229 15786 raft_consensus.cc:3060] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:33.654618 15606 raft_consensus.cc:2468] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 3.
I20260709 13:19:33.656951 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49dae0aab0d740888c95b1d0a26d62c7" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:33.660440 15532 raft_consensus.cc:3055] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:33.660844 15532 raft_consensus.cc:740] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:33.661957 15532 consensus_queue.cc:260] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
W20260709 13:19:33.662773 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:33.663437 15532 raft_consensus.cc:3060] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:33.666636 15786 raft_consensus.cc:2468] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:33.669467 15570 leader_election.cc:304] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:33.669816 15499 leader_election.cc:304] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 6cafb1b5fa254559a839a39f95b9a19a; no voters: 
I20260709 13:19:33.670336 15844 raft_consensus.cc:2804] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:33.670753 15834 raft_consensus.cc:2804] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:33.671322 15834 raft_consensus.cc:697] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:33.671043 15844 raft_consensus.cc:697] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:33.672255 15834 consensus_queue.cc:237] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:33.672961 15844 consensus_queue.cc:237] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } }
I20260709 13:19:33.659701 15788 raft_consensus.cc:2468] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 3.
I20260709 13:19:33.696171 15532 raft_consensus.cc:2468] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 2.
I20260709 13:19:33.697700 15355 catalog_manager.cc:5697] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 2 to 3, leader changed from 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3) to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 3 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:33.716610 15356 catalog_manager.cc:5697] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 1 to 2, leader changed from 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2) to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.012643 15532 raft_consensus.cc:1275] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.014155 15832 consensus_queue.cc:1048] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.032760 15788 raft_consensus.cc:1275] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.034669 15870 consensus_queue.cc:1048] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.121068 15606 raft_consensus.cc:1275] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:34.122674 15834 consensus_queue.cc:1048] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:34.137156 15788 raft_consensus.cc:1275] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:34.138732 15834 consensus_queue.cc:1048] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:34.194178 15532 raft_consensus.cc:1275] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.195672 15832 consensus_queue.cc:1048] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.207655 15786 raft_consensus.cc:1275] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.210254 15870 consensus_queue.cc:1048] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:34.312316  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:34.323182 15606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
mode: GRACEFUL
new_leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:58456
I20260709 13:19:34.323853 15606 raft_consensus.cc:606] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Received request to transfer leadership to TS 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:34.326951 15606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "366512517bb54846832acb3aa279aeb4"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
mode: GRACEFUL
new_leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:58456
I20260709 13:19:34.327535 15606 raft_consensus.cc:606] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Received request to transfer leadership to TS 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:34.330314 15532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
mode: GRACEFUL
new_leader_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:44984
I20260709 13:19:34.330946 15532 raft_consensus.cc:606] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Received request to transfer leadership to TS 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:34.332312  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:34.332990  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:34.333847  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:34.446435 15844 raft_consensus.cc:993] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917: : Instructing follower 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:34.447079 15870 raft_consensus.cc:1081] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Signalling peer 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:34.448830 15532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "366512517bb54846832acb3aa279aeb4"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:44964
I20260709 13:19:34.449404 15532 raft_consensus.cc:493] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.449807 15532 raft_consensus.cc:3060] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.457448 15532 raft_consensus.cc:515] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.459365 15532 leader_election.cc:290] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:34.460615 15786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366512517bb54846832acb3aa279aeb4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:34.461274 15786 raft_consensus.cc:3060] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.465155 15606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366512517bb54846832acb3aa279aeb4" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:34.465898 15606 raft_consensus.cc:3055] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.466286 15606 raft_consensus.cc:740] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:34.467338 15606 consensus_queue.cc:260] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.468546 15786 raft_consensus.cc:2468] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 2.
I20260709 13:19:34.468900 15606 raft_consensus.cc:3060] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.469990 15496 leader_election.cc:304] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:34.470822 15885 raft_consensus.cc:2804] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.471287 15885 raft_consensus.cc:697] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:34.472373 15885 consensus_queue.cc:237] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.484570 15606 raft_consensus.cc:2468] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 2.
I20260709 13:19:34.492120 15356 catalog_manager.cc:5697] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 1 to 2, leader changed from 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3) to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 2 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:34.663945 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:34.686802 15844 raft_consensus.cc:993] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917: : Instructing follower 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:34.687445 15832 raft_consensus.cc:1081] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Signalling peer 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:34.689189 15532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:44964
I20260709 13:19:34.689728 15532 raft_consensus.cc:493] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.690076 15532 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.697909 15532 raft_consensus.cc:515] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.715961 15894 raft_consensus.cc:993] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a: : Instructing follower 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:34.722363 15894 raft_consensus.cc:1081] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Signalling peer 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:34.724298 15606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:58428
I20260709 13:19:34.724900 15606 raft_consensus.cc:493] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:34.725274 15606 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:34.730505 15532 leader_election.cc:290] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 2 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:34.730979 15788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:34.731714 15788 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.736116 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:34.736873 15607 raft_consensus.cc:3055] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:34.737185 15607 raft_consensus.cc:740] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:34.738011 15607 consensus_queue.cc:260] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.739405 15607 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:34.743067 15606 raft_consensus.cc:515] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.747310 15606 leader_election.cc:290] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 3 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:34.749830 15786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:34.750155 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7746ae5a62294618aa5b1024e2183248" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:34.750478 15786 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:34.750829 15532 raft_consensus.cc:3055] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:34.751195 15532 raft_consensus.cc:740] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:34.752226 15532 consensus_queue.cc:260] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.753490 15532 raft_consensus.cc:3060] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:34.761806 15788 raft_consensus.cc:2468] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 2.
I20260709 13:19:34.766147 15607 raft_consensus.cc:2468] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 2.
I20260709 13:19:34.767741 15496 leader_election.cc:304] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:34.761929 15786 raft_consensus.cc:2468] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 3.
I20260709 13:19:34.769351 15893 raft_consensus.cc:2804] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:34.769663 15570 leader_election.cc:304] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:34.769855 15893 raft_consensus.cc:697] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:34.770574 15832 raft_consensus.cc:2804] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:34.771211 15832 raft_consensus.cc:697] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:34.772159 15832 consensus_queue.cc:237] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.773422 15532 raft_consensus.cc:2468] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 3.
I20260709 13:19:34.771230 15893 consensus_queue.cc:237] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:34.791841 15356 catalog_manager.cc:5697] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 1 to 2, leader changed from 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3) to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 2 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:34.797151 15355 catalog_manager.cc:5697] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 2 to 3, leader changed from 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2) to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 3 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:34.985255 15786 raft_consensus.cc:1275] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:34.986959 15893 consensus_queue.cc:1048] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.137451 15607 raft_consensus.cc:1275] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.175891 15894 consensus_queue.cc:1048] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:35.200407 15786 raft_consensus.cc:1275] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.201953 15894 consensus_queue.cc:1048] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.224324 15606 raft_consensus.cc:1275] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:35.225997 15661 consensus_queue.cc:1048] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:35.304903 15532 raft_consensus.cc:1275] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:35.306443 15832 consensus_queue.cc:1048] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:35.316855 15786 raft_consensus.cc:1275] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:35.318811 15870 consensus_queue.cc:1048] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:35.347052  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:35.358866 15532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
mode: GRACEFUL
new_leader_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:44984
I20260709 13:19:35.359509 15532 raft_consensus.cc:606] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Received request to transfer leadership to TS 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:35.362366 15607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
mode: GRACEFUL
new_leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:58456
I20260709 13:19:35.362960 15607 raft_consensus.cc:606] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Received request to transfer leadership to TS 6cafb1b5fa254559a839a39f95b9a19a
I20260709 13:19:35.365743 15532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2090e23184548509734e73d7676a1c9"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
mode: GRACEFUL
new_leader_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:44984
I20260709 13:19:35.366290 15532 raft_consensus.cc:606] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Received request to transfer leadership to TS 6730ecd4b1d5461997d975e1e0e93917
I20260709 13:19:35.367378  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:35.368078  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:35.368784  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:35.594060 15832 raft_consensus.cc:993] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917: : Instructing follower 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:35.594640 15870 raft_consensus.cc:1081] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Signalling peer 6cafb1b5fa254559a839a39f95b9a19a to start an election
I20260709 13:19:35.596379 15532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369"
dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
 from {username='slave'} at 127.0.0.1:44964
I20260709 13:19:35.597004 15532 raft_consensus.cc:493] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:35.597390 15532 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:35.604535 15532 raft_consensus.cc:515] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.606503 15532 leader_election.cc:290] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 3 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3:33797)
I20260709 13:19:35.608242 15607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
I20260709 13:19:35.608656 15786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5ba5a7dc9d4324b7bd5b73a51d9369" candidate_uuid: "6cafb1b5fa254559a839a39f95b9a19a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:35.608991 15607 raft_consensus.cc:3055] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:35.609396 15786 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:35.609439 15607 raft_consensus.cc:740] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:35.614094 15607 consensus_queue.cc:260] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.615669 15607 raft_consensus.cc:3060] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:35.617551 15786 raft_consensus.cc:2468] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 3.
I20260709 13:19:35.619007 15496 leader_election.cc:304] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cafb1b5fa254559a839a39f95b9a19a, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:35.620800 15885 raft_consensus.cc:2804] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:35.621285 15885 raft_consensus.cc:697] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Becoming Leader. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:35.622105 15885 consensus_queue.cc:237] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.623879 15893 raft_consensus.cc:993] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a: : Instructing follower 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:35.624428 15893 raft_consensus.cc:1081] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Signalling peer 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:35.628492 15606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2090e23184548509734e73d7676a1c9"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:58428
I20260709 13:19:35.629056 15606 raft_consensus.cc:493] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:35.629410 15606 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:35.638896 15606 raft_consensus.cc:515] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.647328 15786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:35.648085 15786 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:35.649338 15356 catalog_manager.cc:5697] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a reported cstate change: term changed from 2 to 3, leader changed from 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3) to 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2). New cstate: current_term: 3 leader_uuid: "6cafb1b5fa254559a839a39f95b9a19a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:35.653560 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2090e23184548509734e73d7676a1c9" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:35.654170 15532 raft_consensus.cc:3055] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:35.654436 15532 raft_consensus.cc:740] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:35.655148 15532 consensus_queue.cc:260] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.656448 15532 raft_consensus.cc:3060] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:35.663447 15606 leader_election.cc:290] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 4 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
W20260709 13:19:35.665067 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:35.665589 15607 raft_consensus.cc:2468] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cafb1b5fa254559a839a39f95b9a19a in term 3.
I20260709 13:19:35.670677 15786 raft_consensus.cc:2468] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 4.
I20260709 13:19:35.672168 15570 leader_election.cc:304] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:35.672247 15532 raft_consensus.cc:2468] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 4.
I20260709 13:19:35.673209 15832 raft_consensus.cc:2804] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:35.673751 15832 raft_consensus.cc:697] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 4 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:35.674685 15832 consensus_queue.cc:237] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.687103 15356 catalog_manager.cc:5697] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 3 to 4, leader changed from 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2) to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 4 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:35.700966 15661 raft_consensus.cc:993] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a: : Instructing follower 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:35.702174 15661 raft_consensus.cc:1081] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Signalling peer 6730ecd4b1d5461997d975e1e0e93917 to start an election
I20260709 13:19:35.705763 15607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a"
dest_uuid: "6730ecd4b1d5461997d975e1e0e93917"
 from {username='slave'} at 127.0.0.1:58428
I20260709 13:19:35.706277 15607 raft_consensus.cc:493] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:35.706585 15607 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:35.711352 15607 raft_consensus.cc:515] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.713256 15607 leader_election.cc:290] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 3 election: Requested vote from peers 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251), 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415)
I20260709 13:19:35.714003 15786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e"
I20260709 13:19:35.714644 15786 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:35.714823 15532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1728ef80cec94c2da5abafaca79cfb9a" candidate_uuid: "6730ecd4b1d5461997d975e1e0e93917" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cafb1b5fa254559a839a39f95b9a19a"
I20260709 13:19:35.715382 15532 raft_consensus.cc:3055] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:35.715649 15532 raft_consensus.cc:740] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6cafb1b5fa254559a839a39f95b9a19a, State: Running, Role: LEADER
I20260709 13:19:35.716459 15532 consensus_queue.cc:260] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.717682 15532 raft_consensus.cc:3060] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:35.722832 15786 raft_consensus.cc:2468] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 3.
I20260709 13:19:35.724103 15532 raft_consensus.cc:2468] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6730ecd4b1d5461997d975e1e0e93917 in term 3.
I20260709 13:19:35.724124 15570 leader_election.cc:304] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6730ecd4b1d5461997d975e1e0e93917, 73099f2ede394d1f8cf0a0ed6d6d914e; no voters: 
I20260709 13:19:35.725116 15832 raft_consensus.cc:2804] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:35.725569 15832 raft_consensus.cc:697] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 3 LEADER]: Becoming Leader. State: Replica: 6730ecd4b1d5461997d975e1e0e93917, State: Running, Role: LEADER
I20260709 13:19:35.726347 15832 consensus_queue.cc:237] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } }
I20260709 13:19:35.732652 15356 catalog_manager.cc:5697] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 reported cstate change: term changed from 2 to 3, leader changed from 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2) to 6730ecd4b1d5461997d975e1e0e93917 (127.6.233.3). New cstate: current_term: 3 leader_uuid: "6730ecd4b1d5461997d975e1e0e93917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:36.026327 15786 raft_consensus.cc:1275] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:36.027834 15885 consensus_queue.cc:1048] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:36.030535 15607 raft_consensus.cc:1275] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Refusing update from remote peer 6cafb1b5fa254559a839a39f95b9a19a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:36.032301 15885 consensus_queue.cc:1048] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6730ecd4b1d5461997d975e1e0e93917" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:19:36.154989 15628 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4320 after lost signal to thread 7079
I20260709 13:19:36.155892 15532 raft_consensus.cc:1275] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 4 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:19:36.156114 15628 debug-util.cc:398] Leaking SignalData structure 0x7b0800269900 after lost signal to thread 15390
W20260709 13:19:36.157567 15628 debug-util.cc:398] Leaking SignalData structure 0x7b0800238ee0 after lost signal to thread 15557
I20260709 13:19:36.157320 15870 consensus_queue.cc:1048] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:36.158802 15628 debug-util.cc:398] Leaking SignalData structure 0x7b0800326bc0 after lost signal to thread 15631
W20260709 13:19:36.159942 15628 debug-util.cc:398] Leaking SignalData structure 0x7b08000503a0 after lost signal to thread 15814
I20260709 13:19:36.170184 15786 raft_consensus.cc:1275] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 4 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:36.171921 15914 consensus_queue.cc:1048] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:36.340528 15786 raft_consensus.cc:1275] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:36.342000 15914 consensus_queue.cc:1048] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73099f2ede394d1f8cf0a0ed6d6d914e" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 45251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:36.350739 15532 raft_consensus.cc:1275] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Refusing update from remote peer 6730ecd4b1d5461997d975e1e0e93917: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:36.353178 15832 consensus_queue.cc:1048] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cafb1b5fa254559a839a39f95b9a19a" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 46415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:36.378777  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:36.440107  7076 tablet_server.cc:179] TabletServer@127.6.233.1:45251 shutting down...
W20260709 13:19:36.477233 15570 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 76 similar messages]
I20260709 13:19:36.492710  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:36.496503  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.498075  7076 raft_consensus.cc:2243] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.500119  7076 raft_consensus.cc:2272] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:36.501112 15570 consensus_peers.cc:597] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.503252  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.504004  7076 raft_consensus.cc:2243] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.504565  7076 raft_consensus.cc:2272] T eaa3cf8c223242aa9d4af09b802e0976 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.507112  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.507776  7076 raft_consensus.cc:2243] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.508239  7076 raft_consensus.cc:2272] T 1728ef80cec94c2da5abafaca79cfb9a P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.511528  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.512185  7076 raft_consensus.cc:2243] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.512615  7076 raft_consensus.cc:2272] T d2090e23184548509734e73d7676a1c9 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.515589  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.516309  7076 raft_consensus.cc:2243] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.516737  7076 raft_consensus.cc:2272] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.519711  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.520429  7076 raft_consensus.cc:2243] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.520833  7076 raft_consensus.cc:2272] T 904af91a3bcf498fae5d1d5fc130072d P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.523289  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.523878  7076 raft_consensus.cc:2243] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.524349  7076 raft_consensus.cc:2272] T 49dae0aab0d740888c95b1d0a26d62c7 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.526788  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.527421  7076 raft_consensus.cc:2243] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.527842  7076 raft_consensus.cc:2272] T 366512517bb54846832acb3aa279aeb4 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.530201  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.530735  7076 raft_consensus.cc:2243] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.531203  7076 raft_consensus.cc:2272] T a5cda7404bba4460b66b3e328e320c39 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.533859  7076 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:36.534440  7076 raft_consensus.cc:2243] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.534910  7076 raft_consensus.cc:2272] T 7746ae5a62294618aa5b1024e2183248 P 73099f2ede394d1f8cf0a0ed6d6d914e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:36.558255 15570 consensus_peers.cc:597] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.566143  7076 tablet_server.cc:196] TabletServer@127.6.233.1:45251 shutdown complete.
I20260709 13:19:36.596544  7076 tablet_server.cc:179] TabletServer@127.6.233.2:0 shutting down...
I20260709 13:19:36.652271  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:36.654268  7076 tablet_replica.cc:333] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.655596  7076 raft_consensus.cc:2243] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.656523  7076 raft_consensus.cc:2272] T a5cda7404bba4460b66b3e328e320c39 P 6cafb1b5fa254559a839a39f95b9a19a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:36.662153 15496 consensus_peers.cc:597] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.664808  7076 tablet_replica.cc:333] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
W20260709 13:19:36.665373 15572 consensus_peers.cc:597] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Couldn't send request to peer 6cafb1b5fa254559a839a39f95b9a19a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.666064 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:36.666813  7076 raft_consensus.cc:2243] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.667316  7076 raft_consensus.cc:2272] T 7746ae5a62294618aa5b1024e2183248 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.669795  7076 tablet_replica.cc:333] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.670410  7076 raft_consensus.cc:2243] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.671182  7076 raft_consensus.cc:2272] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.674674  7076 tablet_replica.cc:333] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.675334  7076 raft_consensus.cc:2243] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.675750  7076 raft_consensus.cc:2272] T 1728ef80cec94c2da5abafaca79cfb9a P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.680644  7076 tablet_replica.cc:333] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.681430  7076 raft_consensus.cc:2243] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.681967  7076 raft_consensus.cc:2272] T d2090e23184548509734e73d7676a1c9 P 6cafb1b5fa254559a839a39f95b9a19a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:36.682216 15572 consensus_peers.cc:597] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Couldn't send request to peer 6cafb1b5fa254559a839a39f95b9a19a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.684923  7076 tablet_replica.cc:333] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.685534  7076 raft_consensus.cc:2243] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.685961  7076 raft_consensus.cc:2272] T eaa3cf8c223242aa9d4af09b802e0976 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.689668  7076 tablet_replica.cc:333] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.690442  7076 raft_consensus.cc:2243] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.691288  7076 raft_consensus.cc:2272] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6cafb1b5fa254559a839a39f95b9a19a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.694417  7076 tablet_replica.cc:333] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.694972  7076 raft_consensus.cc:2243] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.695713  7076 raft_consensus.cc:2272] T 366512517bb54846832acb3aa279aeb4 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.697940  7076 tablet_replica.cc:333] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.698503  7076 raft_consensus.cc:2243] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.698920  7076 raft_consensus.cc:2272] T 49dae0aab0d740888c95b1d0a26d62c7 P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.701228  7076 tablet_replica.cc:333] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a: stopping tablet replica
I20260709 13:19:36.701771  7076 raft_consensus.cc:2243] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.702476  7076 raft_consensus.cc:2272] T 904af91a3bcf498fae5d1d5fc130072d P 6cafb1b5fa254559a839a39f95b9a19a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.757860  7076 tablet_server.cc:196] TabletServer@127.6.233.2:0 shutdown complete.
W20260709 13:19:36.764505 15572 consensus_peers.cc:597] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Couldn't send request to peer 6cafb1b5fa254559a839a39f95b9a19a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.799291  7076 tablet_server.cc:179] TabletServer@127.6.233.3:0 shutting down...
W20260709 13:19:36.805474 15572 consensus_peers.cc:597] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Couldn't send request to peer 6cafb1b5fa254559a839a39f95b9a19a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.808012 15570 consensus_peers.cc:597] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.836509 15570 consensus_peers.cc:597] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 73099f2ede394d1f8cf0a0ed6d6d914e (127.6.233.1:45251): Couldn't send request to peer 73099f2ede394d1f8cf0a0ed6d6d914e. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:45251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:36.844417 15572 consensus_peers.cc:597] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Couldn't send request to peer 6cafb1b5fa254559a839a39f95b9a19a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.854259  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:36.855299  7076 tablet_replica.cc:333] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.856462  7076 raft_consensus.cc:2243] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.857105  7076 raft_consensus.cc:2272] T c65b1035590e41cbbc5b51a8c3e5e0b4 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.860425  7076 tablet_replica.cc:333] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.861263  7076 raft_consensus.cc:2243] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.862346  7076 raft_consensus.cc:2272] T eaa3cf8c223242aa9d4af09b802e0976 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.865373  7076 tablet_replica.cc:333] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.866281  7076 raft_consensus.cc:2243] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.867384  7076 raft_consensus.cc:2272] T 7746ae5a62294618aa5b1024e2183248 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.870589  7076 tablet_replica.cc:333] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.871542  7076 raft_consensus.cc:2243] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.872787  7076 raft_consensus.cc:2272] T a5cda7404bba4460b66b3e328e320c39 P 6730ecd4b1d5461997d975e1e0e93917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.876129  7076 tablet_replica.cc:333] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.876976  7076 raft_consensus.cc:2243] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.877607  7076 raft_consensus.cc:2272] T 904af91a3bcf498fae5d1d5fc130072d P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.880873  7076 tablet_replica.cc:333] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.881665  7076 raft_consensus.cc:2243] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:36.882172 15572 consensus_peers.cc:597] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 -> Peer 6cafb1b5fa254559a839a39f95b9a19a (127.6.233.2:46415): Couldn't send request to peer 6cafb1b5fa254559a839a39f95b9a19a. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:46415: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:36.882233  7076 raft_consensus.cc:2272] T 366512517bb54846832acb3aa279aeb4 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.885774  7076 tablet_replica.cc:333] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.886670  7076 raft_consensus.cc:2243] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.887696  7076 raft_consensus.cc:2272] T 49dae0aab0d740888c95b1d0a26d62c7 P 6730ecd4b1d5461997d975e1e0e93917 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.890722  7076 tablet_replica.cc:333] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.891649  7076 raft_consensus.cc:2243] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:36.892279  7076 raft_consensus.cc:2272] T 6f5ba5a7dc9d4324b7bd5b73a51d9369 P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.895643  7076 tablet_replica.cc:333] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.896502  7076 raft_consensus.cc:2243] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.897636  7076 raft_consensus.cc:2272] T d2090e23184548509734e73d7676a1c9 P 6730ecd4b1d5461997d975e1e0e93917 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:36.900939  7076 tablet_replica.cc:333] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917: stopping tablet replica
I20260709 13:19:36.901682  7076 raft_consensus.cc:2243] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:36.902769  7076 raft_consensus.cc:2272] T 1728ef80cec94c2da5abafaca79cfb9a P 6730ecd4b1d5461997d975e1e0e93917 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:37.666965 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:37.934686  7076 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15628)
W20260709 13:19:38.668121 15404 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:38.935268  7076 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15628)
I20260709 13:19:39.319448  7076 tablet_server.cc:196] TabletServer@127.6.233.3:0 shutdown complete.
I20260709 13:19:39.341846  7076 master.cc:562] Master@127.6.233.62:43277 shutting down...
I20260709 13:19:39.365689  7076 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:39.366201  7076 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:39.366545  7076 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3e381a20642f412c863fea57071b9c7a: stopping tablet replica
I20260709 13:19:39.404493  7076 master.cc:584] Master@127.6.233.62:43277 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15944 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:19:39.450434  7076 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.233.62:41357
I20260709 13:19:39.451596  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:39.457530 15933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:39.457731 15932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:39.458420 15935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:39.458807  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:39.459905  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:39.460143  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:39.460322  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603179460286 us; error 0 us; skew 500 ppm
I20260709 13:19:39.460914  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:39.463161  7076 webserver.cc:533] Webserver started at http://127.6.233.62:36589/ using document root <none> and password file <none>
I20260709 13:19:39.463716  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:39.463958  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:39.464298  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:39.465533  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/master-0-root/instance:
uuid: "33759c72fe2745518e96e0debae75986"
format_stamp: "Formatted at 2026-07-09 13:19:39 on dist-test-slave-sjgx"
I20260709 13:19:39.469755  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:39.472965 15940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.473677  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:19:39.473955  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/master-0-root
uuid: "33759c72fe2745518e96e0debae75986"
format_stamp: "Formatted at 2026-07-09 13:19:39 on dist-test-slave-sjgx"
I20260709 13:19:39.474262  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:39.493877  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:39.495087  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:39.531806  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.62:41357
I20260709 13:19:39.531908 15991 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.62:41357 every 8 connection(s)
I20260709 13:19:39.535684 15992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:39.546360 15992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986: Bootstrap starting.
I20260709 13:19:39.550901 15992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:39.554929 15992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986: No bootstrap required, opened a new log
I20260709 13:19:39.557027 15992 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33759c72fe2745518e96e0debae75986" member_type: VOTER }
I20260709 13:19:39.557385 15992 raft_consensus.cc:385] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:39.557654 15992 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33759c72fe2745518e96e0debae75986, State: Initialized, Role: FOLLOWER
I20260709 13:19:39.558209 15992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33759c72fe2745518e96e0debae75986" member_type: VOTER }
I20260709 13:19:39.558645 15992 raft_consensus.cc:399] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:39.558868 15992 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:39.559136 15992 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:39.563511 15992 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33759c72fe2745518e96e0debae75986" member_type: VOTER }
I20260709 13:19:39.563992 15992 leader_election.cc:304] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33759c72fe2745518e96e0debae75986; no voters: 
I20260709 13:19:39.565074 15992 leader_election.cc:290] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:39.565454 15995 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:39.566759 15995 raft_consensus.cc:697] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 1 LEADER]: Becoming Leader. State: Replica: 33759c72fe2745518e96e0debae75986, State: Running, Role: LEADER
I20260709 13:19:39.567426 15995 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33759c72fe2745518e96e0debae75986" member_type: VOTER }
I20260709 13:19:39.568011 15992 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:39.571650 15997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33759c72fe2745518e96e0debae75986. Latest consensus state: current_term: 1 leader_uuid: "33759c72fe2745518e96e0debae75986" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33759c72fe2745518e96e0debae75986" member_type: VOTER } }
I20260709 13:19:39.572103 15996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33759c72fe2745518e96e0debae75986" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33759c72fe2745518e96e0debae75986" member_type: VOTER } }
I20260709 13:19:39.572409 15997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:39.572719 15996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:39.574213 16002 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:39.579092 16002 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:39.583765  7076 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:39.587880 16002 catalog_manager.cc:1383] Generated new cluster ID: 77e7e63165604c70b913d1be573efd46
I20260709 13:19:39.588212 16002 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:39.607395 16002 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:39.608728 16002 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:39.621450 16002 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986: Generated new TSK 0
I20260709 13:19:39.622059 16002 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:39.651203  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:39.657008 16013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:39.658118 16014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:39.660102 16016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:39.660292  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:39.661342  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:39.661567  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:39.661749  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603179661727 us; error 0 us; skew 500 ppm
I20260709 13:19:39.662245  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:39.664495  7076 webserver.cc:533] Webserver started at http://127.6.233.1:41155/ using document root <none> and password file <none>
I20260709 13:19:39.664958  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:39.665153  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:39.665421  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:39.666451  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-0-root/instance:
uuid: "3471e07a98e44052a21d5816bb06b25b"
format_stamp: "Formatted at 2026-07-09 13:19:39 on dist-test-slave-sjgx"
I20260709 13:19:39.670976  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:19:39.674871 16021 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.675676  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:39.675990  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "3471e07a98e44052a21d5816bb06b25b"
format_stamp: "Formatted at 2026-07-09 13:19:39 on dist-test-slave-sjgx"
I20260709 13:19:39.676317  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:39.688271  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:39.689419  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:39.690809  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:39.693131  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:39.693310  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.693590  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:39.693773  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.733232  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:34611
I20260709 13:19:39.733346 16083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:34611 every 8 connection(s)
I20260709 13:19:39.738576  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:39.748025 16088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:39.749683 16089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:39.754347 16092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:39.754935  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:39.756080 16084 heartbeater.cc:344] Connected to a master server at 127.6.233.62:41357
I20260709 13:19:39.756248  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:39.756511 16084 heartbeater.cc:461] Registering TS with master...
W20260709 13:19:39.756615  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:39.756901  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603179756884 us; error 0 us; skew 500 ppm
I20260709 13:19:39.757407 16084 heartbeater.cc:507] Master 127.6.233.62:41357 requested a full tablet report, sending...
I20260709 13:19:39.757505  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:39.759747 15957 ts_manager.cc:194] Registered new tserver with Master: 3471e07a98e44052a21d5816bb06b25b (127.6.233.1:34611)
I20260709 13:19:39.760433  7076 webserver.cc:533] Webserver started at http://127.6.233.2:34355/ using document root <none> and password file <none>
I20260709 13:19:39.760974  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:39.761157  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:39.761430  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:39.761752 15957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49712
I20260709 13:19:39.762537  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-1-root/instance:
uuid: "a8dfb582871148c7b273b907e7ea1a17"
format_stamp: "Formatted at 2026-07-09 13:19:39 on dist-test-slave-sjgx"
I20260709 13:19:39.766826  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:19:39.769951 16096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.770676  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:19:39.770960  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-1-root
uuid: "a8dfb582871148c7b273b907e7ea1a17"
format_stamp: "Formatted at 2026-07-09 13:19:39 on dist-test-slave-sjgx"
I20260709 13:19:39.771219  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:39.782145  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:39.783300  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:39.784885  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:39.787495  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:39.787667  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.787846  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:39.787968  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.826813  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.2:42955
I20260709 13:19:39.826931 16158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.2:42955 every 8 connection(s)
I20260709 13:19:39.831614  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:39.838214 16162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:39.839152 16163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:39.842684 16165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:39.842921  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:39.843876  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:39.844126  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:39.844340  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603179844322 us; error 0 us; skew 500 ppm
I20260709 13:19:39.844892 16159 heartbeater.cc:344] Connected to a master server at 127.6.233.62:41357
I20260709 13:19:39.844983  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:39.845456 16159 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:39.846431 16159 heartbeater.cc:507] Master 127.6.233.62:41357 requested a full tablet report, sending...
I20260709 13:19:39.847954  7076 webserver.cc:533] Webserver started at http://127.6.233.3:46575/ using document root <none> and password file <none>
I20260709 13:19:39.848556  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:39.848742  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:39.848694 15957 ts_manager.cc:194] Registered new tserver with Master: a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955)
I20260709 13:19:39.849205  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:39.850260 15957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49724
I20260709 13:19:39.850364  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-2-root/instance:
uuid: "27561a4375e5458d8b3ab53e20dc41c5"
format_stamp: "Formatted at 2026-07-09 13:19:39 on dist-test-slave-sjgx"
I20260709 13:19:39.854970  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:39.858148 16170 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.858875  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:39.859163  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-2-root
uuid: "27561a4375e5458d8b3ab53e20dc41c5"
format_stamp: "Formatted at 2026-07-09 13:19:39 on dist-test-slave-sjgx"
I20260709 13:19:39.859428  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602912355568-7076-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:39.873744  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:39.874863  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:39.876422  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:39.878687  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:39.878911  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.879148  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:39.879316  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:39.918319  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.3:36235
I20260709 13:19:39.918438 16232 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.3:36235 every 8 connection(s)
I20260709 13:19:39.931947 16233 heartbeater.cc:344] Connected to a master server at 127.6.233.62:41357
I20260709 13:19:39.932533 16233 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:39.933357 16233 heartbeater.cc:507] Master 127.6.233.62:41357 requested a full tablet report, sending...
I20260709 13:19:39.935410 15957 ts_manager.cc:194] Registered new tserver with Master: 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:39.936159  7076 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014626524s
I20260709 13:19:39.937418 15957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49730
I20260709 13:19:39.963033 15957 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49738:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:39.965342 15957 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:40.010056 16049 tablet_service.cc:1511] Processing CreateTablet for tablet 2f43b7d02be042c386b6428819c45095 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=48137be4574547bf956385a28cc9e71f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:40.011564 16049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f43b7d02be042c386b6428819c45095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.011286 16123 tablet_service.cc:1511] Processing CreateTablet for tablet 64513640e8a04e20b6ff7ee65462179a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=48137be4574547bf956385a28cc9e71f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:40.012701 16123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64513640e8a04e20b6ff7ee65462179a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.013322 16124 tablet_service.cc:1511] Processing CreateTablet for tablet 2f43b7d02be042c386b6428819c45095 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=48137be4574547bf956385a28cc9e71f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:40.014281 16124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f43b7d02be042c386b6428819c45095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.017675 16048 tablet_service.cc:1511] Processing CreateTablet for tablet 64513640e8a04e20b6ff7ee65462179a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=48137be4574547bf956385a28cc9e71f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:40.018208 16197 tablet_service.cc:1511] Processing CreateTablet for tablet 64513640e8a04e20b6ff7ee65462179a (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=48137be4574547bf956385a28cc9e71f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:40.019045 16048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64513640e8a04e20b6ff7ee65462179a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.019585 16197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64513640e8a04e20b6ff7ee65462179a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.018272 16198 tablet_service.cc:1511] Processing CreateTablet for tablet 2f43b7d02be042c386b6428819c45095 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=48137be4574547bf956385a28cc9e71f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:40.021894 16198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f43b7d02be042c386b6428819c45095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.050220 16250 tablet_bootstrap.cc:492] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b: Bootstrap starting.
I20260709 13:19:40.051473 16248 tablet_bootstrap.cc:492] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17: Bootstrap starting.
I20260709 13:19:40.057803 16249 tablet_bootstrap.cc:492] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5: Bootstrap starting.
I20260709 13:19:40.058574 16248 tablet_bootstrap.cc:654] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.063639 16250 tablet_bootstrap.cc:654] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.064488 16249 tablet_bootstrap.cc:654] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.070670 16248 tablet_bootstrap.cc:492] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17: No bootstrap required, opened a new log
I20260709 13:19:40.070688 16249 tablet_bootstrap.cc:492] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5: No bootstrap required, opened a new log
I20260709 13:19:40.071244 16248 ts_tablet_manager.cc:1403] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:19:40.071396 16250 tablet_bootstrap.cc:492] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b: No bootstrap required, opened a new log
I20260709 13:19:40.071331 16249 ts_tablet_manager.cc:1403] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:19:40.072077 16250 ts_tablet_manager.cc:1403] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:19:40.074496 16248 raft_consensus.cc:359] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.075485 16250 raft_consensus.cc:359] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.075235 16249 raft_consensus.cc:359] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.075327 16248 raft_consensus.cc:385] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.077039 16250 raft_consensus.cc:385] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.077081 16249 raft_consensus.cc:385] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.077325 16248 raft_consensus.cc:740] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8dfb582871148c7b273b907e7ea1a17, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.077543 16250 raft_consensus.cc:740] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.077661 16249 raft_consensus.cc:740] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27561a4375e5458d8b3ab53e20dc41c5, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.078351 16248 consensus_queue.cc:260] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.078428 16250 consensus_queue.cc:260] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.078730 16249 consensus_queue.cc:260] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.081239 16159 heartbeater.cc:499] Master 127.6.233.62:41357 was elected leader, sending a full tablet report...
I20260709 13:19:40.081743 16248 ts_tablet_manager.cc:1434] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:40.083112 16248 tablet_bootstrap.cc:492] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17: Bootstrap starting.
I20260709 13:19:40.092473 16248 tablet_bootstrap.cc:654] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.103365 16084 heartbeater.cc:499] Master 127.6.233.62:41357 was elected leader, sending a full tablet report...
I20260709 13:19:40.104307 16250 ts_tablet_manager.cc:1434] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b: Time spent starting tablet: real 0.032s	user 0.014s	sys 0.015s
I20260709 13:19:40.104970 16233 heartbeater.cc:499] Master 127.6.233.62:41357 was elected leader, sending a full tablet report...
I20260709 13:19:40.105587 16250 tablet_bootstrap.cc:492] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b: Bootstrap starting.
I20260709 13:19:40.106545 16248 tablet_bootstrap.cc:492] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17: No bootstrap required, opened a new log
I20260709 13:19:40.107101 16248 ts_tablet_manager.cc:1403] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.019s
I20260709 13:19:40.107966 16249 ts_tablet_manager.cc:1434] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.025s
I20260709 13:19:40.109004 16249 tablet_bootstrap.cc:492] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5: Bootstrap starting.
I20260709 13:19:40.110133 16248 raft_consensus.cc:359] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.110944 16248 raft_consensus.cc:385] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.111268 16248 raft_consensus.cc:740] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8dfb582871148c7b273b907e7ea1a17, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.112254 16248 consensus_queue.cc:260] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.115942 16249 tablet_bootstrap.cc:654] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.116585 16248 ts_tablet_manager.cc:1434] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:19:40.122994 16250 tablet_bootstrap.cc:654] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.129159 16250 tablet_bootstrap.cc:492] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b: No bootstrap required, opened a new log
I20260709 13:19:40.129618 16250 ts_tablet_manager.cc:1403] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 13:19:40.129739 16249 tablet_bootstrap.cc:492] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5: No bootstrap required, opened a new log
I20260709 13:19:40.130264 16249 ts_tablet_manager.cc:1403] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:19:40.131978 16250 raft_consensus.cc:359] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.132666 16250 raft_consensus.cc:385] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.132421 16249 raft_consensus.cc:359] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.132946 16250 raft_consensus.cc:740] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.133133 16249 raft_consensus.cc:385] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.133452 16249 raft_consensus.cc:740] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27561a4375e5458d8b3ab53e20dc41c5, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.133776 16250 consensus_queue.cc:260] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.134137 16249 consensus_queue.cc:260] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.135895 16250 ts_tablet_manager.cc:1434] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:40.136515 16249 ts_tablet_manager.cc:1434] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:19:40.180686 16255 raft_consensus.cc:493] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.181128 16255 raft_consensus.cc:515] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.183235 16255 leader_election.cc:290] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:40.190277 16256 raft_consensus.cc:493] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.190884 16256 raft_consensus.cc:515] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.192078 16134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17" is_pre_election: true
I20260709 13:19:40.192832 16134 raft_consensus.cc:2468] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 0.
I20260709 13:19:40.193668 16256 leader_election.cc:290] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3471e07a98e44052a21d5816bb06b25b (127.6.233.1:34611), a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955)
I20260709 13:19:40.193838 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5" is_pre_election: true
I20260709 13:19:40.195775 16208 raft_consensus.cc:2468] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 0.
I20260709 13:19:40.194259 16022 leader_election.cc:304] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3471e07a98e44052a21d5816bb06b25b, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:40.197129 16255 raft_consensus.cc:2804] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:40.197683 16255 raft_consensus.cc:493] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.198192 16255 raft_consensus.cc:3060] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.203860 16059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a" candidate_uuid: "27561a4375e5458d8b3ab53e20dc41c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3471e07a98e44052a21d5816bb06b25b" is_pre_election: true
I20260709 13:19:40.205586 16255 raft_consensus.cc:515] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.206619 16059 raft_consensus.cc:2393] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27561a4375e5458d8b3ab53e20dc41c5 in current term 1: Already voted for candidate 3471e07a98e44052a21d5816bb06b25b in this term.
I20260709 13:19:40.206887 16134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a" candidate_uuid: "27561a4375e5458d8b3ab53e20dc41c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17" is_pre_election: true
I20260709 13:19:40.207507 16134 raft_consensus.cc:2468] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27561a4375e5458d8b3ab53e20dc41c5 in term 0.
I20260709 13:19:40.208492 16133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17"
I20260709 13:19:40.208778 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
I20260709 13:19:40.209177 16133 raft_consensus.cc:3060] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.209306 16208 raft_consensus.cc:3060] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.208544 16255 leader_election.cc:290] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 election: Requested vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:40.209662 16171 leader_election.cc:304] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27561a4375e5458d8b3ab53e20dc41c5, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:40.216890 16133 raft_consensus.cc:2468] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 1.
I20260709 13:19:40.216881 16208 raft_consensus.cc:2468] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 1.
I20260709 13:19:40.218395 16023 leader_election.cc:304] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27561a4375e5458d8b3ab53e20dc41c5, 3471e07a98e44052a21d5816bb06b25b; no voters: 
I20260709 13:19:40.218616 16256 raft_consensus.cc:2764] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:19:40.219437 16255 raft_consensus.cc:2804] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:40.220705 16255 raft_consensus.cc:697] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Becoming Leader. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Running, Role: LEADER
I20260709 13:19:40.221431 16255 consensus_queue.cc:237] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.228554 15955 catalog_manager.cc:5697] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3471e07a98e44052a21d5816bb06b25b (127.6.233.1). New cstate: current_term: 1 leader_uuid: "3471e07a98e44052a21d5816bb06b25b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.424103 16254 raft_consensus.cc:493] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.424626 16254 raft_consensus.cc:515] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.426507 16254 leader_election.cc:290] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3471e07a98e44052a21d5816bb06b25b (127.6.233.1:34611), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:40.433102 16256 raft_consensus.cc:493] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.433712 16256 raft_consensus.cc:515] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.436728 16133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "27561a4375e5458d8b3ab53e20dc41c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17" is_pre_election: true
I20260709 13:19:40.436837 16256 leader_election.cc:290] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 3471e07a98e44052a21d5816bb06b25b (127.6.233.1:34611)
I20260709 13:19:40.437414 16133 raft_consensus.cc:2468] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27561a4375e5458d8b3ab53e20dc41c5 in term 0.
I20260709 13:19:40.437143 16059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "27561a4375e5458d8b3ab53e20dc41c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3471e07a98e44052a21d5816bb06b25b" is_pre_election: true
I20260709 13:19:40.437722 16058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "a8dfb582871148c7b273b907e7ea1a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3471e07a98e44052a21d5816bb06b25b" is_pre_election: true
I20260709 13:19:40.438512 16058 raft_consensus.cc:2468] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8dfb582871148c7b273b907e7ea1a17 in term 0.
I20260709 13:19:40.438432 16171 leader_election.cc:304] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27561a4375e5458d8b3ab53e20dc41c5, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:40.439132 16059 raft_consensus.cc:2468] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27561a4375e5458d8b3ab53e20dc41c5 in term 0.
I20260709 13:19:40.439330 16256 raft_consensus.cc:2804] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:40.439779 16256 raft_consensus.cc:493] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.439952 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "a8dfb582871148c7b273b907e7ea1a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5" is_pre_election: true
I20260709 13:19:40.439785 16098 leader_election.cc:304] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3471e07a98e44052a21d5816bb06b25b, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:40.440397 16256 raft_consensus.cc:3060] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.441113 16254 raft_consensus.cc:2804] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:40.441516 16254 raft_consensus.cc:493] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.441862 16254 raft_consensus.cc:3060] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.448372 16256 raft_consensus.cc:515] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.449561 16208 raft_consensus.cc:2393] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8dfb582871148c7b273b907e7ea1a17 in current term 1: Already voted for candidate 27561a4375e5458d8b3ab53e20dc41c5 in this term.
I20260709 13:19:40.449177 16254 raft_consensus.cc:515] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.451363 16133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "27561a4375e5458d8b3ab53e20dc41c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17"
I20260709 13:19:40.451432 16254 leader_election.cc:290] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [CANDIDATE]: Term 1 election: Requested vote from peers 3471e07a98e44052a21d5816bb06b25b (127.6.233.1:34611), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:40.451654 16059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "27561a4375e5458d8b3ab53e20dc41c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3471e07a98e44052a21d5816bb06b25b"
I20260709 13:19:40.451450 16256 leader_election.cc:290] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [CANDIDATE]: Term 1 election: Requested vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 3471e07a98e44052a21d5816bb06b25b (127.6.233.1:34611)
I20260709 13:19:40.452371 16133 raft_consensus.cc:2393] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 27561a4375e5458d8b3ab53e20dc41c5 in current term 1: Already voted for candidate a8dfb582871148c7b273b907e7ea1a17 in this term.
I20260709 13:19:40.452618 16059 raft_consensus.cc:3060] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.453572 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "a8dfb582871148c7b273b907e7ea1a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
I20260709 13:19:40.453821 16058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "a8dfb582871148c7b273b907e7ea1a17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3471e07a98e44052a21d5816bb06b25b"
I20260709 13:19:40.454344 16208 raft_consensus.cc:2393] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8dfb582871148c7b273b907e7ea1a17 in current term 1: Already voted for candidate 27561a4375e5458d8b3ab53e20dc41c5 in this term.
I20260709 13:19:40.455677 16098 leader_election.cc:304] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8dfb582871148c7b273b907e7ea1a17; no voters: 27561a4375e5458d8b3ab53e20dc41c5, 3471e07a98e44052a21d5816bb06b25b
I20260709 13:19:40.456336 16254 raft_consensus.cc:2749] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:40.459264 16059 raft_consensus.cc:2468] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27561a4375e5458d8b3ab53e20dc41c5 in term 1.
I20260709 13:19:40.460374 16172 leader_election.cc:304] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27561a4375e5458d8b3ab53e20dc41c5, 3471e07a98e44052a21d5816bb06b25b; no voters: a8dfb582871148c7b273b907e7ea1a17
I20260709 13:19:40.461122 16256 raft_consensus.cc:2804] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:40.461974 16256 raft_consensus.cc:697] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 LEADER]: Becoming Leader. State: Replica: 27561a4375e5458d8b3ab53e20dc41c5, State: Running, Role: LEADER
I20260709 13:19:40.462734 16256 consensus_queue.cc:237] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.468979 15955 catalog_manager.cc:5697] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "27561a4375e5458d8b3ab53e20dc41c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:40.511354 15955 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49748:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:40.514443 15955 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:40.544950 16048 tablet_service.cc:1511] Processing CreateTablet for tablet be4a1d36ab954a4eaca95b27fddb3a17 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8886d048b29b4c15b866457cd0f1c08d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:40.545732 16123 tablet_service.cc:1511] Processing CreateTablet for tablet be4a1d36ab954a4eaca95b27fddb3a17 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8886d048b29b4c15b866457cd0f1c08d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:40.546260 16048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4a1d36ab954a4eaca95b27fddb3a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.547012 16123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4a1d36ab954a4eaca95b27fddb3a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.548521 16049 tablet_service.cc:1511] Processing CreateTablet for tablet 840f719b9989481c9d03751e412c7a70 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8886d048b29b4c15b866457cd0f1c08d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:40.549536 16049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840f719b9989481c9d03751e412c7a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.553088 16198 tablet_service.cc:1511] Processing CreateTablet for tablet be4a1d36ab954a4eaca95b27fddb3a17 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8886d048b29b4c15b866457cd0f1c08d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:19:40.554323 16198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4a1d36ab954a4eaca95b27fddb3a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.558990 16124 tablet_service.cc:1511] Processing CreateTablet for tablet 840f719b9989481c9d03751e412c7a70 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8886d048b29b4c15b866457cd0f1c08d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:40.560286 16124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840f719b9989481c9d03751e412c7a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.561074 16197 tablet_service.cc:1511] Processing CreateTablet for tablet 840f719b9989481c9d03751e412c7a70 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8886d048b29b4c15b866457cd0f1c08d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:19:40.562371 16197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 840f719b9989481c9d03751e412c7a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:40.568352 16250 tablet_bootstrap.cc:492] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b: Bootstrap starting.
I20260709 13:19:40.573812 16249 tablet_bootstrap.cc:492] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5: Bootstrap starting.
I20260709 13:19:40.578080 16250 tablet_bootstrap.cc:654] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:40.578862 16005 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:40.581249 16248 tablet_bootstrap.cc:492] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17: Bootstrap starting.
I20260709 13:19:40.582419 16249 tablet_bootstrap.cc:654] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.590402 16248 tablet_bootstrap.cc:654] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.590829 16249 tablet_bootstrap.cc:492] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5: No bootstrap required, opened a new log
I20260709 13:19:40.591379 16249 ts_tablet_manager.cc:1403] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:19:40.594146 16249 raft_consensus.cc:359] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.594794 16249 raft_consensus.cc:385] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.595086 16249 raft_consensus.cc:740] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27561a4375e5458d8b3ab53e20dc41c5, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.596016 16249 consensus_queue.cc:260] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.598268 16249 ts_tablet_manager.cc:1434] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:19:40.599596 16249 tablet_bootstrap.cc:492] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5: Bootstrap starting.
I20260709 13:19:40.600270 16250 tablet_bootstrap.cc:492] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b: No bootstrap required, opened a new log
I20260709 13:19:40.600360 16248 tablet_bootstrap.cc:492] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17: No bootstrap required, opened a new log
I20260709 13:19:40.600970 16250 ts_tablet_manager.cc:1403] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.002s
I20260709 13:19:40.601099 16248 ts_tablet_manager.cc:1403] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:19:40.604122 16250 raft_consensus.cc:359] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.604877 16250 raft_consensus.cc:385] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.605224 16250 raft_consensus.cc:740] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.605854 16249 tablet_bootstrap.cc:654] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.605615 16248 raft_consensus.cc:359] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.606470 16248 raft_consensus.cc:385] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.606165 16250 consensus_queue.cc:260] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.606878 16248 raft_consensus.cc:740] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8dfb582871148c7b273b907e7ea1a17, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.608001 16248 consensus_queue.cc:260] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.608892 16250 ts_tablet_manager.cc:1434] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:19:40.609987 16250 tablet_bootstrap.cc:492] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b: Bootstrap starting.
I20260709 13:19:40.614790 16248 ts_tablet_manager.cc:1434] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:40.616266 16250 tablet_bootstrap.cc:654] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.616307 16248 tablet_bootstrap.cc:492] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17: Bootstrap starting.
I20260709 13:19:40.625658 16248 tablet_bootstrap.cc:654] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:40.626586 16255 consensus_queue.cc:1048] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:40.641779 16248 tablet_bootstrap.cc:492] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17: No bootstrap required, opened a new log
I20260709 13:19:40.642652 16248 ts_tablet_manager.cc:1403] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:19:40.646677 16248 raft_consensus.cc:359] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.647796 16248 raft_consensus.cc:385] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.648285 16248 raft_consensus.cc:740] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8dfb582871148c7b273b907e7ea1a17, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.649367 16248 consensus_queue.cc:260] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.652518 16248 ts_tablet_manager.cc:1434] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:19:40.671314 16250 tablet_bootstrap.cc:492] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b: No bootstrap required, opened a new log
I20260709 13:19:40.671990 16250 ts_tablet_manager.cc:1403] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b: Time spent bootstrapping tablet: real 0.062s	user 0.035s	sys 0.026s
I20260709 13:19:40.672443 16249 tablet_bootstrap.cc:492] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5: No bootstrap required, opened a new log
I20260709 13:19:40.673166 16249 ts_tablet_manager.cc:1403] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5: Time spent bootstrapping tablet: real 0.074s	user 0.028s	sys 0.039s
I20260709 13:19:40.675336 16250 raft_consensus.cc:359] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.676397 16250 raft_consensus.cc:385] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.676848 16250 raft_consensus.cc:740] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.677771 16250 consensus_queue.cc:260] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.678023 16249 raft_consensus.cc:359] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.680305 16249 raft_consensus.cc:385] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:40.680478 16250 ts_tablet_manager.cc:1434] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:40.681207 16249 raft_consensus.cc:740] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27561a4375e5458d8b3ab53e20dc41c5, State: Initialized, Role: FOLLOWER
I20260709 13:19:40.682309 16249 consensus_queue.cc:260] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.684362 16283 consensus_queue.cc:1048] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Connected to new peer: Peer: permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:40.688069 16249 ts_tablet_manager.cc:1434] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:19:40.767956 16283 raft_consensus.cc:493] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.768405 16283 raft_consensus.cc:515] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.770038 16283 leader_election.cc:290] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:40.770772 16133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840f719b9989481c9d03751e412c7a70" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17" is_pre_election: true
I20260709 13:19:40.771060 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840f719b9989481c9d03751e412c7a70" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5" is_pre_election: true
I20260709 13:19:40.771363 16133 raft_consensus.cc:2468] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 0.
I20260709 13:19:40.771744 16208 raft_consensus.cc:2468] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 0.
I20260709 13:19:40.772455 16022 leader_election.cc:304] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3471e07a98e44052a21d5816bb06b25b, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:40.773198 16283 raft_consensus.cc:2804] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:40.773505 16283 raft_consensus.cc:493] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.773772 16283 raft_consensus.cc:3060] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.779021 16283 raft_consensus.cc:515] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.780637 16283 leader_election.cc:290] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 election: Requested vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:40.781399 16133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840f719b9989481c9d03751e412c7a70" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17"
I20260709 13:19:40.781647 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "840f719b9989481c9d03751e412c7a70" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
I20260709 13:19:40.781953 16133 raft_consensus.cc:3060] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.782220 16208 raft_consensus.cc:3060] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.786993 16133 raft_consensus.cc:2468] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 1.
I20260709 13:19:40.787181 16208 raft_consensus.cc:2468] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 1.
I20260709 13:19:40.788132 16022 leader_election.cc:304] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3471e07a98e44052a21d5816bb06b25b, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:40.788998 16283 raft_consensus.cc:2804] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:40.789498 16283 raft_consensus.cc:697] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Becoming Leader. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Running, Role: LEADER
I20260709 13:19:40.790344 16283 consensus_queue.cc:237] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.796909 15957 catalog_manager.cc:5697] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3471e07a98e44052a21d5816bb06b25b (127.6.233.1). New cstate: current_term: 1 leader_uuid: "3471e07a98e44052a21d5816bb06b25b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.877344 16283 raft_consensus.cc:493] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.877978 16283 raft_consensus.cc:515] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.879828 16283 leader_election.cc:290] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:40.880504 16133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4a1d36ab954a4eaca95b27fddb3a17" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17" is_pre_election: true
I20260709 13:19:40.880816 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4a1d36ab954a4eaca95b27fddb3a17" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5" is_pre_election: true
I20260709 13:19:40.881121 16133 raft_consensus.cc:2468] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 0.
I20260709 13:19:40.881491 16208 raft_consensus.cc:2468] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 0.
I20260709 13:19:40.882110 16022 leader_election.cc:304] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3471e07a98e44052a21d5816bb06b25b, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:40.882915 16283 raft_consensus.cc:2804] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:40.883277 16283 raft_consensus.cc:493] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.883558 16283 raft_consensus.cc:3060] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.888229 16283 raft_consensus.cc:515] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.889808 16283 leader_election.cc:290] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 election: Requested vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:40.890519 16133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4a1d36ab954a4eaca95b27fddb3a17" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8dfb582871148c7b273b907e7ea1a17"
I20260709 13:19:40.890823 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4a1d36ab954a4eaca95b27fddb3a17" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
I20260709 13:19:40.891157 16133 raft_consensus.cc:3060] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.891387 16208 raft_consensus.cc:3060] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:40.898137 16208 raft_consensus.cc:2468] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 1.
I20260709 13:19:40.898137 16133 raft_consensus.cc:2468] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 1.
I20260709 13:19:40.899295 16023 leader_election.cc:304] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27561a4375e5458d8b3ab53e20dc41c5, 3471e07a98e44052a21d5816bb06b25b; no voters: 
I20260709 13:19:40.899940 16283 raft_consensus.cc:2804] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:40.900441 16283 raft_consensus.cc:697] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Becoming Leader. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Running, Role: LEADER
I20260709 13:19:40.901218 16283 consensus_queue.cc:237] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:40.907270 15957 catalog_manager.cc:5697] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3471e07a98e44052a21d5816bb06b25b (127.6.233.1). New cstate: current_term: 1 leader_uuid: "3471e07a98e44052a21d5816bb06b25b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.929838 16256 consensus_queue.cc:1048] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:40.946625 16256 consensus_queue.cc:1048] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:40.955250 16208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f43b7d02be042c386b6428819c45095"
dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
mode: GRACEFUL
new_leader_uuid: "3471e07a98e44052a21d5816bb06b25b"
 from {username='slave'} at 127.0.0.1:48622
I20260709 13:19:40.955790 16208 raft_consensus.cc:606] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 LEADER]: Received request to transfer leadership to TS 3471e07a98e44052a21d5816bb06b25b
I20260709 13:19:40.969135 16059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a"
dest_uuid: "3471e07a98e44052a21d5816bb06b25b"
mode: GRACEFUL
new_leader_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
 from {username='slave'} at 127.0.0.1:42708
I20260709 13:19:40.969662 16059 raft_consensus.cc:606] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Received request to transfer leadership to TS 27561a4375e5458d8b3ab53e20dc41c5
I20260709 13:19:40.996134  7076 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:19:40.997653  7076 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:19:40.998040  7076 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:19:41.009208 16059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be4a1d36ab954a4eaca95b27fddb3a17"
dest_uuid: "3471e07a98e44052a21d5816bb06b25b"
mode: GRACEFUL
new_leader_uuid: "a8dfb582871148c7b273b907e7ea1a17"
 from {username='slave'} at 127.0.0.1:42720
I20260709 13:19:41.009738 16059 raft_consensus.cc:606] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Received request to transfer leadership to TS a8dfb582871148c7b273b907e7ea1a17
I20260709 13:19:41.010840  7076 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:19:41.192984 16283 consensus_queue.cc:1048] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Connected to new peer: Peer: permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:41.208002 16255 consensus_queue.cc:1048] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:41.277386 16297 raft_consensus.cc:993] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b: : Instructing follower 27561a4375e5458d8b3ab53e20dc41c5 to start an election
I20260709 13:19:41.277992 16255 raft_consensus.cc:1081] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Signalling peer 27561a4375e5458d8b3ab53e20dc41c5 to start an election
I20260709 13:19:41.279886 16208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a"
dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
 from {username='slave'} at 127.0.0.1:48602
I20260709 13:19:41.280632 16208 raft_consensus.cc:493] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.280972 16208 raft_consensus.cc:3060] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.288522 16208 raft_consensus.cc:515] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.290130 16208 leader_election.cc:290] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [CANDIDATE]: Term 2 election: Requested vote from peers 3471e07a98e44052a21d5816bb06b25b (127.6.233.1:34611), a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955)
I20260709 13:19:41.291656 16059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a" candidate_uuid: "27561a4375e5458d8b3ab53e20dc41c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3471e07a98e44052a21d5816bb06b25b"
I20260709 13:19:41.291656 16133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64513640e8a04e20b6ff7ee65462179a" candidate_uuid: "27561a4375e5458d8b3ab53e20dc41c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8dfb582871148c7b273b907e7ea1a17"
I20260709 13:19:41.292730 16059 raft_consensus.cc:3055] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:41.292765 16133 raft_consensus.cc:3060] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.293216 16059 raft_consensus.cc:740] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Running, Role: LEADER
I20260709 13:19:41.294346 16059 consensus_queue.cc:260] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.296068 16059 raft_consensus.cc:3060] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.302790 16133 raft_consensus.cc:2468] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27561a4375e5458d8b3ab53e20dc41c5 in term 2.
I20260709 13:19:41.304302 16171 leader_election.cc:304] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27561a4375e5458d8b3ab53e20dc41c5, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:41.305141 16256 raft_consensus.cc:2804] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:41.305584 16059 raft_consensus.cc:2468] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27561a4375e5458d8b3ab53e20dc41c5 in term 2.
I20260709 13:19:41.305670 16256 raft_consensus.cc:697] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 LEADER]: Becoming Leader. State: Replica: 27561a4375e5458d8b3ab53e20dc41c5, State: Running, Role: LEADER
I20260709 13:19:41.307283 16256 consensus_queue.cc:237] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.313544 15955 catalog_manager.cc:5697] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 reported cstate change: term changed from 1 to 2, leader changed from 3471e07a98e44052a21d5816bb06b25b (127.6.233.1) to 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "27561a4375e5458d8b3ab53e20dc41c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.450148 16255 consensus_queue.cc:1048] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:41.457844 16297 raft_consensus.cc:993] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b: : Instructing follower a8dfb582871148c7b273b907e7ea1a17 to start an election
I20260709 13:19:41.458525 16297 raft_consensus.cc:1081] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Signalling peer a8dfb582871148c7b273b907e7ea1a17 to start an election
I20260709 13:19:41.462369 16134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be4a1d36ab954a4eaca95b27fddb3a17"
dest_uuid: "a8dfb582871148c7b273b907e7ea1a17"
 from {username='slave'} at 127.0.0.1:35252
I20260709 13:19:41.463115 16134 raft_consensus.cc:493] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.463551 16134 raft_consensus.cc:3060] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.467662 16297 consensus_queue.cc:1048] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Connected to new peer: Peer: permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:41.473740 16134 raft_consensus.cc:515] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.476279 16134 leader_election.cc:290] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [CANDIDATE]: Term 2 election: Requested vote from peers 3471e07a98e44052a21d5816bb06b25b (127.6.233.1:34611), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:41.477409 16059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4a1d36ab954a4eaca95b27fddb3a17" candidate_uuid: "a8dfb582871148c7b273b907e7ea1a17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3471e07a98e44052a21d5816bb06b25b"
I20260709 13:19:41.477582 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be4a1d36ab954a4eaca95b27fddb3a17" candidate_uuid: "a8dfb582871148c7b273b907e7ea1a17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
I20260709 13:19:41.478171 16059 raft_consensus.cc:3055] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:41.478590 16059 raft_consensus.cc:740] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Running, Role: LEADER
I20260709 13:19:41.479372 16059 consensus_queue.cc:260] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.480219 16059 raft_consensus.cc:3060] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.486881 16059 raft_consensus.cc:2468] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8dfb582871148c7b273b907e7ea1a17 in term 2.
I20260709 13:19:41.487928 16098 leader_election.cc:304] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3471e07a98e44052a21d5816bb06b25b, a8dfb582871148c7b273b907e7ea1a17; no voters: 27561a4375e5458d8b3ab53e20dc41c5
I20260709 13:19:41.488921 16254 raft_consensus.cc:2804] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:41.489974 16254 raft_consensus.cc:697] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 2 LEADER]: Becoming Leader. State: Replica: a8dfb582871148c7b273b907e7ea1a17, State: Running, Role: LEADER
I20260709 13:19:41.491012 16254 consensus_queue.cc:237] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.497215 15957 catalog_manager.cc:5697] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 reported cstate change: term changed from 1 to 2, leader changed from 3471e07a98e44052a21d5816bb06b25b (127.6.233.1) to a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "a8dfb582871148c7b273b907e7ea1a17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.545979 16289 raft_consensus.cc:993] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5: : Instructing follower 3471e07a98e44052a21d5816bb06b25b to start an election
I20260709 13:19:41.546499 16302 raft_consensus.cc:1081] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 LEADER]: Signalling peer 3471e07a98e44052a21d5816bb06b25b to start an election
I20260709 13:19:41.547910 16059 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f43b7d02be042c386b6428819c45095"
dest_uuid: "3471e07a98e44052a21d5816bb06b25b"
 from {username='slave'} at 127.0.0.1:42694
I20260709 13:19:41.548406 16059 raft_consensus.cc:493] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.548707 16059 raft_consensus.cc:3060] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.553843 16059 raft_consensus.cc:515] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.555603 16059 leader_election.cc:290] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 2 election: Requested vote from peers a8dfb582871148c7b273b907e7ea1a17 (127.6.233.2:42955), 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3:36235)
I20260709 13:19:41.556349 16134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8dfb582871148c7b273b907e7ea1a17"
I20260709 13:19:41.556737 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f43b7d02be042c386b6428819c45095" candidate_uuid: "3471e07a98e44052a21d5816bb06b25b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27561a4375e5458d8b3ab53e20dc41c5"
I20260709 13:19:41.557009 16134 raft_consensus.cc:3060] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.557340 16208 raft_consensus.cc:3055] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:41.557646 16208 raft_consensus.cc:740] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27561a4375e5458d8b3ab53e20dc41c5, State: Running, Role: LEADER
I20260709 13:19:41.558449 16208 consensus_queue.cc:260] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.559546 16208 raft_consensus.cc:3060] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.562829 16134 raft_consensus.cc:2468] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 2.
I20260709 13:19:41.564214 16022 leader_election.cc:304] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3471e07a98e44052a21d5816bb06b25b, a8dfb582871148c7b273b907e7ea1a17; no voters: 
I20260709 13:19:41.565042 16297 raft_consensus.cc:2804] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:41.565434 16297 raft_consensus.cc:697] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 2 LEADER]: Becoming Leader. State: Replica: 3471e07a98e44052a21d5816bb06b25b, State: Running, Role: LEADER
I20260709 13:19:41.565668 16208 raft_consensus.cc:2468] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3471e07a98e44052a21d5816bb06b25b in term 2.
I20260709 13:19:41.566457 16297 consensus_queue.cc:237] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } }
I20260709 13:19:41.572924 15957 catalog_manager.cc:5697] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b reported cstate change: term changed from 1 to 2, leader changed from 27561a4375e5458d8b3ab53e20dc41c5 (127.6.233.3) to 3471e07a98e44052a21d5816bb06b25b (127.6.233.1). New cstate: current_term: 2 leader_uuid: "3471e07a98e44052a21d5816bb06b25b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8dfb582871148c7b273b907e7ea1a17" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 42955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3471e07a98e44052a21d5816bb06b25b" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 34611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27561a4375e5458d8b3ab53e20dc41c5" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 36235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.628536  7076 tablet_server.cc:179] TabletServer@127.6.233.1:0 shutting down...
I20260709 13:19:41.652467  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:41.653179  7076 tablet_replica.cc:333] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b: stopping tablet replica
I20260709 13:19:41.653867  7076 raft_consensus.cc:2243] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.654335  7076 raft_consensus.cc:2272] T be4a1d36ab954a4eaca95b27fddb3a17 P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.657133  7076 tablet_replica.cc:333] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b: stopping tablet replica
I20260709 13:19:41.657689  7076 raft_consensus.cc:2243] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.658519  7076 raft_consensus.cc:2272] T 840f719b9989481c9d03751e412c7a70 P 3471e07a98e44052a21d5816bb06b25b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.661358  7076 tablet_replica.cc:333] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b: stopping tablet replica
I20260709 13:19:41.661816  7076 raft_consensus.cc:2243] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.662340  7076 pending_rounds.cc:70] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b: Trying to abort 1 pending ops.
I20260709 13:19:41.662508  7076 pending_rounds.cc:77] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638631704625152 op_type: NO_OP noop_request { }
I20260709 13:19:41.662743  7076 raft_consensus.cc:2889] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:41.662977  7076 raft_consensus.cc:2272] T 2f43b7d02be042c386b6428819c45095 P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.665644  7076 tablet_replica.cc:333] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b: stopping tablet replica
I20260709 13:19:41.666131  7076 raft_consensus.cc:2243] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.666472  7076 raft_consensus.cc:2272] T 64513640e8a04e20b6ff7ee65462179a P 3471e07a98e44052a21d5816bb06b25b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.684615  7076 tablet_server.cc:196] TabletServer@127.6.233.1:0 shutdown complete.
I20260709 13:19:41.703742  7076 tablet_server.cc:179] TabletServer@127.6.233.2:0 shutting down...
I20260709 13:19:41.726147  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:41.726964  7076 tablet_replica.cc:333] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17: stopping tablet replica
I20260709 13:19:41.727718  7076 raft_consensus.cc:2243] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.728250  7076 raft_consensus.cc:2272] T 840f719b9989481c9d03751e412c7a70 P a8dfb582871148c7b273b907e7ea1a17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.730983  7076 tablet_replica.cc:333] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17: stopping tablet replica
I20260709 13:19:41.731554  7076 raft_consensus.cc:2243] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.732203  7076 pending_rounds.cc:70] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17: Trying to abort 1 pending ops.
I20260709 13:19:41.732406  7076 pending_rounds.cc:77] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638631395287040 op_type: NO_OP noop_request { }
I20260709 13:19:41.732671  7076 raft_consensus.cc:2889] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:41.732931  7076 raft_consensus.cc:2272] T be4a1d36ab954a4eaca95b27fddb3a17 P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.735435  7076 tablet_replica.cc:333] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17: stopping tablet replica
I20260709 13:19:41.736013  7076 raft_consensus.cc:2243] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.736505  7076 raft_consensus.cc:2272] T 64513640e8a04e20b6ff7ee65462179a P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.738657  7076 tablet_replica.cc:333] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17: stopping tablet replica
I20260709 13:19:41.739215  7076 raft_consensus.cc:2243] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.739667  7076 raft_consensus.cc:2272] T 2f43b7d02be042c386b6428819c45095 P a8dfb582871148c7b273b907e7ea1a17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.754010  7076 tablet_server.cc:196] TabletServer@127.6.233.2:0 shutdown complete.
I20260709 13:19:41.770381  7076 tablet_server.cc:179] TabletServer@127.6.233.3:0 shutting down...
I20260709 13:19:41.791524  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:41.792344  7076 tablet_replica.cc:333] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5: stopping tablet replica
I20260709 13:19:41.793041  7076 raft_consensus.cc:2243] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.793545  7076 raft_consensus.cc:2272] T 840f719b9989481c9d03751e412c7a70 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.796180  7076 tablet_replica.cc:333] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5: stopping tablet replica
I20260709 13:19:41.796674  7076 raft_consensus.cc:2243] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.797103  7076 raft_consensus.cc:2272] T be4a1d36ab954a4eaca95b27fddb3a17 P 27561a4375e5458d8b3ab53e20dc41c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.799939  7076 tablet_replica.cc:333] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5: stopping tablet replica
I20260709 13:19:41.800518  7076 raft_consensus.cc:2243] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.800899  7076 raft_consensus.cc:2272] T 2f43b7d02be042c386b6428819c45095 P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.803378  7076 tablet_replica.cc:333] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5: stopping tablet replica
I20260709 13:19:41.803875  7076 raft_consensus.cc:2243] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.804492  7076 pending_rounds.cc:70] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5: Trying to abort 1 pending ops.
I20260709 13:19:41.804682  7076 pending_rounds.cc:77] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638630642425856 op_type: NO_OP noop_request { }
I20260709 13:19:41.804950  7076 raft_consensus.cc:2889] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:41.805224  7076 raft_consensus.cc:2272] T 64513640e8a04e20b6ff7ee65462179a P 27561a4375e5458d8b3ab53e20dc41c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.829370  7076 tablet_server.cc:196] TabletServer@127.6.233.3:0 shutdown complete.
I20260709 13:19:41.845721  7076 master.cc:562] Master@127.6.233.62:41357 shutting down...
I20260709 13:19:41.864889  7076 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.865474  7076 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.865832  7076 tablet_replica.cc:333] T 00000000000000000000000000000000 P 33759c72fe2745518e96e0debae75986: stopping tablet replica
I20260709 13:19:41.885522  7076 master.cc:584] Master@127.6.233.62:41357 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2472 ms)
[----------] 6 tests from LeaderRebalancerTest (269400 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:19:41.923120  7076 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.233.62:33387
I20260709 13:19:41.924263  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:41.929657 16304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.929795 16303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:41.930698 16306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:41.931877  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:41.932741  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:41.932948  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:41.933115  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603181933098 us; error 0 us; skew 500 ppm
I20260709 13:19:41.933650  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:41.935933  7076 webserver.cc:533] Webserver started at http://127.6.233.62:46651/ using document root <none> and password file <none>
I20260709 13:19:41.936477  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:41.936694  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:41.936973  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:41.938095  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/master-0-root/instance:
uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-sjgx"
I20260709 13:19:41.942735  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:19:41.946043 16311 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:41.946887  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:41.947124  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/master-0-root
uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac"
format_stamp: "Formatted at 2026-07-09 13:19:41 on dist-test-slave-sjgx"
I20260709 13:19:41.947351  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:41.982795  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:41.983970  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:42.021152  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.62:33387
I20260709 13:19:42.021271 16362 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.62:33387 every 8 connection(s)
I20260709 13:19:42.025036 16363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.036329 16363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac: Bootstrap starting.
I20260709 13:19:42.041203 16363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.045380 16363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac: No bootstrap required, opened a new log
I20260709 13:19:42.047446 16363 raft_consensus.cc:359] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac" member_type: VOTER }
I20260709 13:19:42.047799 16363 raft_consensus.cc:385] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.047988 16363 raft_consensus.cc:740] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a31e3d6e3c4648b7a2490f70b8b9ac, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.048571 16363 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac" member_type: VOTER }
I20260709 13:19:42.049002 16363 raft_consensus.cc:399] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:42.049258 16363 raft_consensus.cc:493] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:42.049566 16363 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:42.054292 16363 raft_consensus.cc:515] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac" member_type: VOTER }
I20260709 13:19:42.054796 16363 leader_election.cc:304] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3a31e3d6e3c4648b7a2490f70b8b9ac; no voters: 
I20260709 13:19:42.055933 16363 leader_election.cc:290] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:42.056396 16366 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:42.057765 16366 raft_consensus.cc:697] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 1 LEADER]: Becoming Leader. State: Replica: c3a31e3d6e3c4648b7a2490f70b8b9ac, State: Running, Role: LEADER
I20260709 13:19:42.058416 16366 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac" member_type: VOTER }
I20260709 13:19:42.058920 16363 sys_catalog.cc:565] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:42.061460 16367 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac" member_type: VOTER } }
I20260709 13:19:42.061518 16368 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3a31e3d6e3c4648b7a2490f70b8b9ac. Latest consensus state: current_term: 1 leader_uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a31e3d6e3c4648b7a2490f70b8b9ac" member_type: VOTER } }
I20260709 13:19:42.062186 16367 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:42.062282 16368 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:42.064695 16371 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:42.069658 16371 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:42.078750  7076 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:42.079523 16371 catalog_manager.cc:1383] Generated new cluster ID: a02cbfd44e6f4d6da86749d3fb22b338
I20260709 13:19:42.079763 16371 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:42.105278 16371 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:42.106544 16371 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:42.127419 16371 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac: Generated new TSK 0
I20260709 13:19:42.128000 16371 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:42.145056  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:42.150799 16384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:42.152077 16385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:42.153723 16387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:42.153797  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:42.154986  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:42.155174  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:42.155407  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603182155364 us; error 0 us; skew 500 ppm
I20260709 13:19:42.155941  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:42.158226  7076 webserver.cc:533] Webserver started at http://127.6.233.1:35525/ using document root <none> and password file <none>
I20260709 13:19:42.158691  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:42.158882  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:42.159157  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:42.160595  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-0-root/instance:
uuid: "87aff7c64559468cb088f4c29879fd03"
format_stamp: "Formatted at 2026-07-09 13:19:42 on dist-test-slave-sjgx"
I20260709 13:19:42.164943  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:19:42.168211 16392 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.168948  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:19:42.169245  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "87aff7c64559468cb088f4c29879fd03"
format_stamp: "Formatted at 2026-07-09 13:19:42 on dist-test-slave-sjgx"
I20260709 13:19:42.169548  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:42.196981  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:42.198190  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:42.199606  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:42.201812  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:42.202028  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.202260  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:42.202445  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.241623  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:44519
I20260709 13:19:42.241719 16454 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:44519 every 8 connection(s)
I20260709 13:19:42.246855  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:42.253804 16459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:42.256448 16460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:42.257526  7076 server_base.cc:1061] running on GCE node
W20260709 13:19:42.257882 16462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:42.258863  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:42.259099  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:42.259233  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603182259221 us; error 0 us; skew 500 ppm
I20260709 13:19:42.259677  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:42.262007  7076 webserver.cc:533] Webserver started at http://127.6.233.2:34383/ using document root <none> and password file <none>
I20260709 13:19:42.262462  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:42.262658  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:42.262924  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:42.264277  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-1-root/instance:
uuid: "9e8c173367184ea7b1698afd85c61e05"
format_stamp: "Formatted at 2026-07-09 13:19:42 on dist-test-slave-sjgx"
I20260709 13:19:42.267236 16455 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33387
I20260709 13:19:42.267652 16455 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:42.268447 16455 heartbeater.cc:507] Master 127.6.233.62:33387 requested a full tablet report, sending...
I20260709 13:19:42.269641  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:42.271008 16328 ts_manager.cc:194] Registered new tserver with Master: 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519)
I20260709 13:19:42.273564 16328 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37184
I20260709 13:19:42.274341 16467 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.275223  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:42.275525  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-1-root
uuid: "9e8c173367184ea7b1698afd85c61e05"
format_stamp: "Formatted at 2026-07-09 13:19:42 on dist-test-slave-sjgx"
I20260709 13:19:42.275807  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:42.298491  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:42.300289  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:42.302330  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:42.305271  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:42.305488  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.305745  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:42.305917  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.344856  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.2:35425
I20260709 13:19:42.344971 16529 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.2:35425 every 8 connection(s)
I20260709 13:19:42.349773  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:42.356235 16533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:42.358201 16534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:42.361202 16536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:42.362782 16530 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33387
I20260709 13:19:42.363193 16530 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:42.363399  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:42.363997 16530 heartbeater.cc:507] Master 127.6.233.62:33387 requested a full tablet report, sending...
I20260709 13:19:42.364424  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:42.364681  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:42.364857  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603182364822 us; error 0 us; skew 500 ppm
I20260709 13:19:42.365485  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:42.366191 16328 ts_manager.cc:194] Registered new tserver with Master: 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:42.368630 16328 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37192
I20260709 13:19:42.373435  7076 webserver.cc:533] Webserver started at http://127.6.233.3:42561/ using document root <none> and password file <none>
I20260709 13:19:42.374154  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:42.374406  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:42.374745  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:42.376464  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-2-root/instance:
uuid: "742221ecccc942679fec78c444bd37e1"
format_stamp: "Formatted at 2026-07-09 13:19:42 on dist-test-slave-sjgx"
I20260709 13:19:42.381086  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:19:42.384327 16541 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.385062  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:19:42.385358  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-2-root
uuid: "742221ecccc942679fec78c444bd37e1"
format_stamp: "Formatted at 2026-07-09 13:19:42 on dist-test-slave-sjgx"
I20260709 13:19:42.385643  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602912355568-7076-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:42.404790  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:42.405893  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:42.407310  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:42.409415  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:42.409636  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.409875  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:42.410053  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:42.448511  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.3:42185
I20260709 13:19:42.448573 16603 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.3:42185 every 8 connection(s)
I20260709 13:19:42.461921 16604 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33387
I20260709 13:19:42.462373 16604 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:42.463109 16604 heartbeater.cc:507] Master 127.6.233.62:33387 requested a full tablet report, sending...
I20260709 13:19:42.465029 16328 ts_manager.cc:194] Registered new tserver with Master: 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:42.466037  7076 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014355363s
I20260709 13:19:42.466557 16328 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37196
I20260709 13:19:42.491535 16328 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37210:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:42.494192 16328 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:42.580863 16569 tablet_service.cc:1511] Processing CreateTablet for tablet 03c2f3123aef411091662c5ca1e98198 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:42.581017 16495 tablet_service.cc:1511] Processing CreateTablet for tablet 03c2f3123aef411091662c5ca1e98198 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:42.582378 16569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c2f3123aef411091662c5ca1e98198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.582489 16495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c2f3123aef411091662c5ca1e98198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.585134 16494 tablet_service.cc:1511] Processing CreateTablet for tablet a888ed69ad9942d2a6168187b1174fc0 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:42.587100 16494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a888ed69ad9942d2a6168187b1174fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.589111 16566 tablet_service.cc:1511] Processing CreateTablet for tablet 65aaa692131c4282ae5c2c3b51f14beb (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:42.589526 16493 tablet_service.cc:1511] Processing CreateTablet for tablet c4c2dad9468a4c9a92b4cedbfe0bbd19 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:42.590508 16566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65aaa692131c4282ae5c2c3b51f14beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.591389 16493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c2dad9468a4c9a92b4cedbfe0bbd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.592947 16565 tablet_service.cc:1511] Processing CreateTablet for tablet d08ca935d16d40baaf79a555a2d5d42f (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:42.593678 16492 tablet_service.cc:1511] Processing CreateTablet for tablet 65aaa692131c4282ae5c2c3b51f14beb (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:42.594698 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08ca935d16d40baaf79a555a2d5d42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.595494 16492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65aaa692131c4282ae5c2c3b51f14beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.597227 16564 tablet_service.cc:1511] Processing CreateTablet for tablet 16817d31c62c4d53b383f07629c93e9f (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:42.597954 16491 tablet_service.cc:1511] Processing CreateTablet for tablet d08ca935d16d40baaf79a555a2d5d42f (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:42.598922 16564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16817d31c62c4d53b383f07629c93e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.599751 16491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08ca935d16d40baaf79a555a2d5d42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.587570 16567 tablet_service.cc:1511] Processing CreateTablet for tablet c4c2dad9468a4c9a92b4cedbfe0bbd19 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:42.610031 16567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c2dad9468a4c9a92b4cedbfe0bbd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.601498 16490 tablet_service.cc:1511] Processing CreateTablet for tablet 16817d31c62c4d53b383f07629c93e9f (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:42.612161 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16817d31c62c4d53b383f07629c93e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.603870 16489 tablet_service.cc:1511] Processing CreateTablet for tablet 6b676a86e4df4581bac06bd86420bba7 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:42.614312 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b676a86e4df4581bac06bd86420bba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.585261 16568 tablet_service.cc:1511] Processing CreateTablet for tablet a888ed69ad9942d2a6168187b1174fc0 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:42.615367 16563 tablet_service.cc:1511] Processing CreateTablet for tablet 6b676a86e4df4581bac06bd86420bba7 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:42.616405 16568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a888ed69ad9942d2a6168187b1174fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.617318 16563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b676a86e4df4581bac06bd86420bba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.607084 16488 tablet_service.cc:1511] Processing CreateTablet for tablet dffdb1ea0cf34c5ebdd175d6603b1f43 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:42.619300 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffdb1ea0cf34c5ebdd175d6603b1f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.623525 16487 tablet_service.cc:1511] Processing CreateTablet for tablet 720a2c41e70f48b9ba720b3257692eef (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:42.625032 16487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720a2c41e70f48b9ba720b3257692eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.628641 16420 tablet_service.cc:1511] Processing CreateTablet for tablet 03c2f3123aef411091662c5ca1e98198 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:42.630374 16420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c2f3123aef411091662c5ca1e98198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.639705 16419 tablet_service.cc:1511] Processing CreateTablet for tablet a888ed69ad9942d2a6168187b1174fc0 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:42.641113 16419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a888ed69ad9942d2a6168187b1174fc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.647794 16418 tablet_service.cc:1511] Processing CreateTablet for tablet c4c2dad9468a4c9a92b4cedbfe0bbd19 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:42.649297 16418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4c2dad9468a4c9a92b4cedbfe0bbd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.650987 16417 tablet_service.cc:1511] Processing CreateTablet for tablet 65aaa692131c4282ae5c2c3b51f14beb (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:42.653522 16416 tablet_service.cc:1511] Processing CreateTablet for tablet d08ca935d16d40baaf79a555a2d5d42f (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:42.656071 16415 tablet_service.cc:1511] Processing CreateTablet for tablet 16817d31c62c4d53b383f07629c93e9f (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:42.658505 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65aaa692131c4282ae5c2c3b51f14beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.663669 16415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16817d31c62c4d53b383f07629c93e9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.670521 16416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08ca935d16d40baaf79a555a2d5d42f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.697014 16414 tablet_service.cc:1511] Processing CreateTablet for tablet 6b676a86e4df4581bac06bd86420bba7 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:42.698591 16414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b676a86e4df4581bac06bd86420bba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.701160 16413 tablet_service.cc:1511] Processing CreateTablet for tablet dffdb1ea0cf34c5ebdd175d6603b1f43 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:42.702570 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffdb1ea0cf34c5ebdd175d6603b1f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.705307 16412 tablet_service.cc:1511] Processing CreateTablet for tablet 720a2c41e70f48b9ba720b3257692eef (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:42.706642 16412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720a2c41e70f48b9ba720b3257692eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.733606 16562 tablet_service.cc:1511] Processing CreateTablet for tablet dffdb1ea0cf34c5ebdd175d6603b1f43 (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:42.735078 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffdb1ea0cf34c5ebdd175d6603b1f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.786222 16566 tablet_service.cc:1511] Processing CreateTablet for tablet 720a2c41e70f48b9ba720b3257692eef (DEFAULT_TABLE table=test-workload [id=6c6b83871ae7493da908973f9cdf52e0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:42.787809 16566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720a2c41e70f48b9ba720b3257692eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:42.790443 16619 tablet_bootstrap.cc:492] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:42.797554 16619 tablet_bootstrap.cc:654] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.805106 16620 tablet_bootstrap.cc:492] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:42.819480 16621 tablet_bootstrap.cc:492] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:42.825177 16621 tablet_bootstrap.cc:654] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.851861 16619 tablet_bootstrap.cc:492] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:42.853587 16619 ts_tablet_manager.cc:1403] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.007s
I20260709 13:19:42.857586 16621 tablet_bootstrap.cc:492] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:42.858124 16621 ts_tablet_manager.cc:1403] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.015s
I20260709 13:19:42.857225 16619 raft_consensus.cc:359] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.858925 16619 raft_consensus.cc:385] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.859289 16619 raft_consensus.cc:740] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.860253 16619 consensus_queue.cc:260] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.861334 16621 raft_consensus.cc:359] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.862234 16621 raft_consensus.cc:385] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.862573 16621 raft_consensus.cc:740] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.863415 16621 consensus_queue.cc:260] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.886562 16619 ts_tablet_manager.cc:1434] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.032s	user 0.017s	sys 0.012s
I20260709 13:19:42.886713 16620 tablet_bootstrap.cc:654] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.886929 16604 heartbeater.cc:499] Master 127.6.233.62:33387 was elected leader, sending a full tablet report...
I20260709 13:19:42.887480 16621 ts_tablet_manager.cc:1434] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.029s	user 0.021s	sys 0.009s
I20260709 13:19:42.888490 16621 tablet_bootstrap.cc:492] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:42.894824 16621 tablet_bootstrap.cc:654] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.896734 16619 tablet_bootstrap.cc:492] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:42.897722 16620 tablet_bootstrap.cc:492] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:42.898248 16620 ts_tablet_manager.cc:1403] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.007s
I20260709 13:19:42.901340 16620 raft_consensus.cc:359] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:42.902058 16620 raft_consensus.cc:385] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.902336 16620 raft_consensus.cc:740] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.895871 16530 heartbeater.cc:499] Master 127.6.233.62:33387 was elected leader, sending a full tablet report...
I20260709 13:19:42.903060 16620 consensus_queue.cc:260] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:42.906414 16621 tablet_bootstrap.cc:492] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:42.906910 16621 ts_tablet_manager.cc:1403] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:19:42.909507 16619 tablet_bootstrap.cc:654] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.909817 16621 raft_consensus.cc:359] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.910389 16625 raft_consensus.cc:493] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.910679 16621 raft_consensus.cc:385] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.911029 16621 raft_consensus.cc:740] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.910873 16625 raft_consensus.cc:515] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.911912 16621 consensus_queue.cc:260] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.921175 16621 ts_tablet_manager.cc:1434] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.014s	user 0.014s	sys 0.001s
I20260709 13:19:42.922178 16621 tablet_bootstrap.cc:492] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:42.922945 16619 tablet_bootstrap.cc:492] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:42.923677 16619 ts_tablet_manager.cc:1403] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.006s
I20260709 13:19:42.927688 16619 raft_consensus.cc:359] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:42.928663 16621 tablet_bootstrap.cc:654] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.928758 16619 raft_consensus.cc:385] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.931878 16625 leader_election.cc:290] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:42.932353 16619 raft_consensus.cc:740] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.933190 16619 consensus_queue.cc:260] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:42.935343 16619 ts_tablet_manager.cc:1434] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:19:42.936358 16619 tablet_bootstrap.cc:492] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:42.939291 16455 heartbeater.cc:499] Master 127.6.233.62:33387 was elected leader, sending a full tablet report...
I20260709 13:19:42.940261 16620 ts_tablet_manager.cc:1434] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.035s
I20260709 13:19:42.941272 16620 tablet_bootstrap.cc:492] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:42.942829 16619 tablet_bootstrap.cc:654] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.947960 16620 tablet_bootstrap.cc:654] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.955109 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
W20260709 13:19:42.957412 16544 leader_election.cc:343] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.963852 16621 tablet_bootstrap.cc:492] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:42.964623 16621 ts_tablet_manager.cc:1403] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.016s
I20260709 13:19:42.974647 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:42.973757 16621 raft_consensus.cc:359] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.976599 16621 raft_consensus.cc:385] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.977237 16621 raft_consensus.cc:740] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
W20260709 13:19:42.977656 16543 leader_election.cc:343] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:42.978204 16543 leader_election.cc:304] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 742221ecccc942679fec78c444bd37e1; no voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:42.978250 16621 consensus_queue.cc:260] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.979347 16625 raft_consensus.cc:2749] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:42.980870 16621 ts_tablet_manager.cc:1434] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:19:42.982136 16621 tablet_bootstrap.cc:492] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:42.985649 16620 tablet_bootstrap.cc:492] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:42.985669 16619 tablet_bootstrap.cc:492] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:42.986274 16620 ts_tablet_manager.cc:1403] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.028s
I20260709 13:19:42.986614 16619 ts_tablet_manager.cc:1403] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.014s
I20260709 13:19:42.989929 16619 raft_consensus.cc:359] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.990742 16619 raft_consensus.cc:385] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.990471 16620 raft_consensus.cc:359] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.991122 16619 raft_consensus.cc:740] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.991281 16620 raft_consensus.cc:385] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:42.991557 16621 tablet_bootstrap.cc:654] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:42.991703 16620 raft_consensus.cc:740] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:42.992305 16619 consensus_queue.cc:260] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.992794 16620 consensus_queue.cc:260] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:42.995023 16619 ts_tablet_manager.cc:1434] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:19:42.995100 16620 ts_tablet_manager.cc:1434] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:42.996222 16620 tablet_bootstrap.cc:492] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:42.996222 16619 tablet_bootstrap.cc:492] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:43.003387 16620 tablet_bootstrap.cc:654] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.003387 16619 tablet_bootstrap.cc:654] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.013229 16619 tablet_bootstrap.cc:492] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:43.014014 16619 ts_tablet_manager.cc:1403] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:19:43.018175 16619 raft_consensus.cc:359] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.020210 16619 raft_consensus.cc:385] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.020603 16619 raft_consensus.cc:740] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.021566 16619 consensus_queue.cc:260] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.022118 16620 tablet_bootstrap.cc:492] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:43.022730 16620 ts_tablet_manager.cc:1403] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 13:19:43.024312 16619 ts_tablet_manager.cc:1434] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:19:43.025498 16619 tablet_bootstrap.cc:492] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:43.025964 16620 raft_consensus.cc:359] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.026824 16620 raft_consensus.cc:385] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.027154 16620 raft_consensus.cc:740] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.028121 16620 consensus_queue.cc:260] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.030440 16620 ts_tablet_manager.cc:1434] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:43.031628 16620 tablet_bootstrap.cc:492] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:43.045022 16620 tablet_bootstrap.cc:654] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.045670 16619 tablet_bootstrap.cc:654] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.047709 16621 tablet_bootstrap.cc:492] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:43.048588 16621 ts_tablet_manager.cc:1403] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.043s
I20260709 13:19:43.051285 16620 tablet_bootstrap.cc:492] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:43.051891 16620 ts_tablet_manager.cc:1403] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.005s
I20260709 13:19:43.051528 16621 raft_consensus.cc:359] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.052150 16619 tablet_bootstrap.cc:492] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:43.052343 16621 raft_consensus.cc:385] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.052810 16619 ts_tablet_manager.cc:1403] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.003s
I20260709 13:19:43.052783 16621 raft_consensus.cc:740] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.053761 16621 consensus_queue.cc:260] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.055044 16620 raft_consensus.cc:359] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.055760 16620 raft_consensus.cc:385] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.056083 16620 raft_consensus.cc:740] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.056473 16621 ts_tablet_manager.cc:1434] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:43.055909 16619 raft_consensus.cc:359] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.056943 16619 raft_consensus.cc:385] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.057296 16619 raft_consensus.cc:740] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.057132 16620 consensus_queue.cc:260] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.057693 16624 raft_consensus.cc:493] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.058175 16624 raft_consensus.cc:515] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.058337 16619 consensus_queue.cc:260] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.062427 16620 ts_tablet_manager.cc:1434] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:43.063555 16620 tablet_bootstrap.cc:492] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:43.060732 16624 leader_election.cc:290] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.069077 16621 tablet_bootstrap.cc:492] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:43.072608 16620 tablet_bootstrap.cc:654] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:43.073868 16376 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:43.086207 16620 tablet_bootstrap.cc:492] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:43.087015 16620 ts_tablet_manager.cc:1403] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:19:43.091065 16620 raft_consensus.cc:359] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.091878 16620 raft_consensus.cc:385] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.092248 16620 raft_consensus.cc:740] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.093152 16620 consensus_queue.cc:260] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.095922 16621 tablet_bootstrap.cc:654] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.096997 16619 ts_tablet_manager.cc:1434] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.044s	user 0.023s	sys 0.020s
I20260709 13:19:43.097438 16620 ts_tablet_manager.cc:1434] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:19:43.098531 16620 tablet_bootstrap.cc:492] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:43.105346 16619 tablet_bootstrap.cc:492] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:43.107654 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720a2c41e70f48b9ba720b3257692eef" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:43.108405 16430 raft_consensus.cc:2468] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 0.
I20260709 13:19:43.109827 16469 leader_election.cc:304] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.112195 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720a2c41e70f48b9ba720b3257692eef" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
W20260709 13:19:43.114001 16469 leader_election.cc:343] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.115625 16620 tablet_bootstrap.cc:654] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.115860 16640 raft_consensus.cc:2804] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.116485 16619 tablet_bootstrap.cc:654] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.116540 16640 raft_consensus.cc:493] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.117270 16640 raft_consensus.cc:3060] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.122493 16621 tablet_bootstrap.cc:492] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:43.123308 16621 ts_tablet_manager.cc:1403] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.066s	user 0.021s	sys 0.000s
I20260709 13:19:43.127331 16621 raft_consensus.cc:359] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:43.128180 16621 raft_consensus.cc:385] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.128476 16621 raft_consensus.cc:740] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.128705 16640 raft_consensus.cc:515] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.129365 16621 consensus_queue.cc:260] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:43.130362 16620 tablet_bootstrap.cc:492] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:43.130892 16620 ts_tablet_manager.cc:1403] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.002s
I20260709 13:19:43.132472 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720a2c41e70f48b9ba720b3257692eef" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:43.132808 16619 tablet_bootstrap.cc:492] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:43.133149 16430 raft_consensus.cc:3060] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.133558 16619 ts_tablet_manager.cc:1403] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.011s
I20260709 13:19:43.133926 16620 raft_consensus.cc:359] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.134642 16620 raft_consensus.cc:385] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.134935 16620 raft_consensus.cc:740] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.135828 16620 consensus_queue.cc:260] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.137332 16619 raft_consensus.cc:359] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.138203 16619 raft_consensus.cc:385] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.138582 16619 raft_consensus.cc:740] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.139281 16621 ts_tablet_manager.cc:1434] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:19:43.140538 16620 ts_tablet_manager.cc:1434] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:19:43.141592 16620 tablet_bootstrap.cc:492] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:43.142786 16621 tablet_bootstrap.cc:492] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:43.144289 16619 consensus_queue.cc:260] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.149943 16621 tablet_bootstrap.cc:654] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.152271 16620 tablet_bootstrap.cc:654] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.153685 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720a2c41e70f48b9ba720b3257692eef" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
W20260709 13:19:43.155272 16469 leader_election.cc:343] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.156030 16640 leader_election.cc:290] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.141619 16430 raft_consensus.cc:2468] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 1.
I20260709 13:19:43.157292 16619 ts_tablet_manager.cc:1434] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:19:43.157996 16469 leader_election.cc:304] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:43.158492 16619 tablet_bootstrap.cc:492] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:43.159257 16624 raft_consensus.cc:2804] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.168401 16624 raft_consensus.cc:697] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:43.170220 16624 consensus_queue.cc:237] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.172116 16619 tablet_bootstrap.cc:654] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.173280 16621 tablet_bootstrap.cc:492] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:43.174146 16621 ts_tablet_manager.cc:1403] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.019s
I20260709 13:19:43.178054 16620 tablet_bootstrap.cc:492] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:43.178618 16620 ts_tablet_manager.cc:1403] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.037s	user 0.002s	sys 0.028s
I20260709 13:19:43.178529 16621 raft_consensus.cc:359] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.179754 16621 raft_consensus.cc:385] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.180153 16621 raft_consensus.cc:740] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.181339 16621 consensus_queue.cc:260] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.183171 16620 raft_consensus.cc:359] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.183823 16620 raft_consensus.cc:385] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.184172 16620 raft_consensus.cc:740] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.185547 16619 tablet_bootstrap.cc:492] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:43.186189 16619 ts_tablet_manager.cc:1403] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260709 13:19:43.185097 16620 consensus_queue.cc:260] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.189253 16620 ts_tablet_manager.cc:1434] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:19:43.191974 16619 raft_consensus.cc:359] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.192955 16620 tablet_bootstrap.cc:492] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:43.189855 16624 raft_consensus.cc:493] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.193696 16624 raft_consensus.cc:515] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:43.196466 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c2f3123aef411091662c5ca1e98198" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:43.195910 16325 catalog_manager.cc:5697] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.197191 16579 raft_consensus.cc:2468] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 0.
I20260709 13:19:43.198508 16469 leader_election.cc:304] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.192938 16619 raft_consensus.cc:385] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.191349 16621 ts_tablet_manager.cc:1434] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:19:43.200922 16621 tablet_bootstrap.cc:492] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:43.200919 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c2f3123aef411091662c5ca1e98198" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:43.201517 16649 raft_consensus.cc:2804] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.201812 16430 raft_consensus.cc:2468] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 0.
I20260709 13:19:43.202013 16649 raft_consensus.cc:493] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.202286 16620 tablet_bootstrap.cc:654] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.202472 16649 raft_consensus.cc:3060] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.203691 16628 raft_consensus.cc:493] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.204210 16628 raft_consensus.cc:515] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.210960 16628 leader_election.cc:290] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.211275 16621 tablet_bootstrap.cc:654] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.211467 16619 raft_consensus.cc:740] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.216034 16624 leader_election.cc:290] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185), 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519)
I20260709 13:19:43.216785 16619 consensus_queue.cc:260] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.219642 16625 raft_consensus.cc:493] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.220250 16625 raft_consensus.cc:515] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.222028 16619 ts_tablet_manager.cc:1434] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.004s
I20260709 13:19:43.224494 16619 tablet_bootstrap.cc:492] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:43.224784 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:43.229231 16629 raft_consensus.cc:493] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.229794 16629 raft_consensus.cc:515] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
W20260709 13:19:43.230470 16543 leader_election.cc:343] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.225617 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.222961 16625 leader_election.cc:290] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
W20260709 13:19:43.232766 16544 leader_election.cc:343] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.233428 16544 leader_election.cc:304] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 742221ecccc942679fec78c444bd37e1; no voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:43.236433 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
W20260709 13:19:43.238333 16543 leader_election.cc:343] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.239120 16625 raft_consensus.cc:2749] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.240245 16629 leader_election.cc:290] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:43.241670 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.242522 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.243515 16504 raft_consensus.cc:2468] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:43.242537 16505 raft_consensus.cc:2468] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:43.245880 16544 leader_election.cc:304] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:43.246361 16395 leader_election.cc:304] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.247596 16628 raft_consensus.cc:2804] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.248158 16628 raft_consensus.cc:493] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.248593 16628 raft_consensus.cc:3060] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.247315 16629 raft_consensus.cc:2804] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.251471 16629 raft_consensus.cc:493] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.251948 16629 raft_consensus.cc:3060] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.257783 16619 tablet_bootstrap.cc:654] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.260500 16625 raft_consensus.cc:493] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.263890 16625 raft_consensus.cc:515] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.266359 16625 leader_election.cc:290] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:43.259410 16628 raft_consensus.cc:515] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.267169 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b676a86e4df4581bac06bd86420bba7" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:43.268024 16430 raft_consensus.cc:2468] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:43.269763 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.270617 16504 raft_consensus.cc:3060] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.271325 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b676a86e4df4581bac06bd86420bba7" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.272254 16505 raft_consensus.cc:2468] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:43.269601 16543 leader_election.cc:304] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:43.274855 16625 raft_consensus.cc:2804] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.275354 16625 raft_consensus.cc:493] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.275790 16625 raft_consensus.cc:3060] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.261987 16649 raft_consensus.cc:515] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:43.287385 16504 raft_consensus.cc:2468] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:43.288934 16619 tablet_bootstrap.cc:492] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:43.290326 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c2f3123aef411091662c5ca1e98198" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.291200 16579 raft_consensus.cc:3060] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.291712 16619 ts_tablet_manager.cc:1403] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.002s
I20260709 13:19:43.294270 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.296701 16578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:43.298349 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c2f3123aef411091662c5ca1e98198" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
W20260709 13:19:43.298663 16394 leader_election.cc:343] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.299206 16430 raft_consensus.cc:3060] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.300485 16619 raft_consensus.cc:359] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.301371 16619 raft_consensus.cc:385] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.301703 16619 raft_consensus.cc:740] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.302640 16619 consensus_queue.cc:260] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.305922 16619 ts_tablet_manager.cc:1434] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:19:43.306824 16621 tablet_bootstrap.cc:492] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:43.307065 16619 tablet_bootstrap.cc:492] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:43.307478 16621 ts_tablet_manager.cc:1403] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.025s
I20260709 13:19:43.286430 16628 leader_election.cc:290] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.288829 16649 leader_election.cc:290] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Requested vote from peers 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185), 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519)
W20260709 13:19:43.309253 16394 leader_election.cc:343] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.314463 16619 tablet_bootstrap.cc:654] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.314463 16625 raft_consensus.cc:515] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.303790 16629 raft_consensus.cc:515] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.316295 16430 raft_consensus.cc:2468] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 1.
I20260709 13:19:43.320780 16395 leader_election.cc:304] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:43.311560 16621 raft_consensus.cc:359] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.321666 16621 raft_consensus.cc:385] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.322001 16621 raft_consensus.cc:740] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.322853 16621 consensus_queue.cc:260] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.323421 16469 leader_election.cc:304] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.324698 16628 raft_consensus.cc:2804] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.325006 16629 leader_election.cc:290] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:43.325764 16649 raft_consensus.cc:2804] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.326960 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.327309 16649 raft_consensus.cc:697] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:43.327593 16504 raft_consensus.cc:3060] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.328243 16649 consensus_queue.cc:237] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:43.332371 16579 raft_consensus.cc:2468] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 1.
I20260709 13:19:43.333318 16625 leader_election.cc:290] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:43.335217 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b676a86e4df4581bac06bd86420bba7" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:43.337473 16429 raft_consensus.cc:3060] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.337920 16620 tablet_bootstrap.cc:492] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:43.338413 16620 ts_tablet_manager.cc:1403] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.146s	user 0.073s	sys 0.056s
I20260709 13:19:43.342482 16504 raft_consensus.cc:2468] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
I20260709 13:19:43.343182 16621 ts_tablet_manager.cc:1434] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 13:19:43.345079 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:43.346321 16620 raft_consensus.cc:359] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
W20260709 13:19:43.346920 16543 leader_election.cc:343] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:43.347097 16620 raft_consensus.cc:385] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.347487 16620 raft_consensus.cc:740] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.348294 16620 consensus_queue.cc:260] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.350226 16629 raft_consensus.cc:493] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.350493 16621 tablet_bootstrap.cc:492] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:43.350804 16629 raft_consensus.cc:515] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.353226 16629 leader_election.cc:290] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:43.355149 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b676a86e4df4581bac06bd86420bba7" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.357363 16628 raft_consensus.cc:697] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:43.356621 16504 raft_consensus.cc:3060] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.359908 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c2dad9468a4c9a92b4cedbfe0bbd19" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:43.357446 16544 leader_election.cc:304] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:43.360689 16430 raft_consensus.cc:2468] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:43.361690 16619 tablet_bootstrap.cc:492] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:43.362195 16619 ts_tablet_manager.cc:1403] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.008s
I20260709 13:19:43.362095 16543 leader_election.cc:304] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:43.363158 16629 raft_consensus.cc:2804] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.363801 16629 raft_consensus.cc:697] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:43.363937 16625 raft_consensus.cc:2804] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.364441 16625 raft_consensus.cc:493] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.364853 16625 raft_consensus.cc:3060] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.364655 16629 consensus_queue.cc:237] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.365192 16619 raft_consensus.cc:359] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.365854 16619 raft_consensus.cc:385] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.366120 16619 raft_consensus.cc:740] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.366787 16619 consensus_queue.cc:260] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.363986 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c2dad9468a4c9a92b4cedbfe0bbd19" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.358954 16628 consensus_queue.cc:237] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.368294 16505 raft_consensus.cc:2468] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:43.372139 16504 raft_consensus.cc:2468] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
I20260709 13:19:43.376760 16544 leader_election.cc:304] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.379354 16661 raft_consensus.cc:2804] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.379447 16429 raft_consensus.cc:2468] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
I20260709 13:19:43.379978 16620 ts_tablet_manager.cc:1434] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.007s
I20260709 13:19:43.380141 16625 raft_consensus.cc:515] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.381606 16661 raft_consensus.cc:697] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:43.382599 16661 consensus_queue.cc:237] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.384151 16620 tablet_bootstrap.cc:492] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:43.380955 16619 ts_tablet_manager.cc:1434] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:19:43.388918 16625 leader_election.cc:290] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:43.384466 16624 raft_consensus.cc:493] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.394579 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c2dad9468a4c9a92b4cedbfe0bbd19" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.395249 16504 raft_consensus.cc:3060] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.396901 16624 raft_consensus.cc:515] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.399230 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c2dad9468a4c9a92b4cedbfe0bbd19" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:43.399910 16429 raft_consensus.cc:3060] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.400609 16624 leader_election.cc:290] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.399962 16325 catalog_manager.cc:5697] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.407027 16620 tablet_bootstrap.cc:654] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.408464 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:43.409739 16504 raft_consensus.cc:2468] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
I20260709 13:19:43.410521 16430 raft_consensus.cc:2468] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 0.
I20260709 13:19:43.411195 16621 tablet_bootstrap.cc:654] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.404371 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:43.412678 16469 leader_election.cc:304] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.412671 16579 raft_consensus.cc:2468] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 0.
I20260709 13:19:43.413440 16649 raft_consensus.cc:2804] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.413798 16649 raft_consensus.cc:493] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.414747 16649 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.415730 16429 raft_consensus.cc:2468] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
I20260709 13:19:43.416966 16543 leader_election.cc:304] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:43.402861 16327 catalog_manager.cc:5697] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.419170 16326 catalog_manager.cc:5697] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.422237 16661 raft_consensus.cc:2804] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.422806 16661 raft_consensus.cc:697] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:43.423676 16661 consensus_queue.cc:237] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.427398 16328 catalog_manager.cc:5697] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.430742 16649 raft_consensus.cc:515] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.436986 16628 raft_consensus.cc:493] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.437500 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:43.437618 16628 raft_consensus.cc:515] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.438310 16429 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.439815 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.440455 16579 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.440927 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.441629 16504 raft_consensus.cc:2468] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:43.443135 16395 leader_election.cc:304] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.437794 16620 tablet_bootstrap.cc:492] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:43.444315 16662 raft_consensus.cc:2804] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.444679 16620 ts_tablet_manager.cc:1403] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.006s
I20260709 13:19:43.444741 16662 raft_consensus.cc:493] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.445191 16662 raft_consensus.cc:3060] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.447613 16579 raft_consensus.cc:2468] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 1.
I20260709 13:19:43.448900 16469 leader_election.cc:304] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.449779 16624 raft_consensus.cc:2804] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.450273 16624 raft_consensus.cc:697] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:43.450692 16628 leader_election.cc:290] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.452672 16578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:43.453365 16578 raft_consensus.cc:2468] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:43.450538 16620 raft_consensus.cc:359] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.451100 16624 consensus_queue.cc:237] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.455686 16649 leader_election.cc:290] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.455802 16620 raft_consensus.cc:385] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.457800 16429 raft_consensus.cc:2468] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 1.
I20260709 13:19:43.459656 16620 raft_consensus.cc:740] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.461231 16628 raft_consensus.cc:493] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.461380 16620 consensus_queue.cc:260] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.461856 16628 raft_consensus.cc:515] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.463688 16620 ts_tablet_manager.cc:1434] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:19:43.456414 16662 raft_consensus.cc:515] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.464293 16628 leader_election.cc:290] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.465817 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:43.466064 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.466538 16662 leader_election.cc:290] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.466809 16504 raft_consensus.cc:2468] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:43.467648 16578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.471014 16578 raft_consensus.cc:3060] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.472534 16327 catalog_manager.cc:5697] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.474542 16621 tablet_bootstrap.cc:492] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:43.475123 16621 ts_tablet_manager.cc:1403] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.003s
I20260709 13:19:43.468354 16395 leader_election.cc:304] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.469561 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.478798 16504 raft_consensus.cc:3060] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.478929 16579 raft_consensus.cc:2468] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:43.479975 16662 raft_consensus.cc:2804] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:43.480463 16662 raft_consensus.cc:493] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.480827 16662 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.478279 16621 raft_consensus.cc:359] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.486042 16621 raft_consensus.cc:385] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.486447 16621 raft_consensus.cc:740] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.487360 16621 consensus_queue.cc:260] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.484752 16328 catalog_manager.cc:5697] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.494194 16504 raft_consensus.cc:2468] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:43.495568 16395 leader_election.cc:304] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.496541 16628 raft_consensus.cc:2804] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.495976 16662 raft_consensus.cc:515] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.497033 16621 ts_tablet_manager.cc:1434] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 13:19:43.498780 16628 raft_consensus.cc:697] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:43.499846 16628 consensus_queue.cc:237] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.497890 16578 raft_consensus.cc:2468] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:43.501782 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.501909 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.502512 16504 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.502532 16579 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.504206 16621 tablet_bootstrap.cc:492] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:43.508648 16662 leader_election.cc:290] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.512668 16504 raft_consensus.cc:2468] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:43.513729 16395 leader_election.cc:304] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.514412 16628 raft_consensus.cc:2804] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:43.514901 16628 raft_consensus.cc:697] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:43.514096 16328 catalog_manager.cc:5697] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.515623 16621 tablet_bootstrap.cc:654] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:43.515645 16628 consensus_queue.cc:237] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.518177 16579 raft_consensus.cc:2468] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:43.527999 16621 tablet_bootstrap.cc:492] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:43.528504 16621 ts_tablet_manager.cc:1403] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260709 13:19:43.530602 16621 raft_consensus.cc:359] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.531075 16621 raft_consensus.cc:385] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:43.531288 16621 raft_consensus.cc:740] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:43.531505 16328 catalog_manager.cc:5697] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.531899 16621 consensus_queue.cc:260] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.533676 16621 ts_tablet_manager.cc:1434] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:43.564698 16649 consensus_queue.cc:1048] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.575073 16579 raft_consensus.cc:3060] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.583323 16649 consensus_queue.cc:1048] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.682358 16661 raft_consensus.cc:493] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.682850 16661 raft_consensus.cc:515] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.685034 16661 leader_election.cc:290] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:43.685823 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:43.686144 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.687281 16504 raft_consensus.cc:2393] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 742221ecccc942679fec78c444bd37e1 in current term 1: Already voted for candidate 87aff7c64559468cb088f4c29879fd03 in this term.
I20260709 13:19:43.688210 16544 leader_election.cc:304] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 742221ecccc942679fec78c444bd37e1; no voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:43.688908 16661 raft_consensus.cc:3060] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.694752 16661 raft_consensus.cc:2749] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.699056 16504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c2f3123aef411091662c5ca1e98198"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
mode: GRACEFUL
new_leader_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:50066
I20260709 13:19:43.699632 16504 raft_consensus.cc:606] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Received request to transfer leadership to TS 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:43.704475 16504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
mode: GRACEFUL
new_leader_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:50066
I20260709 13:19:43.704931 16504 raft_consensus.cc:606] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Received request to transfer leadership to TS 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:43.716497 16579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4c2dad9468a4c9a92b4cedbfe0bbd19"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
mode: GRACEFUL
new_leader_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:43422
I20260709 13:19:43.716985 16579 raft_consensus.cc:606] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Received request to transfer leadership to TS 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:43.721542 16579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
mode: GRACEFUL
new_leader_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:43422
I20260709 13:19:43.722000 16579 raft_consensus.cc:606] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Received request to transfer leadership to TS 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:43.733644 16429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:51172
I20260709 13:19:43.734090 16429 raft_consensus.cc:606] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Received request to transfer leadership to TS 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:43.738981 16429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:51172
I20260709 13:19:43.739398 16429 raft_consensus.cc:606] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Received request to transfer leadership to TS 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:43.743922 16579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b676a86e4df4581bac06bd86420bba7"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
mode: GRACEFUL
new_leader_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:43422
I20260709 13:19:43.744412 16579 raft_consensus.cc:606] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Received request to transfer leadership to TS 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:43.748755 16429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:51172
I20260709 13:19:43.749217 16429 raft_consensus.cc:606] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Received request to transfer leadership to TS 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:43.753686 16504 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "720a2c41e70f48b9ba720b3257692eef"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
mode: GRACEFUL
new_leader_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:50066
I20260709 13:19:43.754165 16504 raft_consensus.cc:606] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Received request to transfer leadership to TS 742221ecccc942679fec78c444bd37e1
I20260709 13:19:43.760397 16628 raft_consensus.cc:493] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.760959 16628 raft_consensus.cc:515] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.762715 16628 leader_election.cc:290] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.763370 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:43.763667 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:43.764029 16504 raft_consensus.cc:2393] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87aff7c64559468cb088f4c29879fd03 in current term 1: Already voted for candidate 742221ecccc942679fec78c444bd37e1 in this term.
I20260709 13:19:43.765084 16395 leader_election.cc:304] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03; no voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:43.765640 16628 raft_consensus.cc:3060] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:43.770757 16628 raft_consensus.cc:2749] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:43.773721 16662 consensus_queue.cc:1048] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.776116 16661 consensus_queue.cc:1048] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.781338 16649 consensus_queue.cc:1048] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.783427 16663 raft_consensus.cc:993] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:43.783926 16663 raft_consensus.cc:1081] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Signalling peer 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:43.787572 16629 raft_consensus.cc:993] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1: : Instructing follower 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:43.788087 16629 raft_consensus.cc:1081] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Signalling peer 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:43.788842 16505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:50052
I20260709 13:19:43.789456 16505 raft_consensus.cc:493] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.789840 16505 raft_consensus.cc:3060] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.794728 16430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:51144
I20260709 13:19:43.795704 16663 consensus_queue.cc:1048] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.796970 16430 raft_consensus.cc:493] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.797433 16430 raft_consensus.cc:3060] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.799218 16505 raft_consensus.cc:515] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.801923 16505 leader_election.cc:290] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.803444 16629 consensus_queue.cc:1048] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.807611 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:43.808198 16429 raft_consensus.cc:3055] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:43.808548 16429 raft_consensus.cc:740] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:43.809655 16429 consensus_queue.cc:260] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.811187 16429 raft_consensus.cc:3060] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.816546 16578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08ca935d16d40baaf79a555a2d5d42f" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.817142 16578 raft_consensus.cc:3060] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.821786 16429 raft_consensus.cc:2468] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:43.823230 16469 leader_election.cc:304] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.824015 16649 raft_consensus.cc:2804] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:43.824522 16649 raft_consensus.cc:697] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:43.825393 16649 consensus_queue.cc:237] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.830587 16430 raft_consensus.cc:515] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.833467 16578 raft_consensus.cc:2468] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:43.837762 16624 consensus_queue.cc:1048] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.842813 16625 consensus_queue.cc:1048] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:43.842514 16324 catalog_manager.cc:5697] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 1 to 2, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.846026 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.846621 16504 raft_consensus.cc:3060] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.856907 16504 raft_consensus.cc:2468] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:43.858012 16395 leader_election.cc:304] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.858897 16662 raft_consensus.cc:2804] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:43.859378 16662 raft_consensus.cc:697] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:43.860226 16662 consensus_queue.cc:237] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.866686 16629 consensus_queue.cc:1048] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.872751 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65aaa692131c4282ae5c2c3b51f14beb" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.872769 16430 leader_election.cc:290] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.873366 16579 raft_consensus.cc:3055] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:43.873901 16579 raft_consensus.cc:740] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:43.874745 16579 consensus_queue.cc:260] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.876137 16579 raft_consensus.cc:3060] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.884619 16625 raft_consensus.cc:993] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1: : Instructing follower 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:43.885155 16625 raft_consensus.cc:1081] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Signalling peer 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:43.885533 16579 raft_consensus.cc:2468] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:43.887002 16428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4c2dad9468a4c9a92b4cedbfe0bbd19"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:51144
I20260709 13:19:43.887698 16428 raft_consensus.cc:493] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.888083 16428 raft_consensus.cc:3060] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.888605 16689 raft_consensus.cc:993] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05: : Instructing follower 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:43.889087 16689 raft_consensus.cc:1081] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Signalling peer 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:43.890918 16429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c2f3123aef411091662c5ca1e98198"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:51158
I20260709 13:19:43.890633 16326 catalog_manager.cc:5697] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 1 to 2, leader changed from 742221ecccc942679fec78c444bd37e1 (127.6.233.3) to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.891525 16429 raft_consensus.cc:493] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.892594 16429 raft_consensus.cc:3060] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.896656 16428 raft_consensus.cc:515] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.899086 16640 consensus_queue.cc:1048] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.901427 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c2dad9468a4c9a92b4cedbfe0bbd19" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.902163 16504 raft_consensus.cc:3060] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.911036 16504 raft_consensus.cc:2468] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:43.911150 16429 raft_consensus.cc:515] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:43.911800 16428 leader_election.cc:290] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.912396 16395 leader_election.cc:304] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.913302 16662 raft_consensus.cc:2804] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:43.913743 16662 raft_consensus.cc:697] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:43.914499 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4c2dad9468a4c9a92b4cedbfe0bbd19" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.914543 16662 consensus_queue.cc:237] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.915185 16579 raft_consensus.cc:3055] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:43.917990 16579 raft_consensus.cc:740] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:43.919442 16429 leader_election.cc:290] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Requested vote from peers 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:43.918814 16579 consensus_queue.cc:260] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.920346 16578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c2f3123aef411091662c5ca1e98198" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.920595 16579 raft_consensus.cc:3060] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.920771 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c2f3123aef411091662c5ca1e98198" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.920966 16578 raft_consensus.cc:3060] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.921353 16504 raft_consensus.cc:3055] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:43.921715 16504 raft_consensus.cc:740] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:43.922215 16649 raft_consensus.cc:993] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05: : Instructing follower 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:43.922652 16649 raft_consensus.cc:1081] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Signalling peer 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:43.922479 16504 consensus_queue.cc:260] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:43.923650 16504 raft_consensus.cc:3060] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.925674 16428 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:51158
I20260709 13:19:43.926252 16428 raft_consensus.cc:493] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.926608 16428 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.927987 16579 raft_consensus.cc:2468] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:43.930711 16504 raft_consensus.cc:2468] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:43.931967 16395 leader_election.cc:304] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:43.932314 16624 consensus_queue.cc:1048] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.932904 16662 raft_consensus.cc:2804] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:43.933357 16662 raft_consensus.cc:697] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:43.934195 16662 consensus_queue.cc:237] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } }
I20260709 13:19:43.934063 16326 catalog_manager.cc:5697] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 1 to 2, leader changed from 742221ecccc942679fec78c444bd37e1 (127.6.233.3) to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.937258 16428 raft_consensus.cc:515] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.940788 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:43.941186 16579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:43.941468 16504 raft_consensus.cc:3055] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:43.941913 16504 raft_consensus.cc:740] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:43.942934 16428 leader_election.cc:290] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:43.942866 16504 consensus_queue.cc:260] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.943892 16504 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.946384 16578 raft_consensus.cc:2468] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:43.949779 16429 raft_consensus.cc:1240] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Rejecting Update request from peer 9e8c173367184ea7b1698afd85c61e05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:43.956526 16504 raft_consensus.cc:2468] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:43.957556 16395 leader_election.cc:304] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:43.958280 16662 raft_consensus.cc:2804] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:43.958763 16662 raft_consensus.cc:697] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:43.959581 16662 consensus_queue.cc:237] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:43.961630 16325 catalog_manager.cc:5697] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 1 to 2, leader changed from 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2) to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.964366 16661 consensus_queue.cc:1048] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.977602 16662 consensus_queue.cc:1048] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:43.986261 16625 consensus_queue.cc:1048] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.991647 16325 catalog_manager.cc:5697] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 1 to 2, leader changed from 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2) to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.993839 16628 consensus_queue.cc:1048] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.995441 16628 consensus_queue.cc:1048] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:43.998543 16625 raft_consensus.cc:993] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1: : Instructing follower 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:43.999150 16628 raft_consensus.cc:993] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:43.999739 16628 raft_consensus.cc:1081] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Signalling peer 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:43.999109 16625 raft_consensus.cc:1081] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Signalling peer 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:44.002707 16503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b676a86e4df4581bac06bd86420bba7"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:50046
I20260709 13:19:44.003275 16503 raft_consensus.cc:493] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.003633 16503 raft_consensus.cc:3060] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.008245 16502 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:50052
I20260709 13:19:44.008957 16502 raft_consensus.cc:493] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.009286 16502 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.017488 16663 consensus_queue.cc:1048] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.021497 16689 raft_consensus.cc:993] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05: : Instructing follower 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:44.021942 16689 raft_consensus.cc:1081] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Signalling peer 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:44.024181 16579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "720a2c41e70f48b9ba720b3257692eef"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:43418
I20260709 13:19:44.024988 16579 raft_consensus.cc:493] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.024875 16502 raft_consensus.cc:515] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.025669 16579 raft_consensus.cc:3060] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.037676 16503 raft_consensus.cc:515] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.034572 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:44.041577 16429 raft_consensus.cc:3055] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:44.041712 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b676a86e4df4581bac06bd86420bba7" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:44.042109 16429 raft_consensus.cc:740] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:44.042709 16428 raft_consensus.cc:3060] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.043272 16429 consensus_queue.cc:260] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.044940 16429 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.052026 16579 raft_consensus.cc:515] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.056134 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720a2c41e70f48b9ba720b3257692eef" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:44.057024 16430 raft_consensus.cc:3060] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.058382 16576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b676a86e4df4581bac06bd86420bba7" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:44.059252 16576 raft_consensus.cc:3055] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:44.059657 16576 raft_consensus.cc:740] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:44.060811 16576 consensus_queue.cc:260] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.062361 16576 raft_consensus.cc:3060] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.068007 16503 leader_election.cc:290] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:44.056200 16504 raft_consensus.cc:1240] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Rejecting Update request from peer 87aff7c64559468cb088f4c29879fd03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:44.075184 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "720a2c41e70f48b9ba720b3257692eef" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:44.075713 16579 leader_election.cc:290] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:44.075758 16504 raft_consensus.cc:3055] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:44.076980 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:44.076459 16504 raft_consensus.cc:740] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:44.079849 16430 raft_consensus.cc:2468] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 2.
I20260709 13:19:44.080518 16504 consensus_queue.cc:260] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.081875 16504 raft_consensus.cc:3060] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.082406 16662 raft_consensus.cc:993] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:44.082867 16662 raft_consensus.cc:1081] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Signalling peer 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:44.082917 16428 raft_consensus.cc:2468] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:44.071798 16502 leader_election.cc:290] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:44.055797 16429 raft_consensus.cc:2468] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:44.084250 16469 leader_election.cc:304] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:44.085093 16649 raft_consensus.cc:2804] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:44.085546 16649 raft_consensus.cc:697] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:44.085989 16543 leader_election.cc:304] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:44.086335 16649 consensus_queue.cc:237] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.088263 16625 raft_consensus.cc:2804] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:44.088460 16576 raft_consensus.cc:2468] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:44.088745 16625 raft_consensus.cc:697] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 2 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:44.089599 16625 consensus_queue.cc:237] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.092834 16469 leader_election.cc:304] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:44.093753 16649 raft_consensus.cc:2804] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:44.094211 16649 raft_consensus.cc:697] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:44.094997 16649 consensus_queue.cc:237] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.097647 16505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:50052
I20260709 13:19:44.099229 16505 raft_consensus.cc:493] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.099579 16505 raft_consensus.cc:3060] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.107697 16504 raft_consensus.cc:2468] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 2.
I20260709 13:19:44.108754 16505 raft_consensus.cc:515] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.108245 16324 catalog_manager.cc:5697] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 1 to 2, leader changed from 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2) to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.109759 16502 raft_consensus.cc:1240] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Rejecting Update request from peer 87aff7c64559468cb088f4c29879fd03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:44.110890 16505 leader_election.cc:290] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:44.112543 16576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:44.113634 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d31c62c4d53b383f07629c93e9f" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:44.114208 16430 raft_consensus.cc:3055] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:44.114212 16663 consensus_queue.cc:1059] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:44.114802 16430 raft_consensus.cc:740] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:44.115662 16430 consensus_queue.cc:260] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
W20260709 13:19:44.116578 16662 consensus_queue.cc:1175] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "742221ecccc942679fec78c444bd37e1" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:19:44.117580 16430 raft_consensus.cc:3060] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.118419 16325 catalog_manager.cc:5697] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 1 to 2, leader changed from 742221ecccc942679fec78c444bd37e1 (127.6.233.3) to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.120217 16325 catalog_manager.cc:5697] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 1 to 2, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.124662 16430 raft_consensus.cc:2468] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
W20260709 13:19:44.125118 16663 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:19:44.125690 16469 leader_election.cc:304] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:44.126535 16649 raft_consensus.cc:2804] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:44.127039 16649 raft_consensus.cc:697] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:44.127802 16649 consensus_queue.cc:237] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:44.135344 16325 catalog_manager.cc:5697] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 1 to 2, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.287290 16502 raft_consensus.cc:1275] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.288607 16663 consensus_queue.cc:1048] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.290871 16577 raft_consensus.cc:1275] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.292109 16663 consensus_queue.cc:1048] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.303172 16502 raft_consensus.cc:1275] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.304507 16663 consensus_queue.cc:1048] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.315768 16577 raft_consensus.cc:1275] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.317438 16663 consensus_queue.cc:1048] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.383016 16577 raft_consensus.cc:1275] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.384258 16649 consensus_queue.cc:1048] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.391774 16430 raft_consensus.cc:1275] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.393628 16649 consensus_queue.cc:1048] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.393743 16502 raft_consensus.cc:1275] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.395571 16663 consensus_queue.cc:1048] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.406682 16577 raft_consensus.cc:1275] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.408609 16662 consensus_queue.cc:1048] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.504545 16430 raft_consensus.cc:1275] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.505796 16649 consensus_queue.cc:1048] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.507586 16430 raft_consensus.cc:1275] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.508880 16649 consensus_queue.cc:1048] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.517400 16577 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.519018 16576 raft_consensus.cc:1275] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.522089 16576 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.525002 16577 raft_consensus.cc:1275] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.527034 16689 consensus_queue.cc:1048] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.529093 16576 raft_consensus.cc:1275] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.528978 16689 consensus_queue.cc:1048] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.531121 16662 consensus_queue.cc:1048] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.541533 16502 raft_consensus.cc:1275] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.543061 16663 consensus_queue.cc:1048] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.563611 16430 raft_consensus.cc:1275] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.564900 16629 consensus_queue.cc:1048] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:44.572273 16502 raft_consensus.cc:1275] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.574642 16629 consensus_queue.cc:1048] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:44.610775 16577 raft_consensus.cc:3060] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.615933 16577 raft_consensus.cc:1275] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.617305 16649 consensus_queue.cc:1048] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:44.625114 16430 raft_consensus.cc:1275] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.627667 16703 consensus_queue.cc:1048] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:46.782104 16326 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37226:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:46.784318 16326 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:46.840154 16417 tablet_service.cc:1511] Processing CreateTablet for tablet 6214c36d361c4529888dd02a83e1924a (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:46.841476 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6214c36d361c4529888dd02a83e1924a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.841187 16490 tablet_service.cc:1511] Processing CreateTablet for tablet 6214c36d361c4529888dd02a83e1924a (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:46.842247 16565 tablet_service.cc:1511] Processing CreateTablet for tablet 6214c36d361c4529888dd02a83e1924a (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:46.842662 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6214c36d361c4529888dd02a83e1924a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.843667 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6214c36d361c4529888dd02a83e1924a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.844255 16419 tablet_service.cc:1511] Processing CreateTablet for tablet 347298cd45544d4c9e195829a27fc374 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:46.845546 16419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347298cd45544d4c9e195829a27fc374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.864849 16488 tablet_service.cc:1511] Processing CreateTablet for tablet 347298cd45544d4c9e195829a27fc374 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:46.866752 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347298cd45544d4c9e195829a27fc374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.867534 16716 tablet_bootstrap.cc:492] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:46.867547 16717 tablet_bootstrap.cc:492] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:46.869071 16566 tablet_service.cc:1511] Processing CreateTablet for tablet 347298cd45544d4c9e195829a27fc374 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:46.870443 16566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347298cd45544d4c9e195829a27fc374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.872078 16490 tablet_service.cc:1511] Processing CreateTablet for tablet 146e62ac93d645438fb30732020e2947 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:46.874526 16717 tablet_bootstrap.cc:654] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.875876 16716 tablet_bootstrap.cc:654] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.877280 16562 tablet_service.cc:1511] Processing CreateTablet for tablet 146e62ac93d645438fb30732020e2947 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:46.878695 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146e62ac93d645438fb30732020e2947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.869100 16417 tablet_service.cc:1511] Processing CreateTablet for tablet 146e62ac93d645438fb30732020e2947 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:46.885193 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146e62ac93d645438fb30732020e2947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.886312 16717 tablet_bootstrap.cc:492] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:46.886965 16717 ts_tablet_manager.cc:1403] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:19:46.887738 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146e62ac93d645438fb30732020e2947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.890122 16717 raft_consensus.cc:359] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:46.890645 16716 tablet_bootstrap.cc:492] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:46.890954 16717 raft_consensus.cc:385] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.891331 16717 raft_consensus.cc:740] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.891376 16716 ts_tablet_manager.cc:1403] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.011s
I20260709 13:19:46.892395 16717 consensus_queue.cc:260] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:46.894807 16717 ts_tablet_manager.cc:1434] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 13:19:46.896322 16704 raft_consensus.cc:493] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.896816 16704 raft_consensus.cc:515] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:46.898913 16704 leader_election.cc:290] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:46.899295 16416 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce73e29b7324f93b0a3bcc3963b28b1 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:46.900630 16416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce73e29b7324f93b0a3bcc3963b28b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.900756 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
W20260709 13:19:46.903717 16469 leader_election.cc:343] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Not found: Tablet not found: 6214c36d361c4529888dd02a83e1924a
W20260709 13:19:46.904417 16469 leader_election.cc:343] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.904811 16469 leader_election.cc:304] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:46.908962 16704 raft_consensus.cc:2749] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.915429 16716 raft_consensus.cc:359] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:46.916461 16716 raft_consensus.cc:385] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.916816 16716 raft_consensus.cc:740] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.917728 16716 consensus_queue.cc:260] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:46.922281 16716 ts_tablet_manager.cc:1434] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:19:46.924207 16720 tablet_bootstrap.cc:492] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:46.930981 16720 tablet_bootstrap.cc:654] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.932886 16662 raft_consensus.cc:493] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.933120 16717 tablet_bootstrap.cc:492] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:46.933537 16662 raft_consensus.cc:515] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:46.935869 16662 leader_election.cc:290] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:46.936853 16716 tablet_bootstrap.cc:492] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:46.937304 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
W20260709 13:19:46.939163 16394 leader_election.cc:343] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.940243 16717 tablet_bootstrap.cc:654] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.942252 16565 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce73e29b7324f93b0a3bcc3963b28b1 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:46.942644 16502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:46.956835 16502 raft_consensus.cc:2468] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:46.945791 16566 tablet_service.cc:1511] Processing CreateTablet for tablet d4b79bef1c3a4d24901aa94288c2700d (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:46.958330 16395 leader_election.cc:304] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:46.959175 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce73e29b7324f93b0a3bcc3963b28b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.959699 16662 raft_consensus.cc:2804] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.960162 16662 raft_consensus.cc:493] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.960538 16662 raft_consensus.cc:3060] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.961489 16566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b79bef1c3a4d24901aa94288c2700d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.961606 16417 tablet_service.cc:1511] Processing CreateTablet for tablet 02b73127387647e98ec7fdc1a9ced251 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:46.963336 16419 tablet_service.cc:1511] Processing CreateTablet for tablet d4b79bef1c3a4d24901aa94288c2700d (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:46.963372 16417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b73127387647e98ec7fdc1a9ced251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.964893 16419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b79bef1c3a4d24901aa94288c2700d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.953523 16488 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce73e29b7324f93b0a3bcc3963b28b1 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:46.972491 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce73e29b7324f93b0a3bcc3963b28b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.954962 16490 tablet_service.cc:1511] Processing CreateTablet for tablet d4b79bef1c3a4d24901aa94288c2700d (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:46.977946 16490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b79bef1c3a4d24901aa94288c2700d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.991353 16494 tablet_service.cc:1511] Processing CreateTablet for tablet 02b73127387647e98ec7fdc1a9ced251 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:46.992965 16494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b73127387647e98ec7fdc1a9ced251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.993410 16562 tablet_service.cc:1511] Processing CreateTablet for tablet 02b73127387647e98ec7fdc1a9ced251 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:46.994761 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b73127387647e98ec7fdc1a9ced251. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.995445 16662 raft_consensus.cc:515] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:46.995890 16492 tablet_service.cc:1511] Processing CreateTablet for tablet a76833a8c7784105a9e1c21f99f553e9 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:46.997258 16492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76833a8c7784105a9e1c21f99f553e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.997849 16419 tablet_service.cc:1511] Processing CreateTablet for tablet a76833a8c7784105a9e1c21f99f553e9 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:46.998502 16502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:46.999060 16419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76833a8c7784105a9e1c21f99f553e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.999112 16502 raft_consensus.cc:3060] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.994786 16716 tablet_bootstrap.cc:654] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.005853 16568 tablet_service.cc:1511] Processing CreateTablet for tablet a76833a8c7784105a9e1c21f99f553e9 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:47.007277 16568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76833a8c7784105a9e1c21f99f553e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.017699 16502 raft_consensus.cc:2468] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.019003 16395 leader_election.cc:304] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:47.029222 16662 leader_election.cc:290] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.029984 16662 raft_consensus.cc:2804] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.030295 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:47.030524 16662 raft_consensus.cc:697] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
W20260709 13:19:47.032153 16394 leader_election.cc:343] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.039973 16717 tablet_bootstrap.cc:492] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:47.040598 16717 ts_tablet_manager.cc:1403] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.108s	user 0.031s	sys 0.038s
I20260709 13:19:47.043795 16717 raft_consensus.cc:359] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.045116 16717 raft_consensus.cc:385] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.045959 16717 raft_consensus.cc:740] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.046280 16720 tablet_bootstrap.cc:492] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.046736 16717 consensus_queue.cc:260] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.049276 16717 ts_tablet_manager.cc:1434] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:47.031721 16662 consensus_queue.cc:237] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.054155 16717 tablet_bootstrap.cc:492] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:47.046854 16720 ts_tablet_manager.cc:1403] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.008s
I20260709 13:19:47.057705 16419 tablet_service.cc:1511] Processing CreateTablet for tablet 3689cd3dab6f4f3b83b7efd4f20d85ff (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:47.059087 16419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3689cd3dab6f4f3b83b7efd4f20d85ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.061976 16488 tablet_service.cc:1511] Processing CreateTablet for tablet 3689cd3dab6f4f3b83b7efd4f20d85ff (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:47.062114 16720 raft_consensus.cc:359] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.062999 16720 raft_consensus.cc:385] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.063345 16720 raft_consensus.cc:740] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.064126 16720 consensus_queue.cc:260] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.065439 16717 tablet_bootstrap.cc:654] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.066465 16720 ts_tablet_manager.cc:1434] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:47.067637 16720 tablet_bootstrap.cc:492] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:47.076922 16488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3689cd3dab6f4f3b83b7efd4f20d85ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.076924 16716 tablet_bootstrap.cc:492] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:47.077773 16716 ts_tablet_manager.cc:1403] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.141s	user 0.019s	sys 0.025s
I20260709 13:19:47.081106 16716 raft_consensus.cc:359] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.081840 16716 raft_consensus.cc:385] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.082147 16716 raft_consensus.cc:740] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.085320 16717 tablet_bootstrap.cc:492] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:47.085876 16717 ts_tablet_manager.cc:1403] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:19:47.089195 16717 raft_consensus.cc:359] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.089892 16717 raft_consensus.cc:385] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.090204 16717 raft_consensus.cc:740] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.091137 16716 consensus_queue.cc:260] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.094468 16562 tablet_service.cc:1511] Processing CreateTablet for tablet 3689cd3dab6f4f3b83b7efd4f20d85ff (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:47.095469 16716 ts_tablet_manager.cc:1434] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:19:47.096555 16716 tablet_bootstrap.cc:492] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:47.097122 16416 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbdc20c048b4eb19cd4edfe34806718 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:47.098564 16416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbdc20c048b4eb19cd4edfe34806718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.102921 16716 tablet_bootstrap.cc:654] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.106063 16489 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbdc20c048b4eb19cd4edfe34806718 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:47.106365 16717 consensus_queue.cc:260] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.107693 16489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbdc20c048b4eb19cd4edfe34806718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.108934 16717 ts_tablet_manager.cc:1434] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:19:47.110040 16717 tablet_bootstrap.cc:492] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:47.116637 16717 tablet_bootstrap.cc:654] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.116706 16566 tablet_service.cc:1511] Processing CreateTablet for tablet 2cbdc20c048b4eb19cd4edfe34806718 (DEFAULT_TABLE table=soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 13:19:47.123346 16376 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:47.133857 16720 tablet_bootstrap.cc:654] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.133148 16325 catalog_manager.cc:5697] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.146715 16720 tablet_bootstrap.cc:492] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.147238 16720 ts_tablet_manager.cc:1403] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.000s
I20260709 13:19:47.150344 16720 raft_consensus.cc:359] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.151376 16566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cbdc20c048b4eb19cd4edfe34806718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.151060 16720 raft_consensus.cc:385] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.152267 16562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3689cd3dab6f4f3b83b7efd4f20d85ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.158270 16662 raft_consensus.cc:493] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.159003 16662 raft_consensus.cc:515] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.161604 16662 leader_election.cc:290] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.165889 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146e62ac93d645438fb30732020e2947" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
W20260709 13:19:47.170629 16394 leader_election.cc:343] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.175544 16717 tablet_bootstrap.cc:492] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:47.175958 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146e62ac93d645438fb30732020e2947" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.176697 16505 raft_consensus.cc:2468] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.178047 16395 leader_election.cc:304] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:47.176174 16717 ts_tablet_manager.cc:1403] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.017s
I20260709 13:19:47.178882 16725 raft_consensus.cc:2804] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.179438 16725 raft_consensus.cc:493] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.179872 16725 raft_consensus.cc:3060] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.182009 16717 raft_consensus.cc:359] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.182757 16717 raft_consensus.cc:385] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.183048 16717 raft_consensus.cc:740] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.183758 16717 consensus_queue.cc:260] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.186048 16717 ts_tablet_manager.cc:1434] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:19:47.189569 16717 tablet_bootstrap.cc:492] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:47.152257 16720 raft_consensus.cc:740] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.190438 16720 consensus_queue.cc:260] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.195317 16720 ts_tablet_manager.cc:1434] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.004s
I20260709 13:19:47.199007 16717 tablet_bootstrap.cc:654] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.199918 16720 tablet_bootstrap.cc:492] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:47.199643 16725 raft_consensus.cc:515] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.210336 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146e62ac93d645438fb30732020e2947" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:47.210759 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146e62ac93d645438fb30732020e2947" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:47.211194 16505 raft_consensus.cc:3060] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:47.212610 16394 leader_election.cc:343] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.213068 16725 leader_election.cc:290] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.215179 16716 tablet_bootstrap.cc:492] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:47.215555 16720 tablet_bootstrap.cc:654] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.215747 16716 ts_tablet_manager.cc:1403] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.119s	user 0.030s	sys 0.015s
I20260709 13:19:47.219041 16716 raft_consensus.cc:359] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.219800 16716 raft_consensus.cc:385] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.220142 16716 raft_consensus.cc:740] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.221235 16717 tablet_bootstrap.cc:492] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:47.221060 16505 raft_consensus.cc:2468] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.220813 16716 consensus_queue.cc:260] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.221776 16717 ts_tablet_manager.cc:1403] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.005s
I20260709 13:19:47.222355 16720 tablet_bootstrap.cc:492] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.222368 16395 leader_election.cc:304] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:47.223009 16720 ts_tablet_manager.cc:1403] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.007s
I20260709 13:19:47.224293 16725 raft_consensus.cc:2804] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.224819 16725 raft_consensus.cc:697] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:47.224706 16717 raft_consensus.cc:359] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.225565 16717 raft_consensus.cc:385] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.225862 16717 raft_consensus.cc:740] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.225772 16725 consensus_queue.cc:237] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.226128 16720 raft_consensus.cc:359] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.226850 16720 raft_consensus.cc:385] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.226703 16717 consensus_queue.cc:260] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.227228 16720 raft_consensus.cc:740] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.228718 16720 consensus_queue.cc:260] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.229199 16716 ts_tablet_manager.cc:1434] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:47.230698 16716 tablet_bootstrap.cc:492] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:47.237160 16720 ts_tablet_manager.cc:1434] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:19:47.238219 16720 tablet_bootstrap.cc:492] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:47.239563 16716 tablet_bootstrap.cc:654] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.249644 16629 raft_consensus.cc:493] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.250209 16629 raft_consensus.cc:515] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.252395 16629 leader_election.cc:290] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:47.258873 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347298cd45544d4c9e195829a27fc374" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.259598 16505 raft_consensus.cc:2468] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:47.261343 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347298cd45544d4c9e195829a27fc374" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:47.261570 16716 tablet_bootstrap.cc:492] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:47.262075 16430 raft_consensus.cc:2468] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:47.262241 16716 ts_tablet_manager.cc:1403] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.016s
I20260709 13:19:47.262552 16717 ts_tablet_manager.cc:1434] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.006s
I20260709 13:19:47.263041 16544 leader_election.cc:304] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:47.263612 16717 tablet_bootstrap.cc:492] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:47.264809 16629 raft_consensus.cc:2804] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.265288 16629 raft_consensus.cc:493] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.264750 16325 catalog_manager.cc:5697] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.265983 16716 raft_consensus.cc:359] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.266707 16720 tablet_bootstrap.cc:654] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.266801 16716 raft_consensus.cc:385] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.267295 16716 raft_consensus.cc:740] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.268285 16716 consensus_queue.cc:260] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.265614 16629 raft_consensus.cc:3060] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.271190 16716 ts_tablet_manager.cc:1434] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:47.272399 16716 tablet_bootstrap.cc:492] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:47.274669 16717 tablet_bootstrap.cc:654] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.282330 16733 raft_consensus.cc:493] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.282907 16733 raft_consensus.cc:515] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.283140 16629 raft_consensus.cc:515] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.287513 16716 tablet_bootstrap.cc:654] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.288080 16717 tablet_bootstrap.cc:492] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:47.288878 16717 ts_tablet_manager.cc:1403] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 13:19:47.292289 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347298cd45544d4c9e195829a27fc374" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:47.292982 16430 raft_consensus.cc:3060] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.293147 16717 raft_consensus.cc:359] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.293915 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:47.294420 16717 raft_consensus.cc:385] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.294623 16429 raft_consensus.cc:2468] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 0.
I20260709 13:19:47.294962 16717 raft_consensus.cc:740] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.296134 16469 leader_election.cc:304] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:47.297039 16704 raft_consensus.cc:2804] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.296343 16717 consensus_queue.cc:260] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.297436 16704 raft_consensus.cc:493] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.297868 16704 raft_consensus.cc:3060] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.302166 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:47.302515 16430 raft_consensus.cc:2468] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
W20260709 13:19:47.303735 16469 leader_election.cc:343] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.305660 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347298cd45544d4c9e195829a27fc374" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:47.306463 16505 raft_consensus.cc:3060] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.306739 16704 raft_consensus.cc:515] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.307906 16543 leader_election.cc:304] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:47.309614 16629 leader_election.cc:290] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:47.309731 16733 leader_election.cc:290] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.312220 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:47.315627 16629 raft_consensus.cc:2804] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.312482 16704 leader_election.cc:290] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.316234 16629 raft_consensus.cc:697] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
W20260709 13:19:47.316964 16469 leader_election.cc:343] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.318523 16505 raft_consensus.cc:2468] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
I20260709 13:19:47.317130 16629 consensus_queue.cc:237] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.326725 16720 tablet_bootstrap.cc:492] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.327397 16720 ts_tablet_manager.cc:1403] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.023s
I20260709 13:19:47.327692 16716 tablet_bootstrap.cc:492] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:47.328306 16716 ts_tablet_manager.cc:1403] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.001s
I20260709 13:19:47.330506 16720 raft_consensus.cc:359] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.331280 16720 raft_consensus.cc:385] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.331245 16716 raft_consensus.cc:359] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.331818 16720 raft_consensus.cc:740] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.310154 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:47.332899 16430 raft_consensus.cc:3060] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.335616 16720 consensus_queue.cc:260] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.338208 16716 raft_consensus.cc:385] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.338613 16716 raft_consensus.cc:740] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.339161 16720 ts_tablet_manager.cc:1434] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:19:47.340029 16720 tablet_bootstrap.cc:492] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:47.338100 16326 catalog_manager.cc:5697] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.343598 16717 ts_tablet_manager.cc:1434] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 13:19:47.339581 16716 consensus_queue.cc:260] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.348232 16716 ts_tablet_manager.cc:1434] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:19:47.349253 16716 tablet_bootstrap.cc:492] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:47.353363 16720 tablet_bootstrap.cc:654] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.355252 16716 tablet_bootstrap.cc:654] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.355924 16717 tablet_bootstrap.cc:492] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:47.363632 16717 tablet_bootstrap.cc:654] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.368141 16430 raft_consensus.cc:2468] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 1.
I20260709 13:19:47.369803 16469 leader_election.cc:304] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1
I20260709 13:19:47.371412 16741 raft_consensus.cc:2804] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.372078 16741 raft_consensus.cc:697] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:47.373196 16741 consensus_queue.cc:237] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.376147 16717 tablet_bootstrap.cc:492] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:47.376751 16717 ts_tablet_manager.cc:1403] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 13:19:47.380910 16717 raft_consensus.cc:359] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.381958 16717 raft_consensus.cc:385] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.382388 16717 raft_consensus.cc:740] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.383299 16717 consensus_queue.cc:260] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.386148 16717 ts_tablet_manager.cc:1434] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:19:47.388260 16717 tablet_bootstrap.cc:492] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:47.394511 16717 tablet_bootstrap.cc:654] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.394938 16720 tablet_bootstrap.cc:492] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.395751 16720 ts_tablet_manager.cc:1403] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.034s
I20260709 13:19:47.399897 16720 raft_consensus.cc:359] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.401067 16720 raft_consensus.cc:385] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.401516 16720 raft_consensus.cc:740] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.403407 16741 raft_consensus.cc:493] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.403890 16739 raft_consensus.cc:493] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.404091 16741 raft_consensus.cc:515] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.404613 16739 raft_consensus.cc:515] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.408596 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146e62ac93d645438fb30732020e2947" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:47.409636 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146e62ac93d645438fb30732020e2947" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.410746 16505 raft_consensus.cc:2393] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 742221ecccc942679fec78c444bd37e1 in current term 1: Already voted for candidate 87aff7c64559468cb088f4c29879fd03 in this term.
I20260709 13:19:47.411182 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:47.412227 16629 raft_consensus.cc:493] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.412927 16629 raft_consensus.cc:515] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.415664 16629 leader_election.cc:290] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:47.416344 16544 leader_election.cc:304] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 742221ecccc942679fec78c444bd37e1; no voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:47.418433 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:47.420202 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.421319 16505 raft_consensus.cc:2393] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 742221ecccc942679fec78c444bd37e1 in current term 1: Already voted for candidate 87aff7c64559468cb088f4c29879fd03 in this term.
I20260709 13:19:47.423146 16629 raft_consensus.cc:3060] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.417657 16739 leader_election.cc:290] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:47.402654 16720 consensus_queue.cc:260] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
W20260709 13:19:47.430116 16469 leader_election.cc:343] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.434805 16543 leader_election.cc:304] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 742221ecccc942679fec78c444bd37e1; no voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:47.437088 16739 raft_consensus.cc:3060] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.437984 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
W20260709 13:19:47.440002 16469 leader_election.cc:343] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.440640 16469 leader_election.cc:304] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:47.441776 16704 raft_consensus.cc:2749] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.401831 16326 catalog_manager.cc:5697] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 1 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.446027 16741 leader_election.cc:290] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.447695 16720 ts_tablet_manager.cc:1434] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 13:19:47.451135 16717 tablet_bootstrap.cc:492] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:47.451725 16717 ts_tablet_manager.cc:1403] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.049s
I20260709 13:19:47.451762 16716 tablet_bootstrap.cc:492] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:47.452385 16716 ts_tablet_manager.cc:1403] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.103s	user 0.040s	sys 0.054s
I20260709 13:19:47.454797 16717 raft_consensus.cc:359] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.455650 16717 raft_consensus.cc:385] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.455389 16716 raft_consensus.cc:359] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.455948 16720 tablet_bootstrap.cc:492] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:47.456023 16717 raft_consensus.cc:740] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.457163 16717 consensus_queue.cc:260] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.457767 16739 raft_consensus.cc:2749] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.456228 16716 raft_consensus.cc:385] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.435066 16629 raft_consensus.cc:2749] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.458416 16716 raft_consensus.cc:740] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.459450 16716 consensus_queue.cc:260] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.460222 16717 ts_tablet_manager.cc:1434] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:19:47.461300 16717 tablet_bootstrap.cc:492] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05: Bootstrap starting.
I20260709 13:19:47.462008 16716 ts_tablet_manager.cc:1434] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:19:47.463109 16716 tablet_bootstrap.cc:492] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:47.463723 16720 tablet_bootstrap.cc:654] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.468139 16717 tablet_bootstrap.cc:654] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.469537 16716 tablet_bootstrap.cc:654] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.475780 16720 tablet_bootstrap.cc:492] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.476327 16720 ts_tablet_manager.cc:1403] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:19:47.479254 16717 tablet_bootstrap.cc:492] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05: No bootstrap required, opened a new log
I20260709 13:19:47.479800 16717 ts_tablet_manager.cc:1403] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.007s
I20260709 13:19:47.479403 16720 raft_consensus.cc:359] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.481168 16720 raft_consensus.cc:385] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.481484 16720 raft_consensus.cc:740] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.482209 16720 consensus_queue.cc:260] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.482678 16717 raft_consensus.cc:359] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.483673 16717 raft_consensus.cc:385] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.483948 16717 raft_consensus.cc:740] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.484637 16717 consensus_queue.cc:260] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.485610 16716 tablet_bootstrap.cc:492] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:47.486116 16716 ts_tablet_manager.cc:1403] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:19:47.486668 16717 ts_tablet_manager.cc:1434] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:19:47.487702 16720 ts_tablet_manager.cc:1434] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:19:47.488726 16720 tablet_bootstrap.cc:492] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:47.490432 16716 raft_consensus.cc:359] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.491146 16716 raft_consensus.cc:385] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.491423 16716 raft_consensus.cc:740] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.492309 16716 consensus_queue.cc:260] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.494956 16716 ts_tablet_manager.cc:1434] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:19:47.495253 16720 tablet_bootstrap.cc:654] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.495925 16716 tablet_bootstrap.cc:492] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:47.503479 16716 tablet_bootstrap.cc:654] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.505021 16720 tablet_bootstrap.cc:492] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.505650 16720 ts_tablet_manager.cc:1403] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 13:19:47.508649 16720 raft_consensus.cc:359] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.509439 16720 raft_consensus.cc:385] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.509788 16720 raft_consensus.cc:740] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.510442 16720 consensus_queue.cc:260] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.510949 16716 tablet_bootstrap.cc:492] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:47.511448 16716 ts_tablet_manager.cc:1403] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:19:47.511909 16720 ts_tablet_manager.cc:1434] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:19:47.514184 16716 raft_consensus.cc:359] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.514731 16716 raft_consensus.cc:385] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.514955 16716 raft_consensus.cc:740] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.515424 16720 tablet_bootstrap.cc:492] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:47.515574 16716 consensus_queue.cc:260] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.518100 16716 ts_tablet_manager.cc:1434] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:19:47.520370 16716 tablet_bootstrap.cc:492] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03: Bootstrap starting.
I20260709 13:19:47.522126 16720 tablet_bootstrap.cc:654] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.525828 16716 tablet_bootstrap.cc:654] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.535631 16720 tablet_bootstrap.cc:492] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.536123 16720 ts_tablet_manager.cc:1403] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.002s
I20260709 13:19:47.538203 16720 raft_consensus.cc:359] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.538767 16720 raft_consensus.cc:385] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.539058 16720 raft_consensus.cc:740] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.539712 16720 consensus_queue.cc:260] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.540234 16716 tablet_bootstrap.cc:492] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03: No bootstrap required, opened a new log
I20260709 13:19:47.540745 16716 ts_tablet_manager.cc:1403] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.007s
I20260709 13:19:47.541810 16720 ts_tablet_manager.cc:1434] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:47.542771 16720 tablet_bootstrap.cc:492] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1: Bootstrap starting.
I20260709 13:19:47.543421 16716 raft_consensus.cc:359] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.544145 16716 raft_consensus.cc:385] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.544397 16716 raft_consensus.cc:740] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.545102 16716 consensus_queue.cc:260] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.547187 16716 ts_tablet_manager.cc:1434] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:19:47.549245 16720 tablet_bootstrap.cc:654] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.550004 16725 consensus_queue.cc:1048] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:47.554548 16720 tablet_bootstrap.cc:492] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1: No bootstrap required, opened a new log
I20260709 13:19:47.555083 16720 ts_tablet_manager.cc:1403] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:19:47.557673 16720 raft_consensus.cc:359] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.558403 16720 raft_consensus.cc:385] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.558676 16720 raft_consensus.cc:740] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.559322 16720 consensus_queue.cc:260] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.561434 16720 ts_tablet_manager.cc:1434] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:47.572602 16725 consensus_queue.cc:1048] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.620790 16725 raft_consensus.cc:493] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.621264 16725 raft_consensus.cc:515] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.623036 16725 leader_election.cc:290] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.623977 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b73127387647e98ec7fdc1a9ced251" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.624182 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b73127387647e98ec7fdc1a9ced251" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:47.624868 16505 raft_consensus.cc:2468] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.624913 16577 raft_consensus.cc:2468] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.626216 16395 leader_election.cc:304] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:47.626922 16725 raft_consensus.cc:2804] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.627246 16725 raft_consensus.cc:493] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.627560 16725 raft_consensus.cc:3060] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.632864 16725 raft_consensus.cc:515] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.634533 16725 leader_election.cc:290] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.635540 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b73127387647e98ec7fdc1a9ced251" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:47.635679 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b73127387647e98ec7fdc1a9ced251" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:47.636217 16505 raft_consensus.cc:3060] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.636325 16577 raft_consensus.cc:3060] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.637135 16629 raft_consensus.cc:493] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.637672 16629 raft_consensus.cc:515] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.639979 16629 leader_election.cc:290] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:47.640947 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:47.641839 16429 raft_consensus.cc:2393] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 742221ecccc942679fec78c444bd37e1 in current term 1: Already voted for candidate 9e8c173367184ea7b1698afd85c61e05 in this term.
I20260709 13:19:47.641724 16502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.643395 16577 raft_consensus.cc:2468] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.643549 16544 leader_election.cc:304] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 742221ecccc942679fec78c444bd37e1; no voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:47.644105 16505 raft_consensus.cc:2468] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.644671 16629 raft_consensus.cc:3060] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.645313 16394 leader_election.cc:304] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:47.646497 16725 raft_consensus.cc:2804] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.646926 16725 raft_consensus.cc:697] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:47.647728 16725 consensus_queue.cc:237] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.648644 16723 raft_consensus.cc:493] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.649216 16723 raft_consensus.cc:515] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.651526 16629 raft_consensus.cc:2749] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.651532 16723 leader_election.cc:290] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.653014 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76833a8c7784105a9e1c21f99f553e9" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:47.653791 16577 raft_consensus.cc:2468] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.655282 16394 leader_election.cc:304] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:47.656208 16725 raft_consensus.cc:2804] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.656569 16725 raft_consensus.cc:493] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.656867 16725 raft_consensus.cc:3060] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.659610 16324 catalog_manager.cc:5697] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.660485 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76833a8c7784105a9e1c21f99f553e9" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.661234 16505 raft_consensus.cc:2468] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.662998 16725 raft_consensus.cc:515] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.665798 16725 leader_election.cc:290] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.666536 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76833a8c7784105a9e1c21f99f553e9" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:47.667207 16577 raft_consensus.cc:3060] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.667752 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76833a8c7784105a9e1c21f99f553e9" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:47.668407 16505 raft_consensus.cc:3060] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.674155 16577 raft_consensus.cc:2468] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.674346 16505 raft_consensus.cc:2468] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.675674 16394 leader_election.cc:304] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:47.676424 16725 raft_consensus.cc:2804] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.676940 16725 raft_consensus.cc:697] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:47.677904 16725 consensus_queue.cc:237] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.685292 16324 catalog_manager.cc:5697] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.732267 16725 raft_consensus.cc:493] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.732852 16725 raft_consensus.cc:515] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.734892 16725 leader_election.cc:290] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.735893 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.736109 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:47.736603 16505 raft_consensus.cc:2468] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.736841 16577 raft_consensus.cc:2468] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.737640 16395 leader_election.cc:304] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:47.738524 16725 raft_consensus.cc:2804] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.738816 16725 raft_consensus.cc:493] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.739063 16725 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.744324 16725 raft_consensus.cc:515] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.746047 16725 leader_election.cc:290] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.746968 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:47.747134 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:47.747587 16505 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.747778 16577 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.753134 16505 raft_consensus.cc:2468] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.753755 16577 raft_consensus.cc:2468] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.754215 16395 leader_election.cc:304] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:47.755081 16725 raft_consensus.cc:2804] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.755522 16725 raft_consensus.cc:697] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:47.756296 16725 consensus_queue.cc:237] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.759722 16723 consensus_queue.cc:1048] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.761617 16741 consensus_queue.cc:1048] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.776505 16629 consensus_queue.cc:1048] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:47.776772 16662 consensus_queue.cc:1048] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.786186 16704 consensus_queue.cc:1048] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.771131 16324 catalog_manager.cc:5697] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.802860 16629 consensus_queue.cc:1048] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.865722 16725 raft_consensus.cc:493] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.865872 16704 raft_consensus.cc:493] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.866230 16725 raft_consensus.cc:515] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.866525 16704 raft_consensus.cc:515] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.868589 16704 leader_election.cc:290] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.868577 16725 leader_election.cc:290] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.869185 16578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:47.868983 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.870003 16578 raft_consensus.cc:2468] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.870157 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1" is_pre_election: true
I20260709 13:19:47.870405 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:47.870515 16505 raft_consensus.cc:2468] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 0.
I20260709 13:19:47.870947 16577 raft_consensus.cc:2468] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 0.
I20260709 13:19:47.871248 16429 raft_consensus.cc:2468] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 0.
I20260709 13:19:47.871338 16394 leader_election.cc:304] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:47.872350 16725 raft_consensus.cc:2804] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.872252 16469 leader_election.cc:304] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:47.872907 16725 raft_consensus.cc:493] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.873347 16704 raft_consensus.cc:2804] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.873658 16725 raft_consensus.cc:3060] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.873711 16704 raft_consensus.cc:493] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.874166 16704 raft_consensus.cc:3060] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.879539 16629 raft_consensus.cc:493] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.880146 16629 raft_consensus.cc:515] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.881028 16725 raft_consensus.cc:515] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.882792 16629 leader_election.cc:290] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:47.883368 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05" is_pre_election: true
I20260709 13:19:47.883147 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03" is_pre_election: true
I20260709 13:19:47.883948 16502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:47.883726 16725 leader_election.cc:290] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.881028 16704 raft_consensus.cc:515] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.884581 16429 raft_consensus.cc:2468] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:47.884802 16577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:47.885439 16502 raft_consensus.cc:2393] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 87aff7c64559468cb088f4c29879fd03 in current term 1: Already voted for candidate 9e8c173367184ea7b1698afd85c61e05 in this term.
I20260709 13:19:47.885551 16577 raft_consensus.cc:3060] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.886019 16543 leader_election.cc:304] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:47.887123 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:47.887928 16429 raft_consensus.cc:2393] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e8c173367184ea7b1698afd85c61e05 in current term 1: Already voted for candidate 87aff7c64559468cb088f4c29879fd03 in this term.
I20260709 13:19:47.888087 16704 leader_election.cc:290] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:47.888698 16629 raft_consensus.cc:2804] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.884581 16505 raft_consensus.cc:2468] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 0.
I20260709 13:19:47.889410 16629 raft_consensus.cc:493] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.889927 16629 raft_consensus.cc:3060] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.888656 16578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:47.891216 16469 leader_election.cc:304] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e8c173367184ea7b1698afd85c61e05; no voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:47.891996 16704 raft_consensus.cc:2749] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.893501 16577 raft_consensus.cc:2468] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 1.
I20260709 13:19:47.894605 16394 leader_election.cc:304] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:47.895344 16725 raft_consensus.cc:2804] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.895829 16725 raft_consensus.cc:697] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:47.895948 16629 raft_consensus.cc:515] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.896720 16725 consensus_queue.cc:237] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.898839 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:47.899097 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:47.899457 16429 raft_consensus.cc:3060] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.899808 16505 raft_consensus.cc:3060] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.906579 16429 raft_consensus.cc:2468] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
I20260709 13:19:47.906067 16328 catalog_manager.cc:5697] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 1 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.906813 16505 raft_consensus.cc:2468] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 1.
I20260709 13:19:47.907563 16629 leader_election.cc:290] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:47.908169 16544 leader_election.cc:304] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:47.909277 16629 raft_consensus.cc:2804] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.909687 16629 raft_consensus.cc:697] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:47.910446 16629 consensus_queue.cc:237] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:47.918530 16328 catalog_manager.cc:5697] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 1 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.004222 16577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "347298cd45544d4c9e195829a27fc374"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
mode: GRACEFUL
new_leader_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:43422
I20260709 13:19:48.004948 16577 raft_consensus.cc:606] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Received request to transfer leadership to TS 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:48.012509 16505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
mode: GRACEFUL
new_leader_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:50066
I20260709 13:19:48.012986 16505 raft_consensus.cc:606] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Received request to transfer leadership to TS 87aff7c64559468cb088f4c29879fd03
I20260709 13:19:48.017593 16429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:51172
I20260709 13:19:48.018152 16429 raft_consensus.cc:606] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Received request to transfer leadership to TS 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:48.023027 16429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b73127387647e98ec7fdc1a9ced251"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:51172
I20260709 13:19:48.023602 16429 raft_consensus.cc:606] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Received request to transfer leadership to TS 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:48.028506 16429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a76833a8c7784105a9e1c21f99f553e9"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:51172
I20260709 13:19:48.029042 16429 raft_consensus.cc:606] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Received request to transfer leadership to TS 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:48.034053 16577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
mode: GRACEFUL
new_leader_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:43422
I20260709 13:19:48.034713 16577 raft_consensus.cc:606] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Received request to transfer leadership to TS 9e8c173367184ea7b1698afd85c61e05
I20260709 13:19:48.039539 16429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:51172
I20260709 13:19:48.040163 16429 raft_consensus.cc:606] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Received request to transfer leadership to TS 742221ecccc942679fec78c444bd37e1
I20260709 13:19:49.056463 16781 consensus_queue.cc:1048] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.059363 16782 consensus_queue.cc:1048] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.062563 16782 consensus_queue.cc:1048] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.068751 16785 consensus_queue.cc:1048] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.071036 16782 consensus_queue.cc:1048] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.081956 16775 consensus_queue.cc:1048] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.084856 16775 consensus_queue.cc:1048] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.088541 16775 consensus_queue.cc:1048] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.096508 16781 consensus_queue.cc:1048] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.089259 16786 consensus_queue.cc:1048] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.091356 16629 raft_consensus.cc:993] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1: : Instructing follower 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:49.099041 16629 raft_consensus.cc:1081] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Signalling peer 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:49.104472 16429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "347298cd45544d4c9e195829a27fc374"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:51144
I20260709 13:19:49.105207 16429 raft_consensus.cc:493] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.105664 16429 raft_consensus.cc:3060] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.119428 16429 raft_consensus.cc:515] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.123020 16429 leader_election.cc:290] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:49.132030 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347298cd45544d4c9e195829a27fc374" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:49.132467 16777 raft_consensus.cc:993] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05: : Instructing follower 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:49.132728 16786 raft_consensus.cc:993] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1: : Instructing follower 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:49.132975 16776 raft_consensus.cc:1081] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Signalling peer 87aff7c64559468cb088f4c29879fd03 to start an election
I20260709 13:19:49.133342 16786 raft_consensus.cc:1081] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Signalling peer 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:49.132753 16575 raft_consensus.cc:3055] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.134390 16575 raft_consensus.cc:740] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:49.134876 16782 raft_consensus.cc:993] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:49.135339 16782 raft_consensus.cc:1081] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Signalling peer 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:49.135236 16575 consensus_queue.cc:260] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.136731 16575 raft_consensus.cc:3060] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.144105 16505 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:50046
I20260709 13:19:49.145005 16505 raft_consensus.cc:493] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.145572 16505 raft_consensus.cc:3060] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.147639 16775 raft_consensus.cc:993] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:49.148205 16775 raft_consensus.cc:1081] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Signalling peer 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:49.168803 16575 raft_consensus.cc:2468] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:49.180562 16394 leader_election.cc:304] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:49.182088 16773 raft_consensus.cc:2804] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.183039 16773 raft_consensus.cc:697] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:49.184235 16773 consensus_queue.cc:237] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.191490 16504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347298cd45544d4c9e195829a27fc374" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:49.191897 16429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
 from {username='slave'} at 127.0.0.1:51158
I20260709 13:19:49.192198 16504 raft_consensus.cc:3060] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.192348 16499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b73127387647e98ec7fdc1a9ced251"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:50052
I20260709 13:19:49.193739 16497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:50052
I20260709 13:19:49.194175 16499 raft_consensus.cc:493] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.194284 16497 raft_consensus.cc:493] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.194581 16499 raft_consensus.cc:3060] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.194720 16497 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.197670 16429 raft_consensus.cc:493] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.198119 16429 raft_consensus.cc:3060] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.155772 16505 raft_consensus.cc:515] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.206198 16781 raft_consensus.cc:993] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:49.206678 16781 raft_consensus.cc:1081] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Signalling peer 9e8c173367184ea7b1698afd85c61e05 to start an election
I20260709 13:19:49.210142 16501 raft_consensus.cc:1240] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Rejecting Update request from peer 742221ecccc942679fec78c444bd37e1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:49.215878 16504 raft_consensus.cc:2468] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:49.220557 16629 consensus_queue.cc:1059] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.221755 16786 raft_consensus.cc:3055] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.222091 16786 raft_consensus.cc:740] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:49.223160 16786 consensus_queue.cc:260] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.224339 16786 raft_consensus.cc:3060] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.226382 16497 raft_consensus.cc:515] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.228590 16498 raft_consensus.cc:1240] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Rejecting Update request from peer 87aff7c64559468cb088f4c29879fd03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:49.233712 16504 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a76833a8c7784105a9e1c21f99f553e9"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
 from {username='slave'} at 127.0.0.1:50052
I20260709 13:19:49.234311 16780 raft_consensus.cc:993] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:49.236063 16782 consensus_queue.cc:1059] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.236539 16497 leader_election.cc:290] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:49.236469 16780 raft_consensus.cc:1081] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Signalling peer 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:49.236128 16429 raft_consensus.cc:515] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.219496 16499 raft_consensus.cc:515] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.257825 16505 leader_election.cc:290] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:49.251667 16503 raft_consensus.cc:1240] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Rejecting Update request from peer 87aff7c64559468cb088f4c29879fd03 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:49.258612 16429 leader_election.cc:290] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Requested vote from peers 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:49.261188 16503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:49.261775 16503 raft_consensus.cc:3055] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.262085 16503 raft_consensus.cc:740] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:49.262445 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:49.262856 16503 consensus_queue.cc:260] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.263283 16430 raft_consensus.cc:3060] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.263470 16780 consensus_queue.cc:1059] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.264541 16780 raft_consensus.cc:3055] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.264617 16503 raft_consensus.cc:3060] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.264904 16780 raft_consensus.cc:740] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:49.265748 16780 consensus_queue.cc:260] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.266856 16780 raft_consensus.cc:3060] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.268082 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3689cd3dab6f4f3b83b7efd4f20d85ff" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:49.268532 16572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:49.269174 16572 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.271684 16429 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:49.275094 16430 raft_consensus.cc:2468] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:49.256443 16504 raft_consensus.cc:493] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.277621 16499 leader_election.cc:290] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:49.285856 16574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b73127387647e98ec7fdc1a9ced251" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:49.286535 16574 raft_consensus.cc:3060] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.287168 16428 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b73127387647e98ec7fdc1a9ced251" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:49.283039 16504 raft_consensus.cc:3060] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.291805 16578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:43420
I20260709 13:19:49.292644 16578 raft_consensus.cc:493] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:49.293113 16578 raft_consensus.cc:3060] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.298825 16504 raft_consensus.cc:515] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.300689 16576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce73e29b7324f93b0a3bcc3963b28b1" candidate_uuid: "87aff7c64559468cb088f4c29879fd03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:49.301309 16576 raft_consensus.cc:3060] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.302078 16503 raft_consensus.cc:2468] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:49.312722 16469 leader_election.cc:304] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:49.315083 16429 raft_consensus.cc:3055] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.315649 16429 raft_consensus.cc:740] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:49.304729 16572 raft_consensus.cc:2468] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:49.318212 16787 raft_consensus.cc:2804] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.318734 16787 raft_consensus.cc:697] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:49.319581 16787 consensus_queue.cc:237] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.316756 16429 consensus_queue.cc:260] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.320925 16578 raft_consensus.cc:515] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.323896 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:49.324550 16430 raft_consensus.cc:3055] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.324906 16430 raft_consensus.cc:740] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:49.326152 16429 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.326997 16578 leader_election.cc:290] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:49.325799 16430 consensus_queue.cc:260] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.328001 16395 leader_election.cc:304] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:49.328085 16503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cbdc20c048b4eb19cd4edfe34806718" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:49.328918 16503 raft_consensus.cc:3060] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.329139 16782 raft_consensus.cc:2804] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.329689 16782 raft_consensus.cc:697] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Becoming Leader. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:49.330148 16428 raft_consensus.cc:2468] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:49.330516 16782 consensus_queue.cc:237] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.330273 16328 catalog_manager.cc:5697] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 1 to 2, leader changed from 742221ecccc942679fec78c444bd37e1 (127.6.233.3) to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.332698 16469 leader_election.cc:304] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87aff7c64559468cb088f4c29879fd03, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:49.309872 16576 raft_consensus.cc:2468] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87aff7c64559468cb088f4c29879fd03 in term 2.
I20260709 13:19:49.336638 16429 raft_consensus.cc:2468] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:49.336333 16776 raft_consensus.cc:2804] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.337191 16430 raft_consensus.cc:3060] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.337328 16776 raft_consensus.cc:697] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:49.338274 16776 consensus_queue.cc:237] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.339551 16575 raft_consensus.cc:2468] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:49.343879 16469 leader_election.cc:304] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:49.344725 16787 raft_consensus.cc:2804] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.345247 16787 raft_consensus.cc:697] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:49.346385 16787 consensus_queue.cc:237] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.347410 16430 raft_consensus.cc:2468] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 2.
I20260709 13:19:49.345413 16574 raft_consensus.cc:2468] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:49.348932 16543 leader_election.cc:304] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:49.349973 16786 raft_consensus.cc:2804] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.350687 16786 raft_consensus.cc:697] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 2 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:49.351634 16503 raft_consensus.cc:2468] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 2.
I20260709 13:19:49.352737 16786 consensus_queue.cc:237] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.359462 16504 leader_election.cc:290] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 742221ecccc942679fec78c444bd37e1 (127.6.233.3:42185)
I20260709 13:19:49.360507 16575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76833a8c7784105a9e1c21f99f553e9" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "742221ecccc942679fec78c444bd37e1"
I20260709 13:19:49.361528 16575 raft_consensus.cc:3060] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.362960 16326 catalog_manager.cc:5697] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 1 to 2, leader changed from 742221ecccc942679fec78c444bd37e1 (127.6.233.3) to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.369110 16575 raft_consensus.cc:2468] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:49.358394 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76833a8c7784105a9e1c21f99f553e9" candidate_uuid: "9e8c173367184ea7b1698afd85c61e05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:49.370347 16430 raft_consensus.cc:3055] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:49.370498 16469 leader_election.cc:304] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:49.370718 16430 raft_consensus.cc:740] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:49.371606 16430 consensus_queue.cc:260] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.371950 16787 raft_consensus.cc:2804] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:49.372918 16430 raft_consensus.cc:3060] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:49.372852 16787 raft_consensus.cc:697] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Leader. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:49.374097 16787 consensus_queue.cc:237] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:49.378723 16430 raft_consensus.cc:2468] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8c173367184ea7b1698afd85c61e05 in term 2.
I20260709 13:19:49.382589 16324 catalog_manager.cc:5697] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 1 to 2, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.385848 16326 catalog_manager.cc:5697] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 reported cstate change: term changed from 1 to 2, leader changed from 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2) to 87aff7c64559468cb088f4c29879fd03 (127.6.233.1). New cstate: current_term: 2 leader_uuid: "87aff7c64559468cb088f4c29879fd03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.396375 16328 catalog_manager.cc:5697] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 1 to 2, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.397887 16328 catalog_manager.cc:5697] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 1 to 2, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.398876 16328 catalog_manager.cc:5697] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 reported cstate change: term changed from 1 to 2, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2). New cstate: current_term: 2 leader_uuid: "9e8c173367184ea7b1698afd85c61e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.606385 16504 raft_consensus.cc:1275] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.607664 16775 consensus_queue.cc:1048] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.617483 16574 raft_consensus.cc:1275] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.619002 16781 consensus_queue.cc:1048] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.757042 16430 raft_consensus.cc:1275] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.758344 16776 consensus_queue.cc:1048] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.767251 16574 raft_consensus.cc:1275] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.768525 16787 consensus_queue.cc:1048] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.774209 16574 raft_consensus.cc:1275] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.776407 16781 consensus_queue.cc:1048] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.776865 16574 raft_consensus.cc:1275] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.778201 16787 consensus_queue.cc:1048] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.784500 16430 raft_consensus.cc:1275] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.788865 16430 raft_consensus.cc:1275] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.788865 16504 raft_consensus.cc:1275] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.790645 16787 consensus_queue.cc:1048] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.790880 16776 consensus_queue.cc:1048] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.791232 16786 consensus_queue.cc:1048] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.798295 16504 raft_consensus.cc:1275] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 87aff7c64559468cb088f4c29879fd03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.799906 16775 consensus_queue.cc:1048] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:49.802693 16430 raft_consensus.cc:1275] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.812481 16786 consensus_queue.cc:1048] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:49.817569 16574 raft_consensus.cc:1275] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.827975 16574 raft_consensus.cc:1275] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:49.828053 16779 consensus_queue.cc:1048] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:49.834226 16779 consensus_queue.cc:1048] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:49.850785 16429 raft_consensus.cc:1275] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 9e8c173367184ea7b1698afd85c61e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:49.850782 16544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:35425, user_credentials={real_user=slave}} blocked reactor thread for 44939.1us
I20260709 13:19:49.854756 16779 consensus_queue.cc:1048] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:50.006453 16526 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9d00 after lost signal to thread 7079
W20260709 13:19:50.007601 16526 debug-util.cc:398] Leaking SignalData structure 0x7b0800159d80 after lost signal to thread 16362
W20260709 13:19:50.009002 16526 debug-util.cc:398] Leaking SignalData structure 0x7b0800218260 after lost signal to thread 16454
W20260709 13:19:50.010202 16526 debug-util.cc:398] Leaking SignalData structure 0x7b0800276fa0 after lost signal to thread 16529
W20260709 13:19:50.011224 16526 debug-util.cc:398] Leaking SignalData structure 0x7b0800090e80 after lost signal to thread 16603
I20260709 13:19:51.939451 16324 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37226:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:19:51.973726 16324 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37226:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:19:52.015223  7076 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:19:52.214205 16841 log.cc:927] Time spent T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:19:52.333179 16852 log.cc:927] Time spent T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:19:52.334410 16870 tablet.cc:1724] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.364099 16877 tablet.cc:1724] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.363903 16879 tablet.cc:1724] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.392874 16883 tablet.cc:1724] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.414610 16881 tablet.cc:1724] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:52.417308 16531 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:3689cd3dab6f4f3b83b7efd4f20d85ff)
I20260709 13:19:52.418253 16429 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:52978
I20260709 13:19:52.419179 16429 raft_consensus.cc:606] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Received request to transfer leadership to TS 742221ecccc942679fec78c444bd37e1
W20260709 13:19:52.422591 16865 log.cc:927] Time spent T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:19:52.436375 16886 tablet.cc:1724] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.437389 16889 tablet.cc:1724] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.434976 16882 tablet.cc:1724] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:52.454627 16531 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2cbdc20c048b4eb19cd4edfe34806718)
W20260709 13:19:52.476766 16531 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:2cbdc20c048b4eb19cd4edfe34806718)
I20260709 13:19:52.508488 16890 tablet.cc:1724] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.541093 16870 tablet.cc:1724] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.544763 16887 tablet.cc:1724] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:19:52.549006 16544 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.2:35425, user_credentials={real_user=slave}} blocked reactor thread for 47877.1us
I20260709 13:19:52.546447 16895 tablet.cc:1724] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.562692 16882 tablet.cc:1724] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.564425 16505 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
mode: GRACEFUL
new_leader_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:55504
I20260709 13:19:52.568596 16877 tablet.cc:1724] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.570206 16324 catalog_manager.cc:5789] TS 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425) does not have the latest schema for tablet a76833a8c7784105a9e1c21f99f553e9 (table soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]). Expected version 1 got 0
I20260709 13:19:52.573423 16889 tablet.cc:1724] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.574106 16505 raft_consensus.cc:606] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Received request to transfer leadership to TS 742221ecccc942679fec78c444bd37e1
I20260709 13:19:52.576750 16896 tablet.cc:1724] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.580651 16324 catalog_manager.cc:5789] TS 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425) does not have the latest schema for tablet d4b79bef1c3a4d24901aa94288c2700d (table soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]). Expected version 1 got 0
I20260709 13:19:52.581979 16324 catalog_manager.cc:5789] TS 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425) does not have the latest schema for tablet 02b73127387647e98ec7fdc1a9ced251 (table soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006]). Expected version 1 got 0
I20260709 13:19:52.583804 16881 tablet.cc:1724] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.585844 16862 raft_consensus.cc:993] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05: : Instructing follower 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:52.587705 16787 raft_consensus.cc:1081] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Signalling peer 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:52.582340  7076 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:19:52.590293 16886 tablet.cc:1724] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.596421 16847 raft_consensus.cc:993] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:52.597093 16773 raft_consensus.cc:1081] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Signalling peer 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:52.581403 16883 tablet.cc:1724] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.599020 16576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:43420
I20260709 13:19:52.603399 16576 raft_consensus.cc:493] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.603920 16576 raft_consensus.cc:3060] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.601291 16572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:43418
I20260709 13:19:52.609268 16572 raft_consensus.cc:493] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.609793 16572 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:52.613539 16879 tablet.cc:1724] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.617946 16886 tablet.cc:1724] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.625916 16881 tablet.cc:1724] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.629240  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:52.630544 16895 tablet.cc:1724] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.632210 16572 raft_consensus.cc:515] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.639712 16425 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0"
dest_uuid: "87aff7c64559468cb088f4c29879fd03"
mode: GRACEFUL
new_leader_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:52978
I20260709 13:19:52.639822 16430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:52.640467 16425 raft_consensus.cc:606] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Received request to transfer leadership to TS 742221ecccc942679fec78c444bd37e1
I20260709 13:19:52.640698 16430 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:52.647886 16576 raft_consensus.cc:515] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.651489 16887 tablet.cc:1724] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.652288 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:52.652627 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6214c36d361c4529888dd02a83e1924a" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:52.652979 16425 raft_consensus.cc:3055] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:52.653293 16505 raft_consensus.cc:3060] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.653399 16425 raft_consensus.cc:740] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:52.654465 16425 consensus_queue.cc:260] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.655650 16425 raft_consensus.cc:3060] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:52.661391 16505 raft_consensus.cc:2468] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 2.
I20260709 13:19:52.662885 16503 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43"
dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
mode: GRACEFUL
new_leader_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:55504
I20260709 13:19:52.664005 16503 raft_consensus.cc:606] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Received request to transfer leadership to TS 742221ecccc942679fec78c444bd37e1
I20260709 13:19:52.668721 16544 leader_election.cc:304] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:52.668314 16896 tablet.cc:1724] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.663395 16576 leader_election.cc:290] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 2 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:52.669809 16891 raft_consensus.cc:2804] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:52.670348 16891 raft_consensus.cc:697] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 2 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:52.671326 16891 consensus_queue.cc:237] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.676537  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:52.676329 16879 tablet.cc:1724] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.677176  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:52.633527 16877 tablet.cc:1724] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:19:52.688874 16425 raft_consensus.cc:2468] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 2.
I20260709 13:19:52.694103 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b79bef1c3a4d24901aa94288c2700d" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:52.694764 16505 raft_consensus.cc:3055] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:52.695091 16505 raft_consensus.cc:740] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:52.695916 16505 consensus_queue.cc:260] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.699085 16505 raft_consensus.cc:3060] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:52.707190 16505 raft_consensus.cc:2468] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 3.
I20260709 13:19:52.708317 16544 leader_election.cc:304] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:52.691637 16430 raft_consensus.cc:2468] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 3.
I20260709 13:19:52.709141 16891 raft_consensus.cc:2804] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:52.709650 16891 raft_consensus.cc:697] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 3 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:52.711465 16891 consensus_queue.cc:237] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.709154 16572 leader_election.cc:290] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 3 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:52.729076 16326 catalog_manager.cc:5697] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 1 to 2, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 2 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.730526 16326 catalog_manager.cc:5697] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 2 to 3, leader changed from 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2) to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 3 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.731832 16328 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac: soft_deleted_table [id=ca5f1ced698847b79dfd9592651c7006] alter complete (version 1)
I20260709 13:19:52.916364 16844 raft_consensus.cc:993] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03: : Instructing follower 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:52.917071 16848 raft_consensus.cc:1081] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Signalling peer 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:52.918711 16572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:43420
I20260709 13:19:52.919273 16572 raft_consensus.cc:493] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:52.919632 16572 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:52.925266 16572 raft_consensus.cc:515] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.927119 16572 leader_election.cc:290] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 3 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:52.927961 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:52.928404 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a888ed69ad9942d2a6168187b1174fc0" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:52.928829 16425 raft_consensus.cc:3055] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:52.929131 16505 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:52.929296 16425 raft_consensus.cc:740] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87aff7c64559468cb088f4c29879fd03, State: Running, Role: LEADER
I20260709 13:19:52.930457 16425 consensus_queue.cc:260] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.931988 16425 raft_consensus.cc:3060] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:52.935922 16505 raft_consensus.cc:2468] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 3.
I20260709 13:19:52.937281 16544 leader_election.cc:304] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 9e8c173367184ea7b1698afd85c61e05; no voters: 
I20260709 13:19:52.938242 16891 raft_consensus.cc:2804] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:52.938733 16891 raft_consensus.cc:697] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 3 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:52.939690 16891 consensus_queue.cc:237] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:52.941880 16425 raft_consensus.cc:2468] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 3.
I20260709 13:19:52.950692 16326 catalog_manager.cc:5697] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 2 to 3, leader changed from 87aff7c64559468cb088f4c29879fd03 (127.6.233.1) to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 3 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.053894 16779 raft_consensus.cc:993] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05: : Instructing follower 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:53.054466 16862 raft_consensus.cc:1081] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Signalling peer 742221ecccc942679fec78c444bd37e1 to start an election
I20260709 13:19:53.056358 16572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43"
dest_uuid: "742221ecccc942679fec78c444bd37e1"
 from {username='slave'} at 127.0.0.1:43418
I20260709 13:19:53.056881 16572 raft_consensus.cc:493] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:53.057201 16572 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.064083 16572 raft_consensus.cc:515] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:53.066599 16572 leader_election.cc:290] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 3 election: Requested vote from peers 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519), 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425)
I20260709 13:19:53.067423 16505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e8c173367184ea7b1698afd85c61e05"
I20260709 13:19:53.068147 16505 raft_consensus.cc:3055] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:53.068456 16505 raft_consensus.cc:740] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e8c173367184ea7b1698afd85c61e05, State: Running, Role: LEADER
I20260709 13:19:53.069832 16505 consensus_queue.cc:260] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:53.068472 16425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffdb1ea0cf34c5ebdd175d6603b1f43" candidate_uuid: "742221ecccc942679fec78c444bd37e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87aff7c64559468cb088f4c29879fd03"
I20260709 13:19:53.071072 16425 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.072786 16505 raft_consensus.cc:3060] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:53.077553 16425 raft_consensus.cc:2468] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 3.
I20260709 13:19:53.078794 16543 leader_election.cc:304] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742221ecccc942679fec78c444bd37e1, 87aff7c64559468cb088f4c29879fd03; no voters: 
I20260709 13:19:53.079527 16891 raft_consensus.cc:2804] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:53.080220 16891 raft_consensus.cc:697] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 3 LEADER]: Becoming Leader. State: Replica: 742221ecccc942679fec78c444bd37e1, State: Running, Role: LEADER
I20260709 13:19:53.080325 16505 raft_consensus.cc:2468] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742221ecccc942679fec78c444bd37e1 in term 3.
I20260709 13:19:53.081238 16891 consensus_queue.cc:237] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } }
I20260709 13:19:53.092664 16326 catalog_manager.cc:5697] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 reported cstate change: term changed from 2 to 3, leader changed from 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2) to 742221ecccc942679fec78c444bd37e1 (127.6.233.3). New cstate: current_term: 3 leader_uuid: "742221ecccc942679fec78c444bd37e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742221ecccc942679fec78c444bd37e1" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 42185 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.153805 16425 raft_consensus.cc:1275] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:19:53.155041 16891 consensus_queue.cc:1048] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:53.179553 16505 raft_consensus.cc:1275] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:19:53.180894 16905 consensus_queue.cc:1048] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:53.195086 16425 raft_consensus.cc:1275] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:53.196326 16905 consensus_queue.cc:1048] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:53.204365 16503 raft_consensus.cc:1275] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:19:53.205848 16905 consensus_queue.cc:1048] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:53.355445 16503 raft_consensus.cc:1275] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:53.356943 16905 consensus_queue.cc:1048] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:53.376552 16425 raft_consensus.cc:1275] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:53.380267 16880 consensus_queue.cc:1048] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:53.618413 16503 raft_consensus.cc:1275] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:53.619705 16905 consensus_queue.cc:1048] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e8c173367184ea7b1698afd85c61e05" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:53.630326 16430 raft_consensus.cc:1275] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Refusing update from remote peer 742221ecccc942679fec78c444bd37e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:53.635803 16880 consensus_queue.cc:1048] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87aff7c64559468cb088f4c29879fd03" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 44519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:53.744247  7076 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:19:53.749456  7076 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:19:53.749953  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:53.756356  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:19:53.756981  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:54.789299  7076 tablet_server.cc:179] TabletServer@127.6.233.1:0 shutting down...
W20260709 13:19:54.801939 16469 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 13:19:54.807065 16469 consensus_peers.cc:597] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.821673  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:54.822561  7076 tablet_replica.cc:333] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.823349  7076 raft_consensus.cc:2243] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.823844  7076 raft_consensus.cc:2272] T 02b73127387647e98ec7fdc1a9ced251 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.826116  7076 tablet_replica.cc:333] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.826754  7076 raft_consensus.cc:2243] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.827191  7076 raft_consensus.cc:2272] T 2cbdc20c048b4eb19cd4edfe34806718 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.829707  7076 tablet_replica.cc:333] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.830339  7076 raft_consensus.cc:2243] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.830770  7076 raft_consensus.cc:2272] T a76833a8c7784105a9e1c21f99f553e9 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.832831  7076 tablet_replica.cc:333] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.833386  7076 raft_consensus.cc:2243] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.834170  7076 raft_consensus.cc:2272] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.836751  7076 tablet_replica.cc:333] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.837349  7076 raft_consensus.cc:2243] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.838092  7076 raft_consensus.cc:2272] T 347298cd45544d4c9e195829a27fc374 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.840181  7076 tablet_replica.cc:333] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.840791  7076 raft_consensus.cc:2243] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.841243  7076 raft_consensus.cc:2272] T d4b79bef1c3a4d24901aa94288c2700d P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.843257  7076 tablet_replica.cc:333] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.843766  7076 raft_consensus.cc:2243] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.844245  7076 raft_consensus.cc:2272] T 6214c36d361c4529888dd02a83e1924a P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.846159  7076 tablet_replica.cc:333] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.846745  7076 raft_consensus.cc:2243] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.847524  7076 raft_consensus.cc:2272] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.850373  7076 tablet_replica.cc:333] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.851156  7076 raft_consensus.cc:2243] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.852116  7076 raft_consensus.cc:2272] T 146e62ac93d645438fb30732020e2947 P 87aff7c64559468cb088f4c29879fd03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.854413  7076 tablet_replica.cc:333] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.854899  7076 raft_consensus.cc:2243] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.855228  7076 raft_consensus.cc:2272] T a888ed69ad9942d2a6168187b1174fc0 P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.857092  7076 tablet_replica.cc:333] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.857548  7076 raft_consensus.cc:2243] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.858047  7076 raft_consensus.cc:2272] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.859849  7076 tablet_replica.cc:333] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.860363  7076 raft_consensus.cc:2243] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.860769  7076 raft_consensus.cc:2272] T d08ca935d16d40baaf79a555a2d5d42f P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.862663  7076 tablet_replica.cc:333] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.863143  7076 raft_consensus.cc:2243] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.863533  7076 raft_consensus.cc:2272] T 6b676a86e4df4581bac06bd86420bba7 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.865610  7076 tablet_replica.cc:333] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.866209  7076 raft_consensus.cc:2243] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.866801  7076 raft_consensus.cc:2272] T 16817d31c62c4d53b383f07629c93e9f P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.869315  7076 tablet_replica.cc:333] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.869848  7076 raft_consensus.cc:2243] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:54.870028 16543 consensus_peers.cc:597] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.870398  7076 raft_consensus.cc:2272] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 87aff7c64559468cb088f4c29879fd03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.872656  7076 tablet_replica.cc:333] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.873168  7076 raft_consensus.cc:2243] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.873962  7076 raft_consensus.cc:2272] T 65aaa692131c4282ae5c2c3b51f14beb P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.876220  7076 tablet_replica.cc:333] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.876791  7076 raft_consensus.cc:2243] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.877274  7076 raft_consensus.cc:2272] T 720a2c41e70f48b9ba720b3257692eef P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:54.879408  7076 tablet_replica.cc:333] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03: stopping tablet replica
I20260709 13:19:54.879817  7076 raft_consensus.cc:2243] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.880653  7076 raft_consensus.cc:2272] T 03c2f3123aef411091662c5ca1e98198 P 87aff7c64559468cb088f4c29879fd03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.891559 16469 consensus_peers.cc:597] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.921037 16543 consensus_peers.cc:597] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.923818  7076 tablet_server.cc:196] TabletServer@127.6.233.1:0 shutdown complete.
W20260709 13:19:54.953755 16469 consensus_peers.cc:597] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.961210  7076 tablet_server.cc:179] TabletServer@127.6.233.2:0 shutting down...
W20260709 13:19:54.962623 16543 consensus_peers.cc:597] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.969385 16543 consensus_peers.cc:597] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.969568 16469 consensus_peers.cc:597] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.992648  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:54.993671  7076 tablet_replica.cc:333] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:54.994733  7076 raft_consensus.cc:2243] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:54.995481  7076 raft_consensus.cc:2272] T 2cbdc20c048b4eb19cd4edfe34806718 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:54.995947 16469 consensus_peers.cc:597] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.997943  7076 tablet_replica.cc:333] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:54.998715  7076 raft_consensus.cc:2243] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:54.999485  7076 raft_consensus.cc:2272] T a76833a8c7784105a9e1c21f99f553e9 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.001523  7076 tablet_replica.cc:333] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.002090  7076 raft_consensus.cc:2243] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.002856  7076 raft_consensus.cc:2272] T 02b73127387647e98ec7fdc1a9ced251 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.005074  7076 tablet_replica.cc:333] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.005685  7076 raft_consensus.cc:2243] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.006136  7076 raft_consensus.cc:2272] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.008831  7076 tablet_replica.cc:333] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.009727  7076 raft_consensus.cc:2243] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.010272  7076 raft_consensus.cc:2272] T 146e62ac93d645438fb30732020e2947 P 9e8c173367184ea7b1698afd85c61e05 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:55.010859 16544 consensus_peers.cc:597] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 -> Peer 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425): Couldn't send request to peer 9e8c173367184ea7b1698afd85c61e05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.012552  7076 tablet_replica.cc:333] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.013201  7076 raft_consensus.cc:2243] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.013645  7076 raft_consensus.cc:2272] T d4b79bef1c3a4d24901aa94288c2700d P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.015616  7076 tablet_replica.cc:333] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.016274  7076 raft_consensus.cc:2243] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.016666  7076 raft_consensus.cc:2272] T 6214c36d361c4529888dd02a83e1924a P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.018697  7076 tablet_replica.cc:333] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.019222  7076 raft_consensus.cc:2243] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.019999  7076 raft_consensus.cc:2272] T 16817d31c62c4d53b383f07629c93e9f P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.022094  7076 tablet_replica.cc:333] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.022639  7076 raft_consensus.cc:2243] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.023059  7076 raft_consensus.cc:2272] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.025125  7076 tablet_replica.cc:333] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.025712  7076 raft_consensus.cc:2243] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.026192  7076 raft_consensus.cc:2272] T a888ed69ad9942d2a6168187b1174fc0 P 9e8c173367184ea7b1698afd85c61e05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.028147  7076 tablet_replica.cc:333] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.028720  7076 raft_consensus.cc:2243] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.029561  7076 raft_consensus.cc:2272] T 6b676a86e4df4581bac06bd86420bba7 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.031884  7076 tablet_replica.cc:333] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.032490  7076 raft_consensus.cc:2243] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.033360  7076 raft_consensus.cc:2272] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.035252  7076 tablet_replica.cc:333] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.035719  7076 raft_consensus.cc:2243] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.036465  7076 raft_consensus.cc:2272] T d08ca935d16d40baaf79a555a2d5d42f P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.038442  7076 tablet_replica.cc:333] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.038882  7076 raft_consensus.cc:2243] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.039249  7076 raft_consensus.cc:2272] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.041162  7076 tablet_replica.cc:333] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.041599  7076 raft_consensus.cc:2243] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.041961  7076 raft_consensus.cc:2272] T 347298cd45544d4c9e195829a27fc374 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.043812  7076 tablet_replica.cc:333] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.044299  7076 raft_consensus.cc:2243] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.044709  7076 raft_consensus.cc:2272] T 03c2f3123aef411091662c5ca1e98198 P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.046602  7076 tablet_replica.cc:333] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.047137  7076 raft_consensus.cc:2243] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.047533  7076 raft_consensus.cc:2272] T 65aaa692131c4282ae5c2c3b51f14beb P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.049403  7076 tablet_replica.cc:333] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05: stopping tablet replica
I20260709 13:19:55.049844  7076 raft_consensus.cc:2243] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.050210  7076 raft_consensus.cc:2272] T 720a2c41e70f48b9ba720b3257692eef P 9e8c173367184ea7b1698afd85c61e05 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:55.092305 16543 consensus_peers.cc:597] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.110595  7076 tablet_server.cc:196] TabletServer@127.6.233.2:0 shutdown complete.
W20260709 13:19:55.130625 16544 consensus_peers.cc:597] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 -> Peer 9e8c173367184ea7b1698afd85c61e05 (127.6.233.2:35425): Couldn't send request to peer 9e8c173367184ea7b1698afd85c61e05. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:35425: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:55.147117 16543 consensus_peers.cc:597] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 -> Peer 87aff7c64559468cb088f4c29879fd03 (127.6.233.1:44519): Couldn't send request to peer 87aff7c64559468cb088f4c29879fd03. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:44519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.148275  7076 tablet_server.cc:179] TabletServer@127.6.233.3:0 shutting down...
I20260709 13:19:55.178439  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:55.179250  7076 tablet_replica.cc:333] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.180238  7076 raft_consensus.cc:2243] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.181238  7076 raft_consensus.cc:2272] T 2cbdc20c048b4eb19cd4edfe34806718 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.183383  7076 tablet_replica.cc:333] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.183924  7076 raft_consensus.cc:2243] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.184372  7076 raft_consensus.cc:2272] T a76833a8c7784105a9e1c21f99f553e9 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.186379  7076 tablet_replica.cc:333] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.186985  7076 raft_consensus.cc:2243] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.187493  7076 raft_consensus.cc:2272] T 4ce73e29b7324f93b0a3bcc3963b28b1 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.189417  7076 tablet_replica.cc:333] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.189975  7076 raft_consensus.cc:2243] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.190452  7076 raft_consensus.cc:2272] T 02b73127387647e98ec7fdc1a9ced251 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.192358  7076 tablet_replica.cc:333] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.192922  7076 raft_consensus.cc:2243] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.193329  7076 raft_consensus.cc:2272] T 146e62ac93d645438fb30732020e2947 P 742221ecccc942679fec78c444bd37e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.195109  7076 tablet_replica.cc:333] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.195677  7076 raft_consensus.cc:2243] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.196447  7076 raft_consensus.cc:2272] T d4b79bef1c3a4d24901aa94288c2700d P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.198125  7076 tablet_replica.cc:333] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.198652  7076 raft_consensus.cc:2243] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.199378  7076 raft_consensus.cc:2272] T 6214c36d361c4529888dd02a83e1924a P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.201324  7076 tablet_replica.cc:333] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.201895  7076 raft_consensus.cc:2243] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.202610  7076 raft_consensus.cc:2272] T dffdb1ea0cf34c5ebdd175d6603b1f43 P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.204532  7076 tablet_replica.cc:333] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.205137  7076 raft_consensus.cc:2243] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.205705  7076 raft_consensus.cc:2272] T 3689cd3dab6f4f3b83b7efd4f20d85ff P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.207623  7076 tablet_replica.cc:333] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.208226  7076 raft_consensus.cc:2243] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.208685  7076 raft_consensus.cc:2272] T d08ca935d16d40baaf79a555a2d5d42f P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.210543  7076 tablet_replica.cc:333] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.211143  7076 raft_consensus.cc:2243] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.211917  7076 raft_consensus.cc:2272] T a888ed69ad9942d2a6168187b1174fc0 P 742221ecccc942679fec78c444bd37e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.213858  7076 tablet_replica.cc:333] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.214352  7076 raft_consensus.cc:2243] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.214821  7076 raft_consensus.cc:2272] T 6b676a86e4df4581bac06bd86420bba7 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.216890  7076 tablet_replica.cc:333] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.217389  7076 raft_consensus.cc:2243] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.217845  7076 raft_consensus.cc:2272] T c4c2dad9468a4c9a92b4cedbfe0bbd19 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.219683  7076 tablet_replica.cc:333] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.220197  7076 raft_consensus.cc:2243] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.220619  7076 raft_consensus.cc:2272] T 347298cd45544d4c9e195829a27fc374 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.222410  7076 tablet_replica.cc:333] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.222916  7076 raft_consensus.cc:2243] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.223307  7076 raft_consensus.cc:2272] T 03c2f3123aef411091662c5ca1e98198 P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.225201  7076 tablet_replica.cc:333] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.225704  7076 raft_consensus.cc:2243] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.226435  7076 raft_consensus.cc:2272] T 720a2c41e70f48b9ba720b3257692eef P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.228395  7076 tablet_replica.cc:333] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.228853  7076 raft_consensus.cc:2243] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.229290  7076 raft_consensus.cc:2272] T 65aaa692131c4282ae5c2c3b51f14beb P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.231218  7076 tablet_replica.cc:333] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1: stopping tablet replica
I20260709 13:19:55.231664  7076 raft_consensus.cc:2243] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:55.232115  7076 raft_consensus.cc:2272] T 16817d31c62c4d53b383f07629c93e9f P 742221ecccc942679fec78c444bd37e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.270908  7076 tablet_server.cc:196] TabletServer@127.6.233.3:0 shutdown complete.
I20260709 13:19:55.304652  7076 master.cc:562] Master@127.6.233.62:33387 shutting down...
I20260709 13:19:55.331459  7076 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:55.332036  7076 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:55.332405  7076 tablet_replica.cc:333] T 00000000000000000000000000000000 P c3a31e3d6e3c4648b7a2490f70b8b9ac: stopping tablet replica
I20260709 13:19:55.352910  7076 master.cc:584] Master@127.6.233.62:33387 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13480 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:19:55.403735  7076 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.233.62:33859
I20260709 13:19:55.405061  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:55.410383 16919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:55.410444 16920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:55.411653 16922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:55.413029  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:55.414142  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:55.414371  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:55.414551  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603195414531 us; error 0 us; skew 500 ppm
I20260709 13:19:55.415128  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:55.417670  7076 webserver.cc:533] Webserver started at http://127.6.233.62:40729/ using document root <none> and password file <none>
I20260709 13:19:55.418381  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:55.418649  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:55.418960  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:55.420219  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/master-0-root/instance:
uuid: "404d64f8e3be442c848a69d690526274"
format_stamp: "Formatted at 2026-07-09 13:19:55 on dist-test-slave-sjgx"
I20260709 13:19:55.424805  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:19:55.428175 16927 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.428905  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:19:55.429194  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/master-0-root
uuid: "404d64f8e3be442c848a69d690526274"
format_stamp: "Formatted at 2026-07-09 13:19:55 on dist-test-slave-sjgx"
I20260709 13:19:55.429466  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:55.455252  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:55.456501  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:55.493068  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.62:33859
I20260709 13:19:55.493196 16978 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.62:33859 every 8 connection(s)
I20260709 13:19:55.496840 16979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:55.507115 16979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274: Bootstrap starting.
I20260709 13:19:55.511742 16979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.515873 16979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274: No bootstrap required, opened a new log
I20260709 13:19:55.517918 16979 raft_consensus.cc:359] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404d64f8e3be442c848a69d690526274" member_type: VOTER }
I20260709 13:19:55.518275 16979 raft_consensus.cc:385] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.518445 16979 raft_consensus.cc:740] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 404d64f8e3be442c848a69d690526274, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.518939 16979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404d64f8e3be442c848a69d690526274" member_type: VOTER }
I20260709 13:19:55.519321 16979 raft_consensus.cc:399] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:55.519506 16979 raft_consensus.cc:493] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:55.519702 16979 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.524147 16979 raft_consensus.cc:515] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404d64f8e3be442c848a69d690526274" member_type: VOTER }
I20260709 13:19:55.524570 16979 leader_election.cc:304] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 404d64f8e3be442c848a69d690526274; no voters: 
I20260709 13:19:55.525565 16979 leader_election.cc:290] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:55.526026 16982 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.527515 16982 raft_consensus.cc:697] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 1 LEADER]: Becoming Leader. State: Replica: 404d64f8e3be442c848a69d690526274, State: Running, Role: LEADER
I20260709 13:19:55.528299 16982 consensus_queue.cc:237] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404d64f8e3be442c848a69d690526274" member_type: VOTER }
I20260709 13:19:55.528436 16979 sys_catalog.cc:565] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:55.533165 16983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "404d64f8e3be442c848a69d690526274" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404d64f8e3be442c848a69d690526274" member_type: VOTER } }
I20260709 13:19:55.533365 16984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 404d64f8e3be442c848a69d690526274. Latest consensus state: current_term: 1 leader_uuid: "404d64f8e3be442c848a69d690526274" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "404d64f8e3be442c848a69d690526274" member_type: VOTER } }
I20260709 13:19:55.533883 16983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:55.534003 16984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:55.536125 16990 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:55.541350 16990 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:55.543764  7076 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:55.550159 16990 catalog_manager.cc:1383] Generated new cluster ID: 198eca25ded64dd38b04f7fd4b515946
I20260709 13:19:55.550441 16990 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:55.563002 16990 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:55.564286 16990 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:55.577106 16990 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274: Generated new TSK 0
I20260709 13:19:55.577705 16990 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:55.610605  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:55.616377 17000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:55.617422 17001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:55.619029 17003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:55.619150  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:55.620270  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:55.620471  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:55.620654  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603195620636 us; error 0 us; skew 500 ppm
I20260709 13:19:55.621313  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:55.623468  7076 webserver.cc:533] Webserver started at http://127.6.233.1:46661/ using document root <none> and password file <none>
I20260709 13:19:55.623929  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:55.624150  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:55.624437  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:55.625476  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-0-root/instance:
uuid: "6f82dcb597824c149ec645f777a5ff6d"
format_stamp: "Formatted at 2026-07-09 13:19:55 on dist-test-slave-sjgx"
I20260709 13:19:55.629773  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:55.633019 17008 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.633716  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:19:55.634008  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-0-root
uuid: "6f82dcb597824c149ec645f777a5ff6d"
format_stamp: "Formatted at 2026-07-09 13:19:55 on dist-test-slave-sjgx"
I20260709 13:19:55.634274  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:55.651425  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:55.652678  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:55.654057  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:55.656387  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:55.656560  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.656845  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:55.656997  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.697634  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.1:43913
I20260709 13:19:55.697754 17070 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.1:43913 every 8 connection(s)
I20260709 13:19:55.702530  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:55.710561 17076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:55.711541 17075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:55.713814 17078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:55.714181  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:55.715191  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:55.715366  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:55.715493  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603195715480 us; error 0 us; skew 500 ppm
I20260709 13:19:55.715938  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:55.718063  7076 webserver.cc:533] Webserver started at http://127.6.233.2:39375/ using document root <none> and password file <none>
I20260709 13:19:55.718477  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:55.718631  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:55.718835  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:55.719957  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-1-root/instance:
uuid: "0f4d1a1667f049b09139e68d548a4b4d"
format_stamp: "Formatted at 2026-07-09 13:19:55 on dist-test-slave-sjgx"
I20260709 13:19:55.722409 17071 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33859
I20260709 13:19:55.722872 17071 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:55.723618 17071 heartbeater.cc:507] Master 127.6.233.62:33859 requested a full tablet report, sending...
I20260709 13:19:55.725216  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:19:55.726004 16944 ts_manager.cc:194] Registered new tserver with Master: 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913)
I20260709 13:19:55.728772 16944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49282
I20260709 13:19:55.730050 17083 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.731057  7076 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:19:55.731341  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-1-root
uuid: "0f4d1a1667f049b09139e68d548a4b4d"
format_stamp: "Formatted at 2026-07-09 13:19:55 on dist-test-slave-sjgx"
I20260709 13:19:55.731626  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:55.753294  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:55.754426  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:55.756263  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:55.758463  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:55.758633  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.758934  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:55.759101  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.798045  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.2:37677
I20260709 13:19:55.798156 17145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.2:37677 every 8 connection(s)
I20260709 13:19:55.802817  7076 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:55.809547 17149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:55.810824 17150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:55.814157 17152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:55.814819 17146 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33859
I20260709 13:19:55.815141  7076 server_base.cc:1061] running on GCE node
I20260709 13:19:55.815256 17146 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:55.816270  7076 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:55.816284 17146 heartbeater.cc:507] Master 127.6.233.62:33859 requested a full tablet report, sending...
W20260709 13:19:55.816664  7076 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:55.816900  7076 hybrid_clock.cc:648] HybridClock initialized: now 1783603195816879 us; error 0 us; skew 500 ppm
I20260709 13:19:55.817616  7076 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:55.818766 16944 ts_manager.cc:194] Registered new tserver with Master: 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:55.820223  7076 webserver.cc:533] Webserver started at http://127.6.233.3:38195/ using document root <none> and password file <none>
I20260709 13:19:55.820770 16944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49288
I20260709 13:19:55.820899  7076 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:55.821291  7076 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:55.821642  7076 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:55.823235  7076 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-2-root/instance:
uuid: "85faa4767a01414fb8a8844e4855490b"
format_stamp: "Formatted at 2026-07-09 13:19:55 on dist-test-slave-sjgx"
I20260709 13:19:55.827556  7076 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:55.830888 17157 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.831643  7076 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:19:55.831946  7076 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-2-root
uuid: "85faa4767a01414fb8a8844e4855490b"
format_stamp: "Formatted at 2026-07-09 13:19:55 on dist-test-slave-sjgx"
I20260709 13:19:55.832305  7076 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskq0h3kj/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602912355568-7076-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:55.855149  7076 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:55.856453  7076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:55.857892  7076 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:55.860067  7076 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:55.860308  7076 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.860549  7076 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:55.860762  7076 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:55.900590  7076 rpc_server.cc:307] RPC server started. Bound to: 127.6.233.3:44509
I20260709 13:19:55.900687 17219 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.233.3:44509 every 8 connection(s)
I20260709 13:19:55.913890 17220 heartbeater.cc:344] Connected to a master server at 127.6.233.62:33859
I20260709 13:19:55.914340 17220 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:55.915006 17220 heartbeater.cc:507] Master 127.6.233.62:33859 requested a full tablet report, sending...
I20260709 13:19:55.916970 16944 ts_manager.cc:194] Registered new tserver with Master: 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:55.917563  7076 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013809833s
I20260709 13:19:55.918793 16944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49298
I20260709 13:19:55.942426 16944 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49314:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:55.944983 16944 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:56.029873 17111 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1c173fc822467fafaf752685f855ba (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:56.031497 17111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1c173fc822467fafaf752685f855ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.033427 17110 tablet_service.cc:1511] Processing CreateTablet for tablet b1acbced6dab4e7f813b3730aa63b641 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:56.034318 17105 tablet_service.cc:1511] Processing CreateTablet for tablet beb60ee4583444808efb3a0a8e188db0 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:56.035091 17110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1acbced6dab4e7f813b3730aa63b641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.035849 17105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb60ee4583444808efb3a0a8e188db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.037257 17036 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1c173fc822467fafaf752685f855ba (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:56.038969 17036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1c173fc822467fafaf752685f855ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.037369 17033 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5a9c19139b4c0dab6c6eaa17e61444 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:56.039705 17031 tablet_service.cc:1511] Processing CreateTablet for tablet 034cfcd66ba440b889388cdbf7a863f2 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:56.040661 17033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5a9c19139b4c0dab6c6eaa17e61444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.042445 17032 tablet_service.cc:1511] Processing CreateTablet for tablet d5ebfeead72a40609742820ec626e3a0 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:56.046550 17035 tablet_service.cc:1511] Processing CreateTablet for tablet b1acbced6dab4e7f813b3730aa63b641 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:56.049659 17029 tablet_service.cc:1511] Processing CreateTablet for tablet b92af6799d364350852d45a6ac8d3d91 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:56.053872 17107 tablet_service.cc:1511] Processing CreateTablet for tablet d5ebfeead72a40609742820ec626e3a0 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:56.055816 17107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ebfeead72a40609742820ec626e3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.057665 17109 tablet_service.cc:1511] Processing CreateTablet for tablet 78b497e987ff4bd9896969fb0582918d (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:56.081974 17109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b497e987ff4bd9896969fb0582918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.061604 17108 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5a9c19139b4c0dab6c6eaa17e61444 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:56.084350 17108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5a9c19139b4c0dab6c6eaa17e61444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.064113 17034 tablet_service.cc:1511] Processing CreateTablet for tablet 78b497e987ff4bd9896969fb0582918d (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:56.066452 17028 tablet_service.cc:1511] Processing CreateTablet for tablet 639bd84656354802813590c28338f69b (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:56.029897 17106 tablet_service.cc:1511] Processing CreateTablet for tablet 034cfcd66ba440b889388cdbf7a863f2 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:56.088168 17106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034cfcd66ba440b889388cdbf7a863f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.069604 17030 tablet_service.cc:1511] Processing CreateTablet for tablet beb60ee4583444808efb3a0a8e188db0 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:56.074753 17032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ebfeead72a40609742820ec626e3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.091888 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639bd84656354802813590c28338f69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.096526 17034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b497e987ff4bd9896969fb0582918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.100920 17030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb60ee4583444808efb3a0a8e188db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.102551 17031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034cfcd66ba440b889388cdbf7a863f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.104307 17029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92af6799d364350852d45a6ac8d3d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.105914 17035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1acbced6dab4e7f813b3730aa63b641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.109525 17104 tablet_service.cc:1511] Processing CreateTablet for tablet b92af6799d364350852d45a6ac8d3d91 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:56.111147 17104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92af6799d364350852d45a6ac8d3d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.114880 17185 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1c173fc822467fafaf752685f855ba (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:19:56.117233 17184 tablet_service.cc:1511] Processing CreateTablet for tablet b1acbced6dab4e7f813b3730aa63b641 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:19:56.119413 17183 tablet_service.cc:1511] Processing CreateTablet for tablet 78b497e987ff4bd9896969fb0582918d (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:19:56.121443 17103 tablet_service.cc:1511] Processing CreateTablet for tablet 639bd84656354802813590c28338f69b (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:56.121703 17178 tablet_service.cc:1511] Processing CreateTablet for tablet b92af6799d364350852d45a6ac8d3d91 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:19:56.122952 17103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639bd84656354802813590c28338f69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.122632 17180 tablet_service.cc:1511] Processing CreateTablet for tablet 034cfcd66ba440b889388cdbf7a863f2 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:19:56.121443 17179 tablet_service.cc:1511] Processing CreateTablet for tablet beb60ee4583444808efb3a0a8e188db0 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:19:56.124733 17177 tablet_service.cc:1511] Processing CreateTablet for tablet 639bd84656354802813590c28338f69b (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:19:56.125027 17181 tablet_service.cc:1511] Processing CreateTablet for tablet d5ebfeead72a40609742820ec626e3a0 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:19:56.127483 17185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1c173fc822467fafaf752685f855ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.128189 17180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034cfcd66ba440b889388cdbf7a863f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.127761 17182 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5a9c19139b4c0dab6c6eaa17e61444 (DEFAULT_TABLE table=test-workload [id=16d1d3c726e64ddc8bea72a4e9f65ab0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:19:56.128890 17183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b497e987ff4bd9896969fb0582918d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.130223 17177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639bd84656354802813590c28338f69b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.136349 17178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92af6799d364350852d45a6ac8d3d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.137105 17184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1acbced6dab4e7f813b3730aa63b641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.140564 17182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5a9c19139b4c0dab6c6eaa17e61444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.145150 17181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ebfeead72a40609742820ec626e3a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.156422 17179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beb60ee4583444808efb3a0a8e188db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:56.160878 17235 tablet_bootstrap.cc:492] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:19:56.183594 17235 tablet_bootstrap.cc:654] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.275414 17237 tablet_bootstrap.cc:492] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.280921 17236 tablet_bootstrap.cc:492] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.282037 17237 tablet_bootstrap.cc:654] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.304167 17235 tablet_bootstrap.cc:492] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.304800 17235 ts_tablet_manager.cc:1403] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.144s	user 0.028s	sys 0.036s
I20260709 13:19:56.306638 17236 tablet_bootstrap.cc:654] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.307717 17235 raft_consensus.cc:359] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.310137 17235 raft_consensus.cc:385] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.310472 17235 raft_consensus.cc:740] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.311547 17237 tablet_bootstrap.cc:492] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.311206 17235 consensus_queue.cc:260] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.312086 17237 ts_tablet_manager.cc:1403] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.012s
I20260709 13:19:56.313421 17071 heartbeater.cc:499] Master 127.6.233.62:33859 was elected leader, sending a full tablet report...
I20260709 13:19:56.314002 17235 ts_tablet_manager.cc:1434] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:19:56.314002 17236 tablet_bootstrap.cc:492] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.314786 17236 ts_tablet_manager.cc:1403] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.007s
I20260709 13:19:56.315045 17235 tablet_bootstrap.cc:492] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:19:56.315903 17237 raft_consensus.cc:359] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.316658 17237 raft_consensus.cc:385] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.316956 17237 raft_consensus.cc:740] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.317824 17237 consensus_queue.cc:260] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.317920 17236 raft_consensus.cc:359] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.318758 17236 raft_consensus.cc:385] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.319141 17236 raft_consensus.cc:740] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.320387 17236 consensus_queue.cc:260] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.321488 17235 tablet_bootstrap.cc:654] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.335932 17235 tablet_bootstrap.cc:492] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.336261 17237 ts_tablet_manager.cc:1434] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.012s
I20260709 13:19:56.336535 17235 ts_tablet_manager.cc:1403] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:19:56.337221 17220 heartbeater.cc:499] Master 127.6.233.62:33859 was elected leader, sending a full tablet report...
I20260709 13:19:56.337565 17237 tablet_bootstrap.cc:492] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.339774 17235 raft_consensus.cc:359] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.340492 17235 raft_consensus.cc:385] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.340801 17235 raft_consensus.cc:740] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.341456 17235 consensus_queue.cc:260] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.343930 17235 ts_tablet_manager.cc:1434] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:56.344259 17237 tablet_bootstrap.cc:654] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.344992 17235 tablet_bootstrap.cc:492] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:19:56.352020 17235 tablet_bootstrap.cc:654] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.362975 17146 heartbeater.cc:499] Master 127.6.233.62:33859 was elected leader, sending a full tablet report...
I20260709 13:19:56.363575 17236 ts_tablet_manager.cc:1434] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.031s
I20260709 13:19:56.365394 17236 tablet_bootstrap.cc:492] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.363646 17235 tablet_bootstrap.cc:492] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.366290 17235 ts_tablet_manager.cc:1403] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.013s
I20260709 13:19:56.370249 17235 raft_consensus.cc:359] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.377362 17235 raft_consensus.cc:385] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.377730 17235 raft_consensus.cc:740] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.378552 17235 consensus_queue.cc:260] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.379828 17236 tablet_bootstrap.cc:654] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.382252 17235 ts_tablet_manager.cc:1434] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.006s
I20260709 13:19:56.382350 17237 tablet_bootstrap.cc:492] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.383040 17237 ts_tablet_manager.cc:1403] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.024s
I20260709 13:19:56.383401 17235 tablet_bootstrap.cc:492] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:19:56.386874 17237 raft_consensus.cc:359] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.387840 17237 raft_consensus.cc:385] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.388221 17237 raft_consensus.cc:740] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.389334 17237 consensus_queue.cc:260] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.390479 17235 tablet_bootstrap.cc:654] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.392247 17237 ts_tablet_manager.cc:1434] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.004s
I20260709 13:19:56.396797 17237 tablet_bootstrap.cc:492] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.405454 17237 tablet_bootstrap.cc:654] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:56.407238 17221 tablet.cc:2406] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:56.418612 17237 tablet_bootstrap.cc:492] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.419420 17237 ts_tablet_manager.cc:1403] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:19:56.423404 17237 raft_consensus.cc:359] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.424417 17237 raft_consensus.cc:385] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.424804 17237 raft_consensus.cc:740] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.426153 17237 consensus_queue.cc:260] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.429585 17237 ts_tablet_manager.cc:1434] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:19:56.430923 17237 tablet_bootstrap.cc:492] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.439707 17237 tablet_bootstrap.cc:654] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.452863 17237 tablet_bootstrap.cc:492] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.453665 17237 ts_tablet_manager.cc:1403] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:19:56.455662 17235 tablet_bootstrap.cc:492] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.456255 17235 ts_tablet_manager.cc:1403] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.051s
I20260709 13:19:56.456666 17237 raft_consensus.cc:359] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.457518 17237 raft_consensus.cc:385] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.457820 17237 raft_consensus.cc:740] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.458160 17236 tablet_bootstrap.cc:492] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.458722 17236 ts_tablet_manager.cc:1403] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.094s	user 0.038s	sys 0.044s
I20260709 13:19:56.458604 17237 consensus_queue.cc:260] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.459241 17235 raft_consensus.cc:359] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.460027 17235 raft_consensus.cc:385] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.460355 17235 raft_consensus.cc:740] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.461023 17237 ts_tablet_manager.cc:1434] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:56.461127 17235 consensus_queue.cc:260] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.462199 17237 tablet_bootstrap.cc:492] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.463788 17236 raft_consensus.cc:359] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.464560 17236 raft_consensus.cc:385] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.464579 17235 ts_tablet_manager.cc:1434] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:56.464883 17236 raft_consensus.cc:740] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.466012 17236 consensus_queue.cc:260] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.467765 17235 tablet_bootstrap.cc:492] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:19:56.468164 17236 ts_tablet_manager.cc:1434] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.006s
I20260709 13:19:56.468986 17237 tablet_bootstrap.cc:654] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.469151 17236 tablet_bootstrap.cc:492] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.472159 17241 raft_consensus.cc:493] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.472846 17241 raft_consensus.cc:515] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.474896 17235 tablet_bootstrap.cc:654] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.477524 17241 leader_election.cc:290] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.488785 17236 tablet_bootstrap.cc:654] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.489997 17237 tablet_bootstrap.cc:492] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.493055 17237 ts_tablet_manager.cc:1403] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.004s
I20260709 13:19:56.496882 17237 raft_consensus.cc:359] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.497786 17237 raft_consensus.cc:385] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.498095 17237 raft_consensus.cc:740] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.498809 17237 consensus_queue.cc:260] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.500494 17235 tablet_bootstrap.cc:492] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.501055 17235 ts_tablet_manager.cc:1403] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.002s
I20260709 13:19:56.502220 17236 tablet_bootstrap.cc:492] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.502771 17241 raft_consensus.cc:493] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.503288 17241 raft_consensus.cc:515] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.504070 17235 raft_consensus.cc:359] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.504810 17235 raft_consensus.cc:385] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.505100 17235 raft_consensus.cc:740] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.505442 17241 leader_election.cc:290] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.502758 17236 ts_tablet_manager.cc:1403] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.008s
I20260709 13:19:56.505787 17235 consensus_queue.cc:260] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.508247 17235 ts_tablet_manager.cc:1434] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:56.501026 17237 ts_tablet_manager.cc:1434] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:19:56.509593 17237 tablet_bootstrap.cc:492] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.509415 17236 raft_consensus.cc:359] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:56.510151 17236 raft_consensus.cc:385] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.510435 17236 raft_consensus.cc:740] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.511179 17236 consensus_queue.cc:260] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:56.513376 17236 ts_tablet_manager.cc:1434] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:19:56.514410 17236 tablet_bootstrap.cc:492] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.515648 17235 tablet_bootstrap.cc:492] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:19:56.516703 17237 tablet_bootstrap.cc:654] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.521576 17236 tablet_bootstrap.cc:654] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.524389 17235 tablet_bootstrap.cc:654] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.528842 17237 tablet_bootstrap.cc:492] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.529465 17237 ts_tablet_manager.cc:1403] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.013s
I20260709 13:19:56.532886 17236 tablet_bootstrap.cc:492] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.532743 17237 raft_consensus.cc:359] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.533474 17237 raft_consensus.cc:385] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.533504 17236 ts_tablet_manager.cc:1403] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:19:56.533984 17237 raft_consensus.cc:740] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.534065 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639bd84656354802813590c28338f69b" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:56.534819 17237 consensus_queue.cc:260] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.535641 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5a9c19139b4c0dab6c6eaa17e61444" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:56.537195 17237 ts_tablet_manager.cc:1434] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:56.538240 17237 tablet_bootstrap.cc:492] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.538985 17236 raft_consensus.cc:359] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.539731 17236 raft_consensus.cc:385] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.540036 17236 raft_consensus.cc:740] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.540983 17236 consensus_queue.cc:260] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
W20260709 13:19:56.542021 17010 leader_election.cc:343] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:56.542976 17010 leader_election.cc:343] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:56.539278 16992 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:56.545173 17237 tablet_bootstrap.cc:654] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.545228 17236 ts_tablet_manager.cc:1434] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:19:56.546465 17236 tablet_bootstrap.cc:492] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.548035 17243 raft_consensus.cc:493] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.548565 17243 raft_consensus.cc:515] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.552881 17236 tablet_bootstrap.cc:654] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.554910 17243 leader_election.cc:290] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.587713 17241 raft_consensus.cc:493] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.588565 17242 raft_consensus.cc:493] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.589114 17242 raft_consensus.cc:515] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.589229 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639bd84656354802813590c28338f69b" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:56.590216 17195 raft_consensus.cc:2468] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:19:56.588583 17241 raft_consensus.cc:515] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.597532 17241 leader_election.cc:290] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.599982 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:56.601190 17120 raft_consensus.cc:2468] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:19:56.602751 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5a9c19139b4c0dab6c6eaa17e61444" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:56.603883 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:56.604221 17195 raft_consensus.cc:2468] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:19:56.604723 17194 raft_consensus.cc:2468] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:19:56.603775 17010 leader_election.cc:304] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:19:56.607470 17241 raft_consensus.cc:2804] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.607776 17235 tablet_bootstrap.cc:492] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.607898 17241 raft_consensus.cc:493] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.608928 17011 leader_election.cc:304] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:56.593357 17242 leader_election.cc:290] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:56.615916 17242 raft_consensus.cc:493] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.616580 17242 raft_consensus.cc:515] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.618149 17241 raft_consensus.cc:3060] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.621042 17235 ts_tablet_manager.cc:1403] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.106s	user 0.028s	sys 0.030s
I20260709 13:19:56.624097 17242 leader_election.cc:290] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:56.625974 17235 raft_consensus.cc:359] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.626740 17235 raft_consensus.cc:385] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.626829 17237 tablet_bootstrap.cc:492] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.627068 17235 raft_consensus.cc:740] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.628283 17235 consensus_queue.cc:260] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.627681 17237 ts_tablet_manager.cc:1403] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.000s
I20260709 13:19:56.640880 17236 tablet_bootstrap.cc:492] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.641613 17236 ts_tablet_manager.cc:1403] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.095s	user 0.025s	sys 0.021s
I20260709 13:19:56.637558 17237 raft_consensus.cc:359] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.642391 17237 raft_consensus.cc:385] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.642859 17237 raft_consensus.cc:740] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.644119 17237 consensus_queue.cc:260] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.645598 17236 raft_consensus.cc:359] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.649565 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:56.651744 17120 raft_consensus.cc:2468] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:19:56.652058 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:56.650635 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:56.653115 17159 leader_election.cc:304] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:56.653801 17236 raft_consensus.cc:385] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.654120 17236 raft_consensus.cc:740] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
W20260709 13:19:56.654230 17086 leader_election.cc:343] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.655054 17236 consensus_queue.cc:260] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.656594 17242 raft_consensus.cc:2804] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.657022 17242 raft_consensus.cc:493] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.657235 17241 raft_consensus.cc:515] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.657368 17242 raft_consensus.cc:3060] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.664695 17241 leader_election.cc:290] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
W20260709 13:19:56.657737 17159 leader_election.cc:343] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.669064 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:56.669691 17121 raft_consensus.cc:3060] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.669693 17235 ts_tablet_manager.cc:1434] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.013s
W20260709 13:19:56.670943 17011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:44509, user_credentials={real_user=slave}} blocked reactor thread for 62260.9us
I20260709 13:19:56.671245 17235 tablet_bootstrap.cc:492] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:19:56.659045 17236 ts_tablet_manager.cc:1434] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:19:56.658078 17237 ts_tablet_manager.cc:1434] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:19:56.671769 17011 leader_election.cc:304] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:56.672938 17237 tablet_bootstrap.cc:492] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.674463 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:56.670773 17242 raft_consensus.cc:515] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.676837 17195 raft_consensus.cc:2393] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 85faa4767a01414fb8a8844e4855490b in this term.
I20260709 13:19:56.658900 17269 raft_consensus.cc:2804] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.679888 17269 raft_consensus.cc:493] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.680281 17269 raft_consensus.cc:3060] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.682636 17121 raft_consensus.cc:2468] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:19:56.684732 17236 tablet_bootstrap.cc:492] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.684593 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:56.685545 17046 raft_consensus.cc:2393] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85faa4767a01414fb8a8844e4855490b in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:19:56.691402 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:56.692353 17045 raft_consensus.cc:2468] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:19:56.692493 17044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:56.662815 17270 raft_consensus.cc:493] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.703720 17270 raft_consensus.cc:515] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.719376 17271 raft_consensus.cc:493] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.720007 17271 raft_consensus.cc:515] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.722082 17235 tablet_bootstrap.cc:654] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.726186 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:56.726681 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:56.727052 17120 raft_consensus.cc:2393] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85faa4767a01414fb8a8844e4855490b in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:19:56.727540 17043 raft_consensus.cc:2393] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85faa4767a01414fb8a8844e4855490b in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:19:56.729665 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92af6799d364350852d45a6ac8d3d91" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:56.729705 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:56.730531 17120 raft_consensus.cc:2468] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:19:56.730935 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:56.731832 17195 raft_consensus.cc:2468] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
W20260709 13:19:56.731861 17010 leader_election.cc:343] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.738022 17158 leader_election.cc:304] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:56.738257 17242 leader_election.cc:290] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:56.738111 17011 leader_election.cc:304] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:56.739125 17265 raft_consensus.cc:2804] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.739557 17265 raft_consensus.cc:493] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.735031 17010 leader_election.cc:304] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:19:56.739898 17265 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.741564 17271 leader_election.cc:290] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.742373 17271 raft_consensus.cc:2804] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.742800 17271 raft_consensus.cc:493] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.741739 17274 raft_consensus.cc:2804] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.743628 17271 raft_consensus.cc:3060] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.743774 17274 raft_consensus.cc:493] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.744720 17274 raft_consensus.cc:3060] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.746485 17269 raft_consensus.cc:515] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.748934 17265 raft_consensus.cc:515] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.749770 17237 tablet_bootstrap.cc:654] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.743639 17236 tablet_bootstrap.cc:654] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.752369 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
W20260709 13:19:56.754019 17159 leader_election.cc:343] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.756574 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:56.757228 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639bd84656354802813590c28338f69b" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:56.757972 17010 leader_election.cc:304] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 85faa4767a01414fb8a8844e4855490b
I20260709 13:19:56.758901 17269 leader_election.cc:290] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
W20260709 13:19:56.759295 17010 leader_election.cc:343] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.759552 17269 raft_consensus.cc:2804] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.718005 17241 raft_consensus.cc:2804] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.760078 17269 raft_consensus.cc:697] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:56.760157 17241 raft_consensus.cc:493] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.760617 17241 raft_consensus.cc:3060] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.761008 17269 consensus_queue.cc:237] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.761912 17235 tablet_bootstrap.cc:492] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.762714 17235 ts_tablet_manager.cc:1403] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.092s	user 0.035s	sys 0.043s
I20260709 13:19:56.761916 17271 raft_consensus.cc:515] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.764582 17158 leader_election.cc:304] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:19:56.765679 17242 raft_consensus.cc:2749] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.766637 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92af6799d364350852d45a6ac8d3d91" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:56.767290 17121 raft_consensus.cc:3060] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.767885 17271 leader_election.cc:290] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.768286 17237 tablet_bootstrap.cc:492] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.769059 17237 ts_tablet_manager.cc:1403] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.000s
I20260709 13:19:56.768376 17235 raft_consensus.cc:359] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.769858 17235 raft_consensus.cc:385] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.770308 17235 raft_consensus.cc:740] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.771515 17235 consensus_queue.cc:260] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.757251 17046 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.775842 17235 ts_tablet_manager.cc:1434] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:56.776144 17265 leader_election.cc:290] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:56.772645 17270 leader_election.cc:290] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.768326 17274 raft_consensus.cc:515] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.776958 17236 tablet_bootstrap.cc:492] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.777473 17236 ts_tablet_manager.cc:1403] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.093s	user 0.005s	sys 0.009s
W20260709 13:19:56.778118 17011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.3:44509, user_credentials={real_user=slave}} blocked reactor thread for 44464.2us
W20260709 13:19:56.779102 17084 leader_election.cc:343] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.779422 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:56.779542 17084 leader_election.cc:304] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d; no voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:19:56.779735 17274 leader_election.cc:290] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.780872 17243 raft_consensus.cc:2749] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.780972 17235 tablet_bootstrap.cc:492] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
W20260709 13:19:56.781144 17010 leader_election.cc:343] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.771816 17237 raft_consensus.cc:359] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.782392 17237 raft_consensus.cc:385] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.782675 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639bd84656354802813590c28338f69b" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:56.783295 17195 raft_consensus.cc:3060] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.784369 17236 raft_consensus.cc:359] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.785153 17236 raft_consensus.cc:385] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.785492 17236 raft_consensus.cc:740] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.786337 17236 consensus_queue.cc:260] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.788543 17235 tablet_bootstrap.cc:654] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.790057 17265 raft_consensus.cc:493] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.790616 17195 raft_consensus.cc:2468] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:19:56.790768 17265 raft_consensus.cc:515] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.794226 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92af6799d364350852d45a6ac8d3d91" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:56.794525 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034cfcd66ba440b889388cdbf7a863f2" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:56.795109 17195 raft_consensus.cc:2468] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:19:56.795387 17265 leader_election.cc:290] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:56.797788 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:56.798614 17193 raft_consensus.cc:3060] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.793327 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92af6799d364350852d45a6ac8d3d91" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:56.800506 17194 raft_consensus.cc:3060] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.795300 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034cfcd66ba440b889388cdbf7a863f2" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:56.805259 17045 raft_consensus.cc:2468] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:19:56.785737 17046 raft_consensus.cc:2468] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:19:56.806849 17158 leader_election.cc:304] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:56.795276 17120 raft_consensus.cc:2468] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:19:56.808220 17158 leader_election.cc:304] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:56.808640 17011 leader_election.cc:304] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:56.809734 17274 raft_consensus.cc:2804] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.809782 17242 raft_consensus.cc:2804] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.810290 17274 raft_consensus.cc:697] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:56.782691 17237 raft_consensus.cc:740] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.811161 17274 consensus_queue.cc:237] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.812302 17265 raft_consensus.cc:2804] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.812711 17194 raft_consensus.cc:2468] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:19:56.812800 17265 raft_consensus.cc:493] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.812553 17193 raft_consensus.cc:2468] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:19:56.813457 17265 raft_consensus.cc:3060] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.805183 17121 raft_consensus.cc:2468] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:19:56.814450 17011 leader_election.cc:304] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:56.815372 17011 leader_election.cc:304] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:56.816332 17273 raft_consensus.cc:2804] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.816605 17269 raft_consensus.cc:2804] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.816820 17273 raft_consensus.cc:697] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:56.817209 17236 ts_tablet_manager.cc:1434] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 13:19:56.817359 17269 raft_consensus.cc:697] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:56.817704 17273 consensus_queue.cc:237] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.818313 17269 consensus_queue.cc:237] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.819967 16943 catalog_manager.cc:5697] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 1 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.821297 17236 tablet_bootstrap.cc:492] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.812978 17237 consensus_queue.cc:260] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.829826 17236 tablet_bootstrap.cc:654] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.803380 17241 raft_consensus.cc:515] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.835718 17242 raft_consensus.cc:697] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:19:56.837522 17242 consensus_queue.cc:237] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.846913 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5a9c19139b4c0dab6c6eaa17e61444" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:56.848460 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5a9c19139b4c0dab6c6eaa17e61444" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:56.849334 17193 raft_consensus.cc:3060] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.850775 17243 raft_consensus.cc:493] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.851364 17243 raft_consensus.cc:515] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:56.853679 17243 leader_election.cc:290] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509), 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913)
W20260709 13:19:56.848656 17010 leader_election.cc:343] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.855736 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:56.856281 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
W20260709 13:19:56.857270 17084 leader_election.cc:343] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:56.857931 17086 leader_election.cc:343] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.858575 17086 leader_election.cc:304] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d; no voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:19:56.859361 17193 raft_consensus.cc:2468] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:19:56.847172 17241 leader_election.cc:290] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:56.860285 17243 raft_consensus.cc:2749] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.863409 17011 leader_election.cc:304] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:56.865051 17241 raft_consensus.cc:2804] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.865653 17241 raft_consensus.cc:697] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:56.866653 17241 consensus_queue.cc:237] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.872463 17237 ts_tablet_manager.cc:1434] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.011s
I20260709 13:19:56.873446 17237 tablet_bootstrap.cc:492] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:19:56.875022 17235 tablet_bootstrap.cc:492] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.875631 17235 ts_tablet_manager.cc:1403] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.027s
I20260709 13:19:56.878304 17235 raft_consensus.cc:359] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:56.878983 17235 raft_consensus.cc:385] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.879220 17237 tablet_bootstrap.cc:654] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.879314 17235 raft_consensus.cc:740] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.880419 17235 consensus_queue.cc:260] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:56.882850 17235 ts_tablet_manager.cc:1434] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:19:56.884017 17235 tablet_bootstrap.cc:492] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:19:56.891201 17235 tablet_bootstrap.cc:654] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.895713 16944 catalog_manager.cc:5697] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.903486 17235 tablet_bootstrap.cc:492] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:19:56.904261 17235 ts_tablet_manager.cc:1403] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.011s
I20260709 13:19:56.907698 17235 raft_consensus.cc:359] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.908632 17235 raft_consensus.cc:385] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.909020 17235 raft_consensus.cc:740] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.890743 17265 raft_consensus.cc:515] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.910061 17235 consensus_queue.cc:260] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.913182 17235 ts_tablet_manager.cc:1434] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:19:56.917063 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034cfcd66ba440b889388cdbf7a863f2" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:56.917685 17046 raft_consensus.cc:3060] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.922190 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034cfcd66ba440b889388cdbf7a863f2" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:56.922865 17121 raft_consensus.cc:3060] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.922957 17237 tablet_bootstrap.cc:492] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:19:56.923585 17237 ts_tablet_manager.cc:1403] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.020s
I20260709 13:19:56.923985 17236 tablet_bootstrap.cc:492] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.924603 17236 ts_tablet_manager.cc:1403] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.104s	user 0.036s	sys 0.045s
I20260709 13:19:56.925333 17265 leader_election.cc:290] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:56.928246 17236 raft_consensus.cc:359] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.929085 17236 raft_consensus.cc:385] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.929437 17236 raft_consensus.cc:740] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.930344 17236 consensus_queue.cc:260] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.931070 17237 raft_consensus.cc:359] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:56.931773 17237 raft_consensus.cc:385] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.932031 17237 raft_consensus.cc:740] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.932858 17237 consensus_queue.cc:260] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:56.933382 17236 ts_tablet_manager.cc:1434] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:56.934000 17121 raft_consensus.cc:2468] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:19:56.934640 17236 tablet_bootstrap.cc:492] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.935312 17237 ts_tablet_manager.cc:1434] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:19:56.935197 17159 leader_election.cc:304] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:56.936168 17265 raft_consensus.cc:2804] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.936579 17265 raft_consensus.cc:697] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:19:56.937230 17265 consensus_queue.cc:237] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.940793 17046 raft_consensus.cc:2468] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:19:56.945212 17236 tablet_bootstrap.cc:654] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.950125 17236 tablet_bootstrap.cc:492] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.950582 17236 ts_tablet_manager.cc:1403] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 13:19:56.950210 16942 catalog_manager.cc:5697] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 1 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.952981 17236 raft_consensus.cc:359] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.952415 16942 catalog_manager.cc:5697] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 1 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.953466 17236 raft_consensus.cc:385] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.953718 17236 raft_consensus.cc:740] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.954336 16942 catalog_manager.cc:5697] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 1 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.954375 17236 consensus_queue.cc:260] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.955852 16942 catalog_manager.cc:5697] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 1 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.956782 17236 ts_tablet_manager.cc:1434] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:56.957773 17236 tablet_bootstrap.cc:492] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:19:56.962342 17236 tablet_bootstrap.cc:654] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.966795 17236 tablet_bootstrap.cc:492] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:19:56.967243 17236 ts_tablet_manager.cc:1403] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:19:56.969061 16944 catalog_manager.cc:5697] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.969774 17236 raft_consensus.cc:359] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.970481 17236 raft_consensus.cc:385] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.970763 17236 raft_consensus.cc:740] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.971397 17236 consensus_queue.cc:260] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:56.973392 17236 ts_tablet_manager.cc:1434] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:57.032172 17243 raft_consensus.cc:493] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.032752 17243 raft_consensus.cc:515] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.034602 17243 leader_election.cc:290] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.035557 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639bd84656354802813590c28338f69b" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:57.035609 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639bd84656354802813590c28338f69b" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:57.036444 17193 raft_consensus.cc:2393] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f4d1a1667f049b09139e68d548a4b4d in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:19:57.037415 17086 leader_election.cc:304] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d; no voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:19:57.038211 17243 raft_consensus.cc:3060] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.043352 17243 raft_consensus.cc:2749] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.050315 17265 raft_consensus.cc:493] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.050871 17265 raft_consensus.cc:515] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.052634 17265 leader_election.cc:290] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:57.053447 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:57.053714 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:57.054190 17046 raft_consensus.cc:2468] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:19:57.054359 17121 raft_consensus.cc:2468] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:19:57.055267 17158 leader_election.cc:304] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:57.055960 17265 raft_consensus.cc:2804] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.056337 17265 raft_consensus.cc:493] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.056564 17265 raft_consensus.cc:3060] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.061674 17265 raft_consensus.cc:515] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.063314 17265 leader_election.cc:290] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:57.064320 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:57.064389 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:57.065234 17046 raft_consensus.cc:3060] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.065281 17121 raft_consensus.cc:3060] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.070255 17121 raft_consensus.cc:2468] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:19:57.070588 17046 raft_consensus.cc:2468] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:19:57.071301 17159 leader_election.cc:304] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:57.072147 17265 raft_consensus.cc:2804] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.072569 17265 raft_consensus.cc:697] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:19:57.073359 17265 consensus_queue.cc:237] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.080830 16942 catalog_manager.cc:5697] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.146677 17241 consensus_queue.cc:1048] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.158504 17269 consensus_queue.cc:1048] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.226418 17243 raft_consensus.cc:493] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.226857 17243 raft_consensus.cc:515] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.228511 17243 leader_election.cc:290] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.229485 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:57.229651 17193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:57.230484 17193 raft_consensus.cc:2393] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f4d1a1667f049b09139e68d548a4b4d in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:19:57.231477 17086 leader_election.cc:304] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d; no voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:19:57.232204 17243 raft_consensus.cc:3060] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.237623 17243 raft_consensus.cc:2749] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.241771 17269 consensus_queue.cc:1048] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.243575 17274 consensus_queue.cc:1048] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.251641 17243 raft_consensus.cc:493] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.252233 17243 raft_consensus.cc:515] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.254451 17243 leader_election.cc:290] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.255878 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:57.256433 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:57.257220 17046 raft_consensus.cc:2393] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f4d1a1667f049b09139e68d548a4b4d in current term 1: Already voted for candidate 85faa4767a01414fb8a8844e4855490b in this term.
I20260709 13:19:57.258512 17084 leader_election.cc:304] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d; no voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:19:57.259727 17243 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.261618 17241 consensus_queue.cc:1048] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.268286 17243 raft_consensus.cc:2749] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.273891 17273 consensus_queue.cc:1048] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.280820 17119 raft_consensus.cc:3060] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.284981 17274 consensus_queue.cc:1048] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.286439 17242 raft_consensus.cc:493] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.286945 17242 raft_consensus.cc:515] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:57.288558 17274 consensus_queue.cc:1048] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.289175 17242 leader_election.cc:290] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913)
I20260709 13:19:57.290946 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:19:57.291705 17046 raft_consensus.cc:2468] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:19:57.291810 17269 consensus_queue.cc:1048] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.293164 17273 raft_consensus.cc:493] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.293030 17117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:57.293715 17273 raft_consensus.cc:515] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:57.294060 17117 raft_consensus.cc:2468] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:19:57.294200 17158 leader_election.cc:304] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:57.295964 17273 leader_election.cc:290] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.297286 17265 raft_consensus.cc:2804] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.297561 17117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:19:57.297955 17265 raft_consensus.cc:493] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.298398 17117 raft_consensus.cc:2468] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:19:57.298502 17265 raft_consensus.cc:3060] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.299937 17010 leader_election.cc:304] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:19:57.300995 17273 raft_consensus.cc:2804] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.301431 17273 raft_consensus.cc:493] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.301841 17273 raft_consensus.cc:3060] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.306106 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:19:57.311275 17265 raft_consensus.cc:515] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:57.312893 17195 raft_consensus.cc:2393] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 85faa4767a01414fb8a8844e4855490b in this term.
I20260709 13:19:57.313926 17273 raft_consensus.cc:515] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:57.317416 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:57.318032 17119 raft_consensus.cc:3060] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.322115 17273 leader_election.cc:290] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.323670 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:57.324568 17195 raft_consensus.cc:2393] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 85faa4767a01414fb8a8844e4855490b in this term.
I20260709 13:19:57.332334 17119 raft_consensus.cc:2468] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:19:57.334079 17010 leader_election.cc:304] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 85faa4767a01414fb8a8844e4855490b
I20260709 13:19:57.335006 17241 raft_consensus.cc:2804] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.335974 17241 raft_consensus.cc:697] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:57.337474 17241 consensus_queue.cc:237] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } }
I20260709 13:19:57.330458 17242 consensus_queue.cc:1048] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.351032 17269 consensus_queue.cc:1048] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.356396 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:57.357570 17119 raft_consensus.cc:2393] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85faa4767a01414fb8a8844e4855490b in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:19:57.367725 17265 leader_election.cc:290] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913)
I20260709 13:19:57.367915 17314 consensus_queue.cc:1048] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.370749 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1c173fc822467fafaf752685f855ba" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:57.375636 17158 leader_election.cc:304] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:19:57.377329 17314 raft_consensus.cc:2749] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.382006 16943 catalog_manager.cc:5697] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 1 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.426101 17314 consensus_queue.cc:1048] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.435806 17313 consensus_queue.cc:1048] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.499344 17313 consensus_queue.cc:1048] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.510066 17312 consensus_queue.cc:1048] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.622445 17195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
mode: GRACEFUL
new_leader_uuid: "6f82dcb597824c149ec645f777a5ff6d"
 from {username='slave'} at 127.0.0.1:59498
I20260709 13:19:57.623050 17195 raft_consensus.cc:606] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Received request to transfer leadership to TS 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:19:57.642810 17046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
mode: GRACEFUL
new_leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:39990
I20260709 13:19:57.643483 17046 raft_consensus.cc:606] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Received request to transfer leadership to TS 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:57.648896 17195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "034cfcd66ba440b889388cdbf7a863f2"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
mode: GRACEFUL
new_leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:59498
I20260709 13:19:57.649372 17195 raft_consensus.cc:606] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Received request to transfer leadership to TS 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:57.654572 17195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
mode: GRACEFUL
new_leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:59498
I20260709 13:19:57.655155 17195 raft_consensus.cc:606] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Received request to transfer leadership to TS 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:57.655375 17241 raft_consensus.cc:993] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d: : Instructing follower 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:19:57.655938 17269 raft_consensus.cc:1081] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Signalling peer 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:19:57.657498 17119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:58030
I20260709 13:19:57.657932 17119 raft_consensus.cc:493] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.658205 17119 raft_consensus.cc:3060] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.660166 17046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b92af6799d364350852d45a6ac8d3d91"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
mode: GRACEFUL
new_leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:39990
I20260709 13:19:57.660781 17046 raft_consensus.cc:606] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Received request to transfer leadership to TS 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:19:57.663885 17119 raft_consensus.cc:515] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.665745 17046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "639bd84656354802813590c28338f69b"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
mode: GRACEFUL
new_leader_uuid: "85faa4767a01414fb8a8844e4855490b"
 from {username='slave'} at 127.0.0.1:39990
I20260709 13:19:57.666195 17119 leader_election.cc:290] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.666428 17046 raft_consensus.cc:606] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Received request to transfer leadership to TS 85faa4767a01414fb8a8844e4855490b
I20260709 13:19:57.666477 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:57.666759 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ebfeead72a40609742820ec626e3a0" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:57.667230 17045 raft_consensus.cc:3055] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.667433 17195 raft_consensus.cc:3060] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.667632 17045 raft_consensus.cc:740] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:57.668658 17045 consensus_queue.cc:260] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.669612 17045 raft_consensus.cc:3060] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.672487 17195 raft_consensus.cc:2468] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:19:57.673565 17086 leader_election.cc:304] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:57.674244 17243 raft_consensus.cc:2804] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.674661 17243 raft_consensus.cc:697] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:19:57.675447 17243 consensus_queue.cc:237] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.675907 17045 raft_consensus.cc:2468] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:19:57.681738 16941 catalog_manager.cc:5697] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 1 to 2, leader changed from 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1) to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 2 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.687031 17273 raft_consensus.cc:993] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d: : Instructing follower 85faa4767a01414fb8a8844e4855490b to start an election
I20260709 13:19:57.687606 17269 raft_consensus.cc:1081] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Signalling peer 85faa4767a01414fb8a8844e4855490b to start an election
I20260709 13:19:57.689249 17195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "639bd84656354802813590c28338f69b"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
 from {username='slave'} at 127.0.0.1:59476
I20260709 13:19:57.689795 17195 raft_consensus.cc:493] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.690164 17195 raft_consensus.cc:3060] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.697021 17195 raft_consensus.cc:515] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.698618 17195 leader_election.cc:290] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:19:57.699353 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639bd84656354802813590c28338f69b" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:57.699647 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639bd84656354802813590c28338f69b" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:57.700027 17045 raft_consensus.cc:3055] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.700296 17119 raft_consensus.cc:3060] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.700428 17045 raft_consensus.cc:740] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:57.701316 17045 consensus_queue.cc:260] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.702535 17045 raft_consensus.cc:3060] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.707242 17119 raft_consensus.cc:2468] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 2.
I20260709 13:19:57.708560 17159 leader_election.cc:304] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:57.709275 17312 raft_consensus.cc:2804] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.709254 17045 raft_consensus.cc:2468] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 2.
I20260709 13:19:57.710031 17312 raft_consensus.cc:697] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 2 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:19:57.710811 17312 consensus_queue.cc:237] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.717293 16941 catalog_manager.cc:5697] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 1 to 2, leader changed from 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1) to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 2 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.755939 17269 consensus_queue.cc:1048] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.766687 17241 consensus_queue.cc:1048] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.875414 17241 raft_consensus.cc:993] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d: : Instructing follower 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:19:57.875922 17274 raft_consensus.cc:1081] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Signalling peer 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:19:57.877457 17119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b92af6799d364350852d45a6ac8d3d91"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:58030
I20260709 13:19:57.878484 17119 raft_consensus.cc:493] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.878859 17119 raft_consensus.cc:3060] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.884546 17119 raft_consensus.cc:515] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.886221 17119 leader_election.cc:290] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.887027 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92af6799d364350852d45a6ac8d3d91" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:57.887310 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92af6799d364350852d45a6ac8d3d91" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:57.887669 17045 raft_consensus.cc:3055] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.887970 17195 raft_consensus.cc:3060] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.888114 17312 raft_consensus.cc:993] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b: : Instructing follower 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:19:57.888204 17045 raft_consensus.cc:740] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:57.888752 17265 raft_consensus.cc:1081] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Signalling peer 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:19:57.889223 17045 consensus_queue.cc:260] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.891469 17045 raft_consensus.cc:3060] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.891482 17119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:58044
I20260709 13:19:57.892189 17119 raft_consensus.cc:493] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.892580 17119 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.894045 17195 raft_consensus.cc:2468] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:19:57.894703 17193 raft_consensus.cc:1240] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Rejecting Update request from peer 6f82dcb597824c149ec645f777a5ff6d for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:57.895192 17086 leader_election.cc:304] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:57.896165 17243 raft_consensus.cc:2804] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.896646 17243 raft_consensus.cc:697] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:19:57.897466 17243 consensus_queue.cc:237] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.898847 17045 raft_consensus.cc:2468] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:19:57.899971 17119 raft_consensus.cc:515] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.901947 17119 leader_election.cc:290] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.903119 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:57.903743 17195 raft_consensus.cc:3055] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.904129 17195 raft_consensus.cc:740] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:19:57.904901 17195 consensus_queue.cc:260] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.906172 17195 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.905934 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:57.905938 16941 catalog_manager.cc:5697] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 1 to 2, leader changed from 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1) to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 2 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.907156 17045 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.913280 17195 raft_consensus.cc:2468] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:19:57.913932 17045 raft_consensus.cc:2468] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:19:57.914655 17086 leader_election.cc:304] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:19:57.915416 17243 raft_consensus.cc:2804] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.915881 17243 raft_consensus.cc:697] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:19:57.916580 17243 consensus_queue.cc:237] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.922488 16941 catalog_manager.cc:5697] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 1 to 2, leader changed from 85faa4767a01414fb8a8844e4855490b (127.6.233.3) to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 2 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.955619 17283 raft_consensus.cc:993] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b: : Instructing follower 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:19:57.956143 17312 raft_consensus.cc:1081] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Signalling peer 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:19:57.957659 17119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "034cfcd66ba440b889388cdbf7a863f2"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:58044
I20260709 13:19:57.958140 17119 raft_consensus.cc:493] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.958437 17119 raft_consensus.cc:3060] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.963208 17119 raft_consensus.cc:515] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.964852 17119 leader_election.cc:290] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.965639 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034cfcd66ba440b889388cdbf7a863f2" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:19:57.965801 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "034cfcd66ba440b889388cdbf7a863f2" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:57.966331 17045 raft_consensus.cc:3060] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.966419 17195 raft_consensus.cc:3055] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.966832 17195 raft_consensus.cc:740] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:19:57.967536 17195 consensus_queue.cc:260] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.968495 17195 raft_consensus.cc:3060] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.971357 17045 raft_consensus.cc:2468] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:19:57.972409 17084 leader_election.cc:304] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:19:57.973091 17243 raft_consensus.cc:2804] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.973439 17195 raft_consensus.cc:2468] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:19:57.973479 17243 raft_consensus.cc:697] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:19:57.974581 17243 consensus_queue.cc:237] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.980538 17283 raft_consensus.cc:993] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b: : Instructing follower 6f82dcb597824c149ec645f777a5ff6d to start an election
I20260709 13:19:57.981016 17312 raft_consensus.cc:1081] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Signalling peer 6f82dcb597824c149ec645f777a5ff6d to start an election
I20260709 13:19:57.981258 16941 catalog_manager.cc:5697] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 1 to 2, leader changed from 85faa4767a01414fb8a8844e4855490b (127.6.233.3) to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 2 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.982458 17045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
 from {username='slave'} at 127.0.0.1:39976
I20260709 13:19:57.983044 17045 raft_consensus.cc:493] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.983398 17045 raft_consensus.cc:3060] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.989033 17045 raft_consensus.cc:515] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.990789 17045 leader_election.cc:290] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 2 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:19:57.991472 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:19:57.991839 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1acbced6dab4e7f813b3730aa63b641" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:19:57.992146 17119 raft_consensus.cc:3060] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.992479 17195 raft_consensus.cc:3055] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.992791 17195 raft_consensus.cc:740] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:19:57.993436 17195 consensus_queue.cc:260] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:57.994390 17195 raft_consensus.cc:3060] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.997473 17119 raft_consensus.cc:2468] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 2.
I20260709 13:19:57.998546 17010 leader_election.cc:304] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:19:57.999353 17241 raft_consensus.cc:2804] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.999552 17195 raft_consensus.cc:2468] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 2.
I20260709 13:19:57.999782 17241 raft_consensus.cc:697] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 2 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:19:58.000929 17241 consensus_queue.cc:237] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:19:58.006950 16941 catalog_manager.cc:5697] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 1 to 2, leader changed from 85faa4767a01414fb8a8844e4855490b (127.6.233.3) to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 2 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.189764 17045 raft_consensus.cc:1275] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.190948 17243 consensus_queue.cc:1048] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.199589 17195 raft_consensus.cc:1275] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.201596 17243 consensus_queue.cc:1048] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.252957 17045 raft_consensus.cc:1275] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 85faa4767a01414fb8a8844e4855490b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.254313 17312 consensus_queue.cc:1048] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.262861 17119 raft_consensus.cc:1275] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Refusing update from remote peer 85faa4767a01414fb8a8844e4855490b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.264585 17265 consensus_queue.cc:1048] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.317147 17045 raft_consensus.cc:1275] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.318399 17243 consensus_queue.cc:1048] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.320935 17195 raft_consensus.cc:1275] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.322346 17327 consensus_queue.cc:1048] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.327055 17193 raft_consensus.cc:1275] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.328740 17327 consensus_queue.cc:1048] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.336674 17045 raft_consensus.cc:1275] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.340606 17243 consensus_queue.cc:1048] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.445714 17195 raft_consensus.cc:1275] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 6f82dcb597824c149ec645f777a5ff6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.446969 17273 consensus_queue.cc:1048] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.454288 17119 raft_consensus.cc:1275] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Refusing update from remote peer 6f82dcb597824c149ec645f777a5ff6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.456010 17241 consensus_queue.cc:1048] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.471000 17195 raft_consensus.cc:1275] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.472273 17243 consensus_queue.cc:1048] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.482018 17045 raft_consensus.cc:1275] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.483392 17327 consensus_queue.cc:1048] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:00.694746 16942 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49320:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:00.697305 16942 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:00.749281 17035 tablet_service.cc:1511] Processing CreateTablet for tablet d5ff0a0b20a143d0aaf15d6d82b08f45 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:00.750605 17035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ff0a0b20a143d0aaf15d6d82b08f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.750765 17105 tablet_service.cc:1511] Processing CreateTablet for tablet d5ff0a0b20a143d0aaf15d6d82b08f45 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:00.751019 17185 tablet_service.cc:1511] Processing CreateTablet for tablet d5ff0a0b20a143d0aaf15d6d82b08f45 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:00.751992 17105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ff0a0b20a143d0aaf15d6d82b08f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.752290 17185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ff0a0b20a143d0aaf15d6d82b08f45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.755553 17184 tablet_service.cc:1511] Processing CreateTablet for tablet 250e32bf965640efb0235518efa212b4 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:00.756868 17184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 250e32bf965640efb0235518efa212b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.759083 17110 tablet_service.cc:1511] Processing CreateTablet for tablet 56b6d36b98fc47afbda83f58ac7adf58 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:00.760416 17110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b6d36b98fc47afbda83f58ac7adf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.761029 17103 tablet_service.cc:1511] Processing CreateTablet for tablet 250e32bf965640efb0235518efa212b4 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:00.762290 17103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 250e32bf965640efb0235518efa212b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.765019 17183 tablet_service.cc:1511] Processing CreateTablet for tablet 56b6d36b98fc47afbda83f58ac7adf58 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:00.766415 17183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b6d36b98fc47afbda83f58ac7adf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.767060 17182 tablet_service.cc:1511] Processing CreateTablet for tablet d9cda90506714a9d8655e5443db45963 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:00.769006 17031 tablet_service.cc:1511] Processing CreateTablet for tablet 56b6d36b98fc47afbda83f58ac7adf58 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:00.765161 17036 tablet_service.cc:1511] Processing CreateTablet for tablet 250e32bf965640efb0235518efa212b4 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:00.770298 17031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b6d36b98fc47afbda83f58ac7adf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.772848 17036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 250e32bf965640efb0235518efa212b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.772593 17178 tablet_service.cc:1511] Processing CreateTablet for tablet cc33975be71a405f899d804b0d704b6d (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:00.775935 17029 tablet_service.cc:1511] Processing CreateTablet for tablet d9cda90506714a9d8655e5443db45963 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:00.776701 17030 tablet_service.cc:1511] Processing CreateTablet for tablet cc33975be71a405f899d804b0d704b6d (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:00.777281 17029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cda90506714a9d8655e5443db45963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.777000 17033 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba57d823da747d9acf8c7897a26c8b4 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:00.778007 17030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc33975be71a405f899d804b0d704b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.778630 17033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba57d823da747d9acf8c7897a26c8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.779286 17181 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba57d823da747d9acf8c7897a26c8b4 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:00.780990 17177 tablet_service.cc:1511] Processing CreateTablet for tablet c65eb3ac940443fb9e3bd22a362ca078 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:00.782516 17177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65eb3ac940443fb9e3bd22a362ca078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.782672 17032 tablet_service.cc:1511] Processing CreateTablet for tablet c65eb3ac940443fb9e3bd22a362ca078 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:00.784394 17032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65eb3ac940443fb9e3bd22a362ca078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.786798 17178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc33975be71a405f899d804b0d704b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.789059 17181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba57d823da747d9acf8c7897a26c8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.789834 17182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cda90506714a9d8655e5443db45963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.804644 17034 tablet_service.cc:1511] Processing CreateTablet for tablet 305dfc44e6ec46ed98df510d917e6250 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:00.806841 17034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305dfc44e6ec46ed98df510d917e6250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.813871 17108 tablet_service.cc:1511] Processing CreateTablet for tablet d9cda90506714a9d8655e5443db45963 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:00.815305 17108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9cda90506714a9d8655e5443db45963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.816434 17106 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba57d823da747d9acf8c7897a26c8b4 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:00.817011 17109 tablet_service.cc:1511] Processing CreateTablet for tablet cc33975be71a405f899d804b0d704b6d (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:00.817935 17106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba57d823da747d9acf8c7897a26c8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.818681 17109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc33975be71a405f899d804b0d704b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.822589 17111 tablet_service.cc:1511] Processing CreateTablet for tablet 305dfc44e6ec46ed98df510d917e6250 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:00.824636 17107 tablet_service.cc:1511] Processing CreateTablet for tablet c65eb3ac940443fb9e3bd22a362ca078 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:00.826538 17111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305dfc44e6ec46ed98df510d917e6250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.831509 17107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65eb3ac940443fb9e3bd22a362ca078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.850729 17180 tablet_service.cc:1511] Processing CreateTablet for tablet 305dfc44e6ec46ed98df510d917e6250 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:00.852288 17180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305dfc44e6ec46ed98df510d917e6250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.873101 17028 tablet_service.cc:1511] Processing CreateTablet for tablet c28d0ef9c91f454aac86f19472e7daa1 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:00.874455 17028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28d0ef9c91f454aac86f19472e7daa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.883301 17104 tablet_service.cc:1511] Processing CreateTablet for tablet c28d0ef9c91f454aac86f19472e7daa1 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:00.889130 17181 tablet_service.cc:1511] Processing CreateTablet for tablet c28d0ef9c91f454aac86f19472e7daa1 (DEFAULT_TABLE table=soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:00.890529 17181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28d0ef9c91f454aac86f19472e7daa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.885149 17104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28d0ef9c91f454aac86f19472e7daa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:00.945508 17349 tablet_bootstrap.cc:492] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:00.951144 17348 tablet_bootstrap.cc:492] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:00.959599 17349 tablet_bootstrap.cc:654] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:00.975767 17350 tablet_bootstrap.cc:492] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:00.981485 17348 tablet_bootstrap.cc:654] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:00.984884 17349 tablet_bootstrap.cc:492] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:00.985670 17349 ts_tablet_manager.cc:1403] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.005s
I20260709 13:20:00.988166 17349 raft_consensus.cc:359] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:00.989030 17349 raft_consensus.cc:385] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:00.989390 17349 raft_consensus.cc:740] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.990137 17350 tablet_bootstrap.cc:654] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:00.990070 17349 consensus_queue.cc:260] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:00.991232 17348 tablet_bootstrap.cc:492] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:00.991889 17348 ts_tablet_manager.cc:1403] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.010s
I20260709 13:20:00.992627 17349 ts_tablet_manager.cc:1434] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:20:00.993866 17349 tablet_bootstrap.cc:492] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:00.995843 17348 raft_consensus.cc:359] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:00.997043 17348 raft_consensus.cc:385] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.001993 17349 tablet_bootstrap.cc:654] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:00.997452 17348 raft_consensus.cc:740] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.004469 17348 consensus_queue.cc:260] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.007508 17348 ts_tablet_manager.cc:1434] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:20:01.009084 17348 tablet_bootstrap.cc:492] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:01.016130 17348 tablet_bootstrap.cc:654] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.025910 17350 tablet_bootstrap.cc:492] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.026489 17350 ts_tablet_manager.cc:1403] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.008s
I20260709 13:20:01.027787 17349 tablet_bootstrap.cc:492] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:01.028488 17349 ts_tablet_manager.cc:1403] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.011s
I20260709 13:20:01.029716 17350 raft_consensus.cc:359] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.030366 17348 tablet_bootstrap.cc:492] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:01.030617 17350 raft_consensus.cc:385] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.030941 17348 ts_tablet_manager.cc:1403] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.010s
I20260709 13:20:01.030946 17350 raft_consensus.cc:740] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.031239 17349 raft_consensus.cc:359] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.032100 17350 consensus_queue.cc:260] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.032605 17349 raft_consensus.cc:385] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.034942 17350 ts_tablet_manager.cc:1434] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:01.032995 17349 raft_consensus.cc:740] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.034869 17348 raft_consensus.cc:359] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.036186 17348 raft_consensus.cc:385] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.035998 17349 consensus_queue.cc:260] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.036543 17348 raft_consensus.cc:740] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.038329 17349 ts_tablet_manager.cc:1434] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:20:01.039294 17349 tablet_bootstrap.cc:492] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:01.040230 17348 consensus_queue.cc:260] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.042608 17348 ts_tablet_manager.cc:1434] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:20:01.043532 17348 tablet_bootstrap.cc:492] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:01.045775 17349 tablet_bootstrap.cc:654] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.048882 17350 tablet_bootstrap.cc:492] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:01.051906 17348 tablet_bootstrap.cc:654] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.056304 17350 tablet_bootstrap.cc:654] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.061514 17243 raft_consensus.cc:493] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.062065 17243 raft_consensus.cc:515] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.062844 17348 tablet_bootstrap.cc:492] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:01.063330 17350 tablet_bootstrap.cc:492] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.063387 17348 ts_tablet_manager.cc:1403] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.005s
I20260709 13:20:01.063596 17349 tablet_bootstrap.cc:492] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:01.064235 17349 ts_tablet_manager.cc:1403] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 13:20:01.065275 17350 ts_tablet_manager.cc:1403] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:20:01.065402 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cda90506714a9d8655e5443db45963" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
W20260709 13:20:01.067189 17084 leader_election.cc:343] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.066969 17348 raft_consensus.cc:359] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.067605 17243 leader_election.cc:290] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.067799 17348 raft_consensus.cc:385] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.068219 17348 raft_consensus.cc:740] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.067233 17349 raft_consensus.cc:359] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.068542 17350 raft_consensus.cc:359] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.069072 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cda90506714a9d8655e5443db45963" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.069089 17349 raft_consensus.cc:385] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.069376 17350 raft_consensus.cc:385] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.069829 17349 raft_consensus.cc:740] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.069931 17350 raft_consensus.cc:740] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.069195 17348 consensus_queue.cc:260] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.071174 17350 consensus_queue.cc:260] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.073799 17350 ts_tablet_manager.cc:1434] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
W20260709 13:20:01.070709 17086 leader_election.cc:343] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.070981 17349 consensus_queue.cc:260] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.074433 17086 leader_election.cc:304] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d; no voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:01.074764 17350 tablet_bootstrap.cc:492] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:01.075330 17243 raft_consensus.cc:2749] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:01.076671 17348 ts_tablet_manager.cc:1434] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:20:01.077780 17348 tablet_bootstrap.cc:492] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:01.079466 17349 ts_tablet_manager.cc:1434] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:20:01.080612 17349 tablet_bootstrap.cc:492] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:01.085602 17348 tablet_bootstrap.cc:654] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.090660 17349 tablet_bootstrap.cc:654] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.092561 17348 tablet_bootstrap.cc:492] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:01.093231 17348 ts_tablet_manager.cc:1403] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:20:01.096467 17349 tablet_bootstrap.cc:492] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:01.096968 17349 ts_tablet_manager.cc:1403] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.005s
I20260709 13:20:01.096815 17348 raft_consensus.cc:359] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.097811 17348 raft_consensus.cc:385] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.098166 17348 raft_consensus.cc:740] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.099020 17348 consensus_queue.cc:260] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.099658 17350 tablet_bootstrap.cc:654] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.099625 17349 raft_consensus.cc:359] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.100414 17349 raft_consensus.cc:385] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.100715 17349 raft_consensus.cc:740] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.101884 17348 ts_tablet_manager.cc:1434] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:01.101543 17349 consensus_queue.cc:260] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.103219 17348 tablet_bootstrap.cc:492] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:01.104143 17349 ts_tablet_manager.cc:1434] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:01.110025 17349 tablet_bootstrap.cc:492] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:01.113785 17348 tablet_bootstrap.cc:654] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.118175 17349 tablet_bootstrap.cc:654] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.122916 17348 tablet_bootstrap.cc:492] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:01.123423 17348 ts_tablet_manager.cc:1403] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:20:01.124176 17350 tablet_bootstrap.cc:492] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.124580 17349 tablet_bootstrap.cc:492] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:01.124645 17350 ts_tablet_manager.cc:1403] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.016s
I20260709 13:20:01.125202 17349 ts_tablet_manager.cc:1403] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 13:20:01.126428 17348 raft_consensus.cc:359] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.127192 17348 raft_consensus.cc:385] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.127532 17348 raft_consensus.cc:740] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.127310 17350 raft_consensus.cc:359] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.128149 17350 raft_consensus.cc:385] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.128232 17349 raft_consensus.cc:359] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.128551 17350 raft_consensus.cc:740] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.129017 17349 raft_consensus.cc:385] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.128432 17348 consensus_queue.cc:260] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.129339 17349 raft_consensus.cc:740] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.129485 17350 consensus_queue.cc:260] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.130385 17349 consensus_queue.cc:260] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.132369 17350 ts_tablet_manager.cc:1434] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:01.133574 17350 tablet_bootstrap.cc:492] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:01.134430 17349 ts_tablet_manager.cc:1434] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:01.135457 17349 tablet_bootstrap.cc:492] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:01.140201 17350 tablet_bootstrap.cc:654] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.141745 17349 tablet_bootstrap.cc:654] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.143570 17348 ts_tablet_manager.cc:1434] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:20:01.145087 17348 tablet_bootstrap.cc:492] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:01.148216 17350 tablet_bootstrap.cc:492] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.148839 17350 ts_tablet_manager.cc:1403] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:20:01.151516 17348 tablet_bootstrap.cc:654] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.151803 17350 raft_consensus.cc:359] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.153724 17350 raft_consensus.cc:385] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.154021 17350 raft_consensus.cc:740] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.154738 17349 tablet_bootstrap.cc:492] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:01.155256 17349 ts_tablet_manager.cc:1403] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:20:01.155001 17350 consensus_queue.cc:260] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.158406 17349 raft_consensus.cc:359] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.159096 17349 raft_consensus.cc:385] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.159397 17349 raft_consensus.cc:740] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.160188 17349 consensus_queue.cc:260] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.162273 17350 ts_tablet_manager.cc:1434] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:20:01.162551 17349 ts_tablet_manager.cc:1434] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:01.163369 17350 tablet_bootstrap.cc:492] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:01.163978 17349 tablet_bootstrap.cc:492] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:01.166497 17348 tablet_bootstrap.cc:492] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:01.167061 17348 ts_tablet_manager.cc:1403] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 13:20:01.170579 17350 tablet_bootstrap.cc:654] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.171350 17349 tablet_bootstrap.cc:654] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.170198 17348 raft_consensus.cc:359] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.174268 17348 raft_consensus.cc:385] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.174664 17348 raft_consensus.cc:740] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.175678 17348 consensus_queue.cc:260] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.178851 17348 ts_tablet_manager.cc:1434] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:20:01.180119 17348 tablet_bootstrap.cc:492] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:01.188566 17349 tablet_bootstrap.cc:492] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:01.189162 17349 ts_tablet_manager.cc:1403] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.016s
I20260709 13:20:01.189314 17348 tablet_bootstrap.cc:654] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.189513 17350 tablet_bootstrap.cc:492] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.190002 17350 ts_tablet_manager.cc:1403] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.000s
I20260709 13:20:01.192166 17349 raft_consensus.cc:359] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.192934 17349 raft_consensus.cc:385] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.193220 17349 raft_consensus.cc:740] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.193298 17350 raft_consensus.cc:359] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.193931 17349 consensus_queue.cc:260] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.194324 17350 raft_consensus.cc:385] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.194761 17350 raft_consensus.cc:740] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.196178 17349 ts_tablet_manager.cc:1434] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:20:01.195600 17350 consensus_queue.cc:260] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.197213 17349 tablet_bootstrap.cc:492] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:01.201313 17350 ts_tablet_manager.cc:1434] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:01.201412 17348 tablet_bootstrap.cc:492] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:01.202095 17348 ts_tablet_manager.cc:1403] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:20:01.202557 17350 tablet_bootstrap.cc:492] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:01.203764 17349 tablet_bootstrap.cc:654] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.205421 17348 raft_consensus.cc:359] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.206424 17348 raft_consensus.cc:385] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.206777 17348 raft_consensus.cc:740] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.207723 17348 consensus_queue.cc:260] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.210922 17348 ts_tablet_manager.cc:1434] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:20:01.211941 17348 tablet_bootstrap.cc:492] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:01.214689 17349 tablet_bootstrap.cc:492] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:01.215237 17349 ts_tablet_manager.cc:1403] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:20:01.218963 17348 tablet_bootstrap.cc:654] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.220151 17350 tablet_bootstrap.cc:654] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.224594 17348 tablet_bootstrap.cc:492] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:01.224365 17349 raft_consensus.cc:359] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.225085 17349 raft_consensus.cc:385] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.225199 17348 ts_tablet_manager.cc:1403] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:20:01.225471 17349 raft_consensus.cc:740] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.226217 17350 tablet_bootstrap.cc:492] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.226824 17350 ts_tablet_manager.cc:1403] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.005s
I20260709 13:20:01.226517 17349 consensus_queue.cc:260] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.228742 17348 raft_consensus.cc:359] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.229157 17349 ts_tablet_manager.cc:1434] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:20:01.229453 17348 raft_consensus.cc:385] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.229734 17348 raft_consensus.cc:740] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.230230 17349 tablet_bootstrap.cc:492] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d: Bootstrap starting.
I20260709 13:20:01.230401 17348 consensus_queue.cc:260] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.232743 17348 ts_tablet_manager.cc:1434] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:01.267647 17335 raft_consensus.cc:493] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.329077 17349 tablet_bootstrap.cc:654] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.284289 17335 raft_consensus.cc:515] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.276990 17350 raft_consensus.cc:359] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.330436 17350 raft_consensus.cc:385] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.325675 17355 raft_consensus.cc:493] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.335712 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.283398 17348 tablet_bootstrap.cc:492] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b: Bootstrap starting.
I20260709 13:20:01.333175 17335 leader_election.cc:290] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.339210 17335 raft_consensus.cc:493] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.304145 17337 raft_consensus.cc:493] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.343111 17335 raft_consensus.cc:515] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.339408 17355 raft_consensus.cc:515] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
W20260709 13:20:01.347637 17158 leader_election.cc:343] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.353085 17348 tablet_bootstrap.cc:654] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.343649 17337 raft_consensus.cc:515] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.354120 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.330891 17350 raft_consensus.cc:740] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.358223 17335 leader_election.cc:290] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.376062 17335 raft_consensus.cc:493] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.375415 17119 raft_consensus.cc:2468] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:20:01.376629 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57d823da747d9acf8c7897a26c8b4" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.378340 17120 raft_consensus.cc:2468] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:20:01.380005 17355 leader_election.cc:290] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.381099 17159 leader_election.cc:304] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:01.381588 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.381340 17350 consensus_queue.cc:260] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.382507 17195 raft_consensus.cc:2468] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 0.
I20260709 13:20:01.382714 17159 leader_election.cc:304] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.385972 17375 raft_consensus.cc:2804] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.386544 17375 raft_consensus.cc:493] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.386946 17375 raft_consensus.cc:3060] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.388109 17349 tablet_bootstrap.cc:492] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d: No bootstrap required, opened a new log
I20260709 13:20:01.388463 17337 leader_election.cc:290] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.389122 17349 ts_tablet_manager.cc:1403] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent bootstrapping tablet: real 0.159s	user 0.039s	sys 0.027s
I20260709 13:20:01.384380 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57d823da747d9acf8c7897a26c8b4" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.391374 17045 raft_consensus.cc:2468] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:20:01.392668 17350 ts_tablet_manager.cc:1434] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.165s	user 0.006s	sys 0.005s
I20260709 13:20:01.376996 17335 raft_consensus.cc:515] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.395035 17350 tablet_bootstrap.cc:492] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:01.397452 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b6d36b98fc47afbda83f58ac7adf58" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.388491 17086 leader_election.cc:304] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.400410 17045 raft_consensus.cc:2468] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:20:01.401404 17355 raft_consensus.cc:2804] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.401857 17355 raft_consensus.cc:493] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.402330 17355 raft_consensus.cc:3060] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.402050 17349 raft_consensus.cc:359] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.403004 17349 raft_consensus.cc:385] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.403302 17349 raft_consensus.cc:740] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.403795 17158 leader_election.cc:304] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.395715 17335 leader_election.cc:290] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.399154 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b6d36b98fc47afbda83f58ac7adf58" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
W20260709 13:20:01.398818 17011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.3:44509, user_credentials={real_user=slave}} blocked reactor thread for 65105us
I20260709 13:20:01.407811 17243 raft_consensus.cc:493] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.408802 17243 raft_consensus.cc:515] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.412525 17335 raft_consensus.cc:2804] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.414254 17120 raft_consensus.cc:2468] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:20:01.416344 17010 leader_election.cc:304] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:20:01.414628 17243 leader_election.cc:290] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.417732 17337 raft_consensus.cc:2804] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.413130 17335 raft_consensus.cc:493] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.418303 17337 raft_consensus.cc:493] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.418813 17337 raft_consensus.cc:3060] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.418483 17335 raft_consensus.cc:3060] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.417846 17243 raft_consensus.cc:493] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.425258 17243 raft_consensus.cc:515] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.433527 17348 tablet_bootstrap.cc:492] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b: No bootstrap required, opened a new log
I20260709 13:20:01.434362 17348 ts_tablet_manager.cc:1403] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b: Time spent bootstrapping tablet: real 0.152s	user 0.026s	sys 0.026s
I20260709 13:20:01.404246 17349 consensus_queue.cc:260] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.441385 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.442552 17348 raft_consensus.cc:359] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.443471 17348 raft_consensus.cc:385] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.444070 17348 raft_consensus.cc:740] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.446897 17383 raft_consensus.cc:493] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.453760 17382 raft_consensus.cc:2804] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.454155 17378 raft_consensus.cc:493] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.454514 17382 raft_consensus.cc:493] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.455144 17382 raft_consensus.cc:3060] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.455034 17378 raft_consensus.cc:515] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.456375 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65eb3ac940443fb9e3bd22a362ca078" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.457180 17046 raft_consensus.cc:2468] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 0.
I20260709 13:20:01.458242 17378 leader_election.cc:290] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.460157 17348 consensus_queue.cc:260] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.462474 17350 tablet_bootstrap.cc:654] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:01.464521 17159 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.2:37677, user_credentials={real_user=slave}} blocked reactor thread for 79260.7us
I20260709 13:20:01.453500 17383 raft_consensus.cc:515] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.489746 17378 raft_consensus.cc:493] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.490621 17378 raft_consensus.cc:515] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.493659 17378 leader_election.cc:290] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.494926 17384 raft_consensus.cc:493] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.495626 17384 raft_consensus.cc:515] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.496398 17243 leader_election.cc:290] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.505887 17389 raft_consensus.cc:493] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.470892 17158 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.6.233.1:43913, user_credentials={real_user=slave}} blocked reactor thread for 67202.8us
I20260709 13:20:01.505668 17378 raft_consensus.cc:493] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.511570 17348 ts_tablet_manager.cc:1434] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.003s
I20260709 13:20:01.513926 17384 leader_election.cc:290] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
W20260709 13:20:01.516024 17084 leader_election.cc:343] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.517226 17084 leader_election.cc:304] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:20:01.517477 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.518333 17046 raft_consensus.cc:2468] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 0.
I20260709 13:20:01.519291 17243 raft_consensus.cc:2804] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.519766 17243 raft_consensus.cc:493] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.520300 17243 raft_consensus.cc:3060] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.520880 17375 raft_consensus.cc:515] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.521396 17337 raft_consensus.cc:515] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.523667 17337 leader_election.cc:290] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.525362 17355 raft_consensus.cc:515] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.523025 17375 leader_election.cc:290] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.519683 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b6d36b98fc47afbda83f58ac7adf58" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.532861 17120 raft_consensus.cc:2468] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:20:01.533910 17355 leader_election.cc:290] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.539022 17349 ts_tablet_manager.cc:1434] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d: Time spent starting tablet: real 0.149s	user 0.017s	sys 0.025s
I20260709 13:20:01.538262 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.541078 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b6d36b98fc47afbda83f58ac7adf58" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.539134 17389 raft_consensus.cc:515] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.545706 17391 raft_consensus.cc:493] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.546324 17191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.547122 17191 raft_consensus.cc:2468] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:20:01.547683 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc33975be71a405f899d804b0d704b6d" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.548559 17192 raft_consensus.cc:2468] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:20:01.530875 17378 raft_consensus.cc:515] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.548476 17190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b6d36b98fc47afbda83f58ac7adf58" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.537211 17084 leader_election.cc:304] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:20:01.552796 17355 raft_consensus.cc:2804] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.553222 17355 raft_consensus.cc:493] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.553572 17355 raft_consensus.cc:3060] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.554507 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.538919 17335 raft_consensus.cc:515] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.554659 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.556501 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc33975be71a405f899d804b0d704b6d" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
W20260709 13:20:01.556727 17084 leader_election.cc:343] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.557304 17046 raft_consensus.cc:2468] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 0.
I20260709 13:20:01.557744 17383 leader_election.cc:290] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.543690 17389 leader_election.cc:290] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.534430 17382 raft_consensus.cc:515] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.556759 17045 raft_consensus.cc:2468] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:20:01.558750 17084 leader_election.cc:304] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:20:01.559135 17195 raft_consensus.cc:2393] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 85faa4767a01414fb8a8844e4855490b in this term.
I20260709 13:20:01.558293 17387 raft_consensus.cc:493] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.559715 17387 raft_consensus.cc:515] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.560142 17382 leader_election.cc:290] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.560438 17011 leader_election.cc:304] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.560926 17389 raft_consensus.cc:2804] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.561364 17337 raft_consensus.cc:2804] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.562570 17337 raft_consensus.cc:493] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.546396 17391 raft_consensus.cc:515] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.561336 17389 raft_consensus.cc:493] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.556756 17335 leader_election.cc:290] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.566712 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65eb3ac940443fb9e3bd22a362ca078" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.564736 17337 raft_consensus.cc:3060] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.568503 17387 leader_election.cc:290] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.565570 17389 raft_consensus.cc:3060] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.570096 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc33975be71a405f899d804b0d704b6d" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.573246 17243 raft_consensus.cc:515] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.575531 17195 raft_consensus.cc:2468] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 0.
I20260709 13:20:01.576543 17191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.580508 17191 raft_consensus.cc:2468] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:20:01.577521 17391 leader_election.cc:290] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.577898 17011 leader_election.cc:304] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.581773 17355 raft_consensus.cc:515] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.582343 17376 raft_consensus.cc:2804] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.582711 17376 raft_consensus.cc:493] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.583058 17376 raft_consensus.cc:3060] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.583076 17120 raft_consensus.cc:2393] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85faa4767a01414fb8a8844e4855490b in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.585001 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.585186 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b6d36b98fc47afbda83f58ac7adf58" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:01.585705 17120 raft_consensus.cc:3060] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.585903 17118 raft_consensus.cc:2393] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.587878 17117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.588604 17117 raft_consensus.cc:2468] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 0.
I20260709 13:20:01.564208 17378 leader_election.cc:290] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.594444 17010 leader_election.cc:304] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:20:01.586323 17389 raft_consensus.cc:515] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.583849 17243 leader_election.cc:290] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
W20260709 13:20:01.596096 16992 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:01.596908 17378 raft_consensus.cc:2804] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.597390 17119 raft_consensus.cc:2393] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.597627 17378 raft_consensus.cc:493] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.598212 17378 raft_consensus.cc:3060] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.599287 17191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.599997 17191 raft_consensus.cc:2468] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 0.
I20260709 13:20:01.600312 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.601907 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65eb3ac940443fb9e3bd22a362ca078" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.602748 17350 tablet_bootstrap.cc:492] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.602596 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:01.603274 17119 raft_consensus.cc:3060] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.603183 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57d823da747d9acf8c7897a26c8b4" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:01.604902 17121 raft_consensus.cc:3060] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.604969 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b6d36b98fc47afbda83f58ac7adf58" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:01.606344 17376 raft_consensus.cc:515] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.602614 17046 raft_consensus.cc:3060] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.611402 17190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65eb3ac940443fb9e3bd22a362ca078" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.604123 17117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cda90506714a9d8655e5443db45963" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.612325 17190 raft_consensus.cc:3060] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.613026 17117 raft_consensus.cc:2468] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 0.
I20260709 13:20:01.608667 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65eb3ac940443fb9e3bd22a362ca078" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.608742 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc33975be71a405f899d804b0d704b6d" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.615108 17119 raft_consensus.cc:2468] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:20:01.615631 17195 raft_consensus.cc:2468] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 0.
I20260709 13:20:01.615743 17118 raft_consensus.cc:2393] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85faa4767a01414fb8a8844e4855490b in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.610165 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.616699 17192 raft_consensus.cc:2468] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 0.
I20260709 13:20:01.617244 17044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc33975be71a405f899d804b0d704b6d" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.602088 17337 raft_consensus.cc:515] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.621564 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:01.622475 17118 raft_consensus.cc:2393] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.591580 17355 leader_election.cc:290] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.607836 17389 leader_election.cc:290] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.603303 17350 ts_tablet_manager.cc:1403] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.209s	user 0.016s	sys 0.024s
I20260709 13:20:01.603181 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.607496 17191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.626591 17044 raft_consensus.cc:2393] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f4d1a1667f049b09139e68d548a4b4d in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:20:01.626879 17191 raft_consensus.cc:3060] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.624998 17194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.627919 17042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.628510 17194 raft_consensus.cc:3060] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.625703 17159 leader_election.cc:304] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.626390 17043 raft_consensus.cc:2393] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f4d1a1667f049b09139e68d548a4b4d in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:20:01.630424 17391 raft_consensus.cc:2804] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:01.630769 17391 raft_consensus.cc:493] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.631103 17391 raft_consensus.cc:3060] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.631232 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc33975be71a405f899d804b0d704b6d" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.631904 17195 raft_consensus.cc:3060] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.631968 17190 raft_consensus.cc:2468] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 1.
I20260709 13:20:01.633164 17192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.638744 17159 leader_election.cc:304] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.638973 17378 raft_consensus.cc:515] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.639542 17335 raft_consensus.cc:2804] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.640084 17335 raft_consensus.cc:697] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:01.640226 17045 raft_consensus.cc:2393] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f4d1a1667f049b09139e68d548a4b4d in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:20:01.641214 17335 consensus_queue.cc:237] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.643476 17120 raft_consensus.cc:2468] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:20:01.624579 17337 leader_election.cc:290] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.648581 17121 raft_consensus.cc:2468] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:20:01.649703 17010 leader_election.cc:304] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:01.650184 17011 leader_election.cc:304] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d; no voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:01.650626 17337 raft_consensus.cc:2804] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.651347 17377 raft_consensus.cc:2749] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:01.651868 17159 leader_election.cc:304] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.652125 17337 raft_consensus.cc:697] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:20:01.654089 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57d823da747d9acf8c7897a26c8b4" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.653824 17337 consensus_queue.cc:237] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.654774 17045 raft_consensus.cc:3060] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.655601 17194 raft_consensus.cc:2468] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 1.
I20260709 13:20:01.658617 17382 raft_consensus.cc:2804] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.659191 17382 raft_consensus.cc:697] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:01.656286 17391 raft_consensus.cc:515] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.660173 17382 consensus_queue.cc:237] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.662256 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cda90506714a9d8655e5443db45963" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.663216 17391 leader_election.cc:290] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:01.652287 17191 raft_consensus.cc:2468] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 1.
I20260709 13:20:01.665184 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b6d36b98fc47afbda83f58ac7adf58" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.667620 17043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65eb3ac940443fb9e3bd22a362ca078" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d" is_pre_election: true
I20260709 13:20:01.669486 17045 raft_consensus.cc:2468] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:20:01.670987 17376 leader_election.cc:290] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.670650 16944 catalog_manager.cc:5697] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.673703 17046 raft_consensus.cc:2468] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 1.
I20260709 13:20:01.673802 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc33975be71a405f899d804b0d704b6d" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:01.663918 17195 raft_consensus.cc:2468] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 1.
I20260709 13:20:01.682862 17121 raft_consensus.cc:2393] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.684718 17084 leader_election.cc:304] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:20:01.685935 17355 raft_consensus.cc:2804] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.686632 17355 raft_consensus.cc:697] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:01.687755 17158 leader_election.cc:304] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:20:01.689116 17335 raft_consensus.cc:2764] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:20:01.687868 17355 consensus_queue.cc:237] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.691936 17086 leader_election.cc:304] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:01.693871 17389 raft_consensus.cc:2804] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:20:01.689585 17158 leader_election.cc:343] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.694419 17389 raft_consensus.cc:493] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.694964 17389 raft_consensus.cc:3060] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:01.695462 17158 leader_election.cc:343] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.696920 17158 leader_election.cc:304] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:01.696823 17350 raft_consensus.cc:359] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.698109 17350 raft_consensus.cc:385] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.698199 17335 raft_consensus.cc:2749] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:01.698583 17350 raft_consensus.cc:740] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.700027 17158 leader_election.cc:304] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85faa4767a01414fb8a8844e4855490b; no voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:01.701122 17335 raft_consensus.cc:2749] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:01.705189 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cda90506714a9d8655e5443db45963" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:01.705345 17086 leader_election.cc:304] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:01.706050 17121 raft_consensus.cc:3060] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.706477 17243 raft_consensus.cc:2804] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.709918 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cda90506714a9d8655e5443db45963" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.710403 17086 leader_election.cc:304] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:01.711900 17243 raft_consensus.cc:697] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:01.713176 17243 consensus_queue.cc:237] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.716929 17121 raft_consensus.cc:2468] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:20:01.717516 17387 raft_consensus.cc:2804] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.718119 17387 raft_consensus.cc:697] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:01.718246 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc33975be71a405f899d804b0d704b6d" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.719216 17195 raft_consensus.cc:2393] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.719385 17387 consensus_queue.cc:237] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.720669 17011 leader_election.cc:304] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d; no voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:01.721921 17376 raft_consensus.cc:2749] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:01.699810 17350 consensus_queue.cc:260] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.724177 17046 raft_consensus.cc:3060] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.727532 17086 leader_election.cc:304] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:01.731936 17243 raft_consensus.cc:2804] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.732431 17243 raft_consensus.cc:697] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:01.733433 17243 consensus_queue.cc:237] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.726001 17159 leader_election.cc:304] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.736387 17382 raft_consensus.cc:2804] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.737346 17382 raft_consensus.cc:697] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:01.738778 17382 consensus_queue.cc:237] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.751928 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.752820 17195 raft_consensus.cc:3060] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.760355 17378 leader_election.cc:290] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.745436 17389 raft_consensus.cc:515] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.759665 17046 raft_consensus.cc:2468] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 1.
I20260709 13:20:01.768579 17195 raft_consensus.cc:2468] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 1.
I20260709 13:20:01.771561 17011 leader_election.cc:304] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:01.772286 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:01.775322 17337 raft_consensus.cc:2804] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:01.776094 17337 raft_consensus.cc:697] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:20:01.777148 17350 ts_tablet_manager.cc:1434] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.151s	user 0.012s	sys 0.000s
I20260709 13:20:01.777068 17337 consensus_queue.cc:237] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.778894 17350 tablet_bootstrap.cc:492] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:01.785416 17121 raft_consensus.cc:2393] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.787150 17389 leader_election.cc:290] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.788501 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:01.789362 17195 raft_consensus.cc:2393] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f4d1a1667f049b09139e68d548a4b4d in current term 1: Already voted for candidate 6f82dcb597824c149ec645f777a5ff6d in this term.
I20260709 13:20:01.789014 16940 catalog_manager.cc:5697] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 1 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.791615 17350 tablet_bootstrap.cc:654] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.794874 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:01.796502 17084 leader_election.cc:304] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d; no voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:01.797107 17350 tablet_bootstrap.cc:492] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.797730 17350 ts_tablet_manager.cc:1403] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.001s
I20260709 13:20:01.798146 17387 raft_consensus.cc:2749] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:01.795660 16943 catalog_manager.cc:5697] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 1 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.800936 17350 raft_consensus.cc:359] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.801735 17350 raft_consensus.cc:385] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.802086 17350 raft_consensus.cc:740] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.802871 17350 consensus_queue.cc:260] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.805327 17350 ts_tablet_manager.cc:1434] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:01.806529 17350 tablet_bootstrap.cc:492] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d: Bootstrap starting.
I20260709 13:20:01.814004 17350 tablet_bootstrap.cc:654] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:01.815857 16944 catalog_manager.cc:5697] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.818147 16944 catalog_manager.cc:5697] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 0 to 1, leader changed from <none> to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 1 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.826591 17350 tablet_bootstrap.cc:492] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d: No bootstrap required, opened a new log
I20260709 13:20:01.826025 16940 catalog_manager.cc:5697] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 1 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.827149 17350 ts_tablet_manager.cc:1403] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:20:01.828088 16940 catalog_manager.cc:5697] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 1 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.831532 16940 catalog_manager.cc:5697] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 1 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.832739 16941 catalog_manager.cc:5697] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 1 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.834463 17350 raft_consensus.cc:359] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.835230 17350 raft_consensus.cc:385] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:01.835467 17350 raft_consensus.cc:740] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.836145 17350 consensus_queue.cc:260] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.838445 17350 ts_tablet_manager.cc:1434] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:01.863966 17378 raft_consensus.cc:493] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.864564 17378 raft_consensus.cc:515] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:01.867125 17378 leader_election.cc:290] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:01.867900 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:01.868393 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:01.869099 17195 raft_consensus.cc:2393] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 0f4d1a1667f049b09139e68d548a4b4d in this term.
I20260709 13:20:01.869957 17011 leader_election.cc:304] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d; no voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:01.870651 17378 raft_consensus.cc:3060] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:01.875820 17378 raft_consensus.cc:2749] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:02.004112 17378 raft_consensus.cc:493] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.004676 17378 raft_consensus.cc:515] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.006460 17378 leader_election.cc:290] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:02.007462 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d" is_pre_election: true
I20260709 13:20:02.007475 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85faa4767a01414fb8a8844e4855490b" is_pre_election: true
I20260709 13:20:02.008533 17121 raft_consensus.cc:2393] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f82dcb597824c149ec645f777a5ff6d in current term 1: Already voted for candidate 85faa4767a01414fb8a8844e4855490b in this term.
I20260709 13:20:02.009450 17010 leader_election.cc:304] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d; no voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:02.010080 17378 raft_consensus.cc:3060] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:02.015215 17378 raft_consensus.cc:2749] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:02.055878 17378 consensus_queue.cc:1048] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.057593 17382 consensus_queue.cc:1048] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.070303 17120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
mode: GRACEFUL
new_leader_uuid: "6f82dcb597824c149ec645f777a5ff6d"
 from {username='slave'} at 127.0.0.1:45002
I20260709 13:20:02.071101 17120 raft_consensus.cc:606] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Received request to transfer leadership to TS 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:02.081338 17378 consensus_queue.cc:1048] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.089757 17120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "250e32bf965640efb0235518efa212b4"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
mode: GRACEFUL
new_leader_uuid: "6f82dcb597824c149ec645f777a5ff6d"
 from {username='slave'} at 127.0.0.1:45002
I20260709 13:20:02.095598 17120 raft_consensus.cc:606] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Received request to transfer leadership to TS 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:02.094430 17389 consensus_queue.cc:1048] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:02.100543 17382 consensus_queue.cc:1048] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:02.116770 17191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9cda90506714a9d8655e5443db45963"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
mode: GRACEFUL
new_leader_uuid: "6f82dcb597824c149ec645f777a5ff6d"
 from {username='slave'} at 127.0.0.1:59498
I20260709 13:20:02.117460 17191 raft_consensus.cc:606] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Received request to transfer leadership to TS 6f82dcb597824c149ec645f777a5ff6d
I20260709 13:20:02.126108 17382 consensus_queue.cc:1048] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:02.126823 17195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba57d823da747d9acf8c7897a26c8b4"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
mode: GRACEFUL
new_leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:59498
I20260709 13:20:02.127467 17195 raft_consensus.cc:606] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Received request to transfer leadership to TS 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:20:02.127806 17389 consensus_queue.cc:1048] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.135828 17335 consensus_queue.cc:1048] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.141093 17191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
mode: GRACEFUL
new_leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:59498
I20260709 13:20:02.141686 17191 raft_consensus.cc:606] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Received request to transfer leadership to TS 0f4d1a1667f049b09139e68d548a4b4d
I20260709 13:20:02.155478 17383 raft_consensus.cc:993] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b: : Instructing follower 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:20:02.156081 17383 raft_consensus.cc:1081] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Signalling peer 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:20:02.160689 17045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
mode: GRACEFUL
new_leader_uuid: "85faa4767a01414fb8a8844e4855490b"
 from {username='slave'} at 127.0.0.1:39990
I20260709 13:20:02.160781 17118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ba57d823da747d9acf8c7897a26c8b4"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:58044
I20260709 13:20:02.161458 17045 raft_consensus.cc:606] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Received request to transfer leadership to TS 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:02.161573 17118 raft_consensus.cc:493] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.162057 17118 raft_consensus.cc:3060] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.171072 17118 raft_consensus.cc:515] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.174048 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57d823da747d9acf8c7897a26c8b4" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:02.174748 17046 raft_consensus.cc:3060] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.174777 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba57d823da747d9acf8c7897a26c8b4" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:02.174243 17118 leader_election.cc:290] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:02.175464 17195 raft_consensus.cc:3055] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:02.175817 17195 raft_consensus.cc:740] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:02.176573 17195 consensus_queue.cc:260] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.177752 17195 raft_consensus.cc:3060] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.182844 17046 raft_consensus.cc:2468] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:20:02.184222 17084 leader_election.cc:304] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:20:02.184799 17195 raft_consensus.cc:2468] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:20:02.185119 17389 raft_consensus.cc:2804] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.185662 17389 raft_consensus.cc:697] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:02.186549 17389 consensus_queue.cc:237] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.193495 16943 catalog_manager.cc:5697] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 1 to 2, leader changed from 85faa4767a01414fb8a8844e4855490b (127.6.233.3) to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 2 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.203539 17389 consensus_queue.cc:1048] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.214715 17388 consensus_queue.cc:1048] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.222173 17389 raft_consensus.cc:993] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d: : Instructing follower 6f82dcb597824c149ec645f777a5ff6d to start an election
I20260709 13:20:02.222720 17388 raft_consensus.cc:1081] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Signalling peer 6f82dcb597824c149ec645f777a5ff6d to start an election
I20260709 13:20:02.224211 17046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "250e32bf965640efb0235518efa212b4"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
 from {username='slave'} at 127.0.0.1:39962
I20260709 13:20:02.224745 17046 raft_consensus.cc:493] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.225116 17046 raft_consensus.cc:3060] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.230334 17046 raft_consensus.cc:515] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.232123 17046 leader_election.cc:290] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 2 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:02.232807 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:02.233489 17118 raft_consensus.cc:3055] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:02.233665 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "250e32bf965640efb0235518efa212b4" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:02.233914 17118 raft_consensus.cc:740] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:02.234282 17195 raft_consensus.cc:3060] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.234730 17118 consensus_queue.cc:260] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.236088 17118 raft_consensus.cc:3060] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.239688 17378 consensus_queue.cc:1048] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.240342 17382 consensus_queue.cc:1048] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.241014 17195 raft_consensus.cc:2468] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 2.
I20260709 13:20:02.242285 17011 leader_election.cc:304] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:02.243157 17378 raft_consensus.cc:2804] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.243844 17378 raft_consensus.cc:697] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:20:02.244779 17378 consensus_queue.cc:237] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.249495 17243 consensus_queue.cc:1048] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.252456 16941 catalog_manager.cc:5697] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 1 to 2, leader changed from 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2) to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 2 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.257974 17118 raft_consensus.cc:2468] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 2.
I20260709 13:20:02.266093 17378 consensus_queue.cc:1048] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.287438 17243 consensus_queue.cc:1048] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.302577 17335 consensus_queue.cc:1048] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.303761 17243 consensus_queue.cc:1048] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:02.318149 17355 raft_consensus.cc:993] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d: : Instructing follower 6f82dcb597824c149ec645f777a5ff6d to start an election
I20260709 13:20:02.318615 17355 raft_consensus.cc:1081] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Signalling peer 6f82dcb597824c149ec645f777a5ff6d to start an election
I20260709 13:20:02.320814 17378 raft_consensus.cc:993] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d: : Instructing follower 85faa4767a01414fb8a8844e4855490b to start an election
I20260709 13:20:02.321331 17378 raft_consensus.cc:1081] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Signalling peer 85faa4767a01414fb8a8844e4855490b to start an election
I20260709 13:20:02.323768 17388 consensus_queue.cc:1048] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:02.323810 17391 raft_consensus.cc:993] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b: : Instructing follower 6f82dcb597824c149ec645f777a5ff6d to start an election
I20260709 13:20:02.324992 17391 raft_consensus.cc:1081] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Signalling peer 6f82dcb597824c149ec645f777a5ff6d to start an election
I20260709 13:20:02.326699 17046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9cda90506714a9d8655e5443db45963"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
 from {username='slave'} at 127.0.0.1:39976
I20260709 13:20:02.327255 17046 raft_consensus.cc:493] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.327622 17046 raft_consensus.cc:3060] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.328982 17194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
 from {username='slave'} at 127.0.0.1:59476
I20260709 13:20:02.329690 17194 raft_consensus.cc:493] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.330070 17194 raft_consensus.cc:3060] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.333113 17045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
 from {username='slave'} at 127.0.0.1:39962
I20260709 13:20:02.333886 17045 raft_consensus.cc:493] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.334296 17045 raft_consensus.cc:3060] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.340507 17194 raft_consensus.cc:515] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.342104 17045 raft_consensus.cc:515] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.344717 17045 leader_election.cc:290] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 2 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:02.345322 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:02.345938 17195 raft_consensus.cc:3060] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.347821 17194 leader_election.cc:290] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:02.348210 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ff0a0b20a143d0aaf15d6d82b08f45" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:02.348493 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:02.349064 17121 raft_consensus.cc:3060] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.348860 17119 raft_consensus.cc:3055] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:02.350136 17119 raft_consensus.cc:740] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:02.350899 17119 consensus_queue.cc:260] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.355299 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28d0ef9c91f454aac86f19472e7daa1" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:02.355855 17119 raft_consensus.cc:3060] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.356020 17045 raft_consensus.cc:3055] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:02.356590 17121 raft_consensus.cc:2468] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 2.
I20260709 13:20:02.357237 17195 raft_consensus.cc:2468] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 2.
I20260709 13:20:02.356621 17045 raft_consensus.cc:740] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:20:02.358036 17159 leader_election.cc:304] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:02.358748 17045 consensus_queue.cc:260] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.360070 17045 raft_consensus.cc:3060] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.359804 17011 leader_election.cc:304] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:02.361068 17376 raft_consensus.cc:2804] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.361694 17376 raft_consensus.cc:697] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 2 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:20:02.362762 17376 consensus_queue.cc:237] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.366751 17045 raft_consensus.cc:2468] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 2.
I20260709 13:20:02.359025 17335 raft_consensus.cc:2804] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.372936 17335 raft_consensus.cc:697] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 2 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:02.362579 17119 raft_consensus.cc:2468] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 2.
I20260709 13:20:02.374596 17335 consensus_queue.cc:237] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.383014 17046 raft_consensus.cc:515] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.385421 17046 leader_election.cc:290] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 2 election: Requested vote from peers 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:02.386582 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cda90506714a9d8655e5443db45963" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:02.387212 17195 raft_consensus.cc:3055] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:02.387511 17195 raft_consensus.cc:740] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:02.388234 17195 consensus_queue.cc:260] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.389446 17195 raft_consensus.cc:3060] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.390061 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9cda90506714a9d8655e5443db45963" candidate_uuid: "6f82dcb597824c149ec645f777a5ff6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:02.390618 17119 raft_consensus.cc:3060] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.388733 16943 catalog_manager.cc:5697] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 1 to 2, leader changed from 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1) to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 2 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.396394 17195 raft_consensus.cc:2468] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 2.
I20260709 13:20:02.396826 17119 raft_consensus.cc:2468] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f82dcb597824c149ec645f777a5ff6d in term 2.
I20260709 13:20:02.397753 17011 leader_election.cc:304] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:02.398684 17376 raft_consensus.cc:2804] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.399341 17376 raft_consensus.cc:697] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 2 LEADER]: Becoming Leader. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:20:02.400199 17376 consensus_queue.cc:237] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.400727 16941 catalog_manager.cc:5697] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 1 to 2, leader changed from 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2) to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 2 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.413569 16941 catalog_manager.cc:5697] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d reported cstate change: term changed from 1 to 2, leader changed from 85faa4767a01414fb8a8844e4855490b (127.6.233.3) to 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1). New cstate: current_term: 2 leader_uuid: "6f82dcb597824c149ec645f777a5ff6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.620177 17335 raft_consensus.cc:993] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b: : Instructing follower 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:20:02.620572 17382 raft_consensus.cc:1081] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Signalling peer 0f4d1a1667f049b09139e68d548a4b4d to start an election
I20260709 13:20:02.621959 17119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
 from {username='slave'} at 127.0.0.1:58044
I20260709 13:20:02.622394 17119 raft_consensus.cc:493] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:02.622671 17119 raft_consensus.cc:3060] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.627038 17119 raft_consensus.cc:515] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.628551 17119 leader_election.cc:290] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 85faa4767a01414fb8a8844e4855490b (127.6.233.3:44509)
I20260709 13:20:02.629272 17046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:02.629523 17195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305dfc44e6ec46ed98df510d917e6250" candidate_uuid: "0f4d1a1667f049b09139e68d548a4b4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85faa4767a01414fb8a8844e4855490b"
I20260709 13:20:02.629881 17046 raft_consensus.cc:3060] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.630141 17195 raft_consensus.cc:3055] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:02.630488 17195 raft_consensus.cc:740] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:02.631139 17195 consensus_queue.cc:260] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.632088 17195 raft_consensus.cc:3060] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.636679 17046 raft_consensus.cc:2468] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:20:02.637323 17195 raft_consensus.cc:2468] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f4d1a1667f049b09139e68d548a4b4d in term 2.
I20260709 13:20:02.637960 17084 leader_election.cc:304] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 6f82dcb597824c149ec645f777a5ff6d; no voters: 
I20260709 13:20:02.638938 17388 raft_consensus.cc:2804] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.639382 17388 raft_consensus.cc:697] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Becoming Leader. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:02.640156 17388 consensus_queue.cc:237] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:02.642952 17195 raft_consensus.cc:1275] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.644515 17388 consensus_queue.cc:1048] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.647746 16941 catalog_manager.cc:5697] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d reported cstate change: term changed from 1 to 2, leader changed from 85faa4767a01414fb8a8844e4855490b (127.6.233.3) to 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2). New cstate: current_term: 2 leader_uuid: "0f4d1a1667f049b09139e68d548a4b4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.652506 17046 raft_consensus.cc:1275] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.654740 17355 consensus_queue.cc:1048] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.715247 17121 raft_consensus.cc:1275] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Refusing update from remote peer 6f82dcb597824c149ec645f777a5ff6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.716486 17378 consensus_queue.cc:1048] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.724080 17194 raft_consensus.cc:1275] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 6f82dcb597824c149ec645f777a5ff6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.727052 17378 consensus_queue.cc:1048] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.796325 17121 raft_consensus.cc:1275] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Refusing update from remote peer 6f82dcb597824c149ec645f777a5ff6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.797643 17378 consensus_queue.cc:1048] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.804988 17194 raft_consensus.cc:1275] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 6f82dcb597824c149ec645f777a5ff6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.806835 17121 raft_consensus.cc:1275] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Refusing update from remote peer 85faa4767a01414fb8a8844e4855490b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.807273 17337 consensus_queue.cc:1048] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.808513 17382 consensus_queue.cc:1048] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.818686 17046 raft_consensus.cc:1275] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 85faa4767a01414fb8a8844e4855490b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.819990 17119 raft_consensus.cc:1275] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Refusing update from remote peer 6f82dcb597824c149ec645f777a5ff6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.821367 17337 consensus_queue.cc:1048] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.821763 17382 consensus_queue.cc:1048] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:02.830505 17195 raft_consensus.cc:1275] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 6f82dcb597824c149ec645f777a5ff6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.832814 17378 consensus_queue.cc:1048] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:03.078033 17195 raft_consensus.cc:1275] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:03.079319 17389 consensus_queue.cc:1048] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:03.089403 17046 raft_consensus.cc:1275] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 0f4d1a1667f049b09139e68d548a4b4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:03.090813 17388 consensus_queue.cc:1048] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:05.165266 16941 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49320:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:05.184626 16941 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49320:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:05.324684  7076 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:05.358343 17461 log.cc:927] Time spent T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
W20260709 13:20:05.400136 17458 log.cc:927] Time spent T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b: Append to log took a long time: real 0.096s	user 0.002s	sys 0.003s
W20260709 13:20:05.445196 17084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.233.1:43913, user_credentials={real_user=slave}} blocked reactor thread for 66002.6us
I20260709 13:20:05.507473 17486 tablet.cc:1724] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.510277 17491 tablet.cc:1724] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:05.527194 17490 log.cc:927] Time spent T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.002s
I20260709 13:20:05.536253 17493 tablet.cc:1724] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.632103 17500 tablet.cc:1724] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.644476 17502 tablet.cc:1724] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.650563 17491 tablet.cc:1724] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.651674 17503 tablet.cc:1724] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.648646 17507 tablet.cc:1724] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.573287 17498 tablet.cc:1724] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.679499 17503 tablet.cc:1724] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.687561 17502 tablet.cc:1724] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.692194 17486 tablet.cc:1724] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.676760 17504 tablet.cc:1724] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.706029 17043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d"
dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
mode: GRACEFUL
new_leader_uuid: "85faa4767a01414fb8a8844e4855490b"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:20:05.706746 17043 raft_consensus.cc:606] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Received request to transfer leadership to TS 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:05.719506 17508 tablet.cc:1724] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.713721 17491 tablet.cc:1724] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.727792 17507 tablet.cc:1724] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.724161 17498 tablet.cc:1724] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.746446 17510 tablet.cc:1724] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.716840 17505 tablet.cc:1724] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.751183 17486 tablet.cc:1724] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.766214 17493 tablet.cc:1724] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.777552 17508 tablet.cc:1724] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.779139 17500 tablet.cc:1724] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.780388 17502 tablet.cc:1724] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.791836 17500 tablet.cc:1724] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.798785 17504 tablet.cc:1724] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.802188 17118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0"
dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
mode: GRACEFUL
new_leader_uuid: "85faa4767a01414fb8a8844e4855490b"
 from {username='slave'} at 127.0.0.1:45014
I20260709 13:20:05.802884 17118 raft_consensus.cc:606] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Received request to transfer leadership to TS 85faa4767a01414fb8a8844e4855490b
I20260709 13:20:05.803089 17508 tablet.cc:1724] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:05.804675  7076 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:05.805418  7076 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:05.835039 16943 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274: soft_deleted_table [id=cfbe6012a5cb45ceaa01c0f412b1978f] alter complete (version 1)
I20260709 13:20:05.846813 17470 raft_consensus.cc:993] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d: : Instructing follower 85faa4767a01414fb8a8844e4855490b to start an election
I20260709 13:20:05.847311 17470 raft_consensus.cc:1081] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Signalling peer 85faa4767a01414fb8a8844e4855490b to start an election
I20260709 13:20:05.849064 17187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
 from {username='slave'} at 127.0.0.1:59476
I20260709 13:20:05.849661 17187 raft_consensus.cc:493] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:05.849989 17187 raft_consensus.cc:3060] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.856192 17187 raft_consensus.cc:515] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:05.858117 17187 leader_election.cc:290] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 2 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:05.859061 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:05.859706 17045 raft_consensus.cc:3055] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:05.859670 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b497e987ff4bd9896969fb0582918d" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:05.860311 17045 raft_consensus.cc:740] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f82dcb597824c149ec645f777a5ff6d, State: Running, Role: LEADER
I20260709 13:20:05.860504 17118 raft_consensus.cc:3060] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.861130 17045 consensus_queue.cc:260] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:05.862391 17045 raft_consensus.cc:3060] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.868237 17118 raft_consensus.cc:2468] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 2.
I20260709 13:20:05.869704 17045 raft_consensus.cc:2468] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 2.
I20260709 13:20:05.869720 17159 leader_election.cc:304] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f4d1a1667f049b09139e68d548a4b4d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:05.870899 17482 raft_consensus.cc:2804] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:05.871425 17482 raft_consensus.cc:697] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 2 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:05.872342 17482 consensus_queue.cc:237] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:05.881358 16940 catalog_manager.cc:5697] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 1 to 2, leader changed from 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1) to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 2 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.095340 17485 raft_consensus.cc:993] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d: : Instructing follower 85faa4767a01414fb8a8844e4855490b to start an election
I20260709 13:20:06.096065 17478 raft_consensus.cc:1081] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Signalling peer 85faa4767a01414fb8a8844e4855490b to start an election
I20260709 13:20:06.097934 17187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0"
dest_uuid: "85faa4767a01414fb8a8844e4855490b"
 from {username='slave'} at 127.0.0.1:59488
I20260709 13:20:06.098445 17187 raft_consensus.cc:493] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:06.098753 17187 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.104071 17187 raft_consensus.cc:515] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:06.106045 17187 leader_election.cc:290] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 3 election: Requested vote from peers 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913), 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677)
I20260709 13:20:06.106773 17045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f82dcb597824c149ec645f777a5ff6d"
I20260709 13:20:06.107193 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beb60ee4583444808efb3a0a8e188db0" candidate_uuid: "85faa4767a01414fb8a8844e4855490b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0f4d1a1667f049b09139e68d548a4b4d"
I20260709 13:20:06.107532 17045 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.107786 17118 raft_consensus.cc:3055] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:06.108170 17118 raft_consensus.cc:740] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f4d1a1667f049b09139e68d548a4b4d, State: Running, Role: LEADER
I20260709 13:20:06.108814 17118 consensus_queue.cc:260] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:06.109755 17118 raft_consensus.cc:3060] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.112413 17045 raft_consensus.cc:2468] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 3.
I20260709 13:20:06.113570 17158 leader_election.cc:304] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f82dcb597824c149ec645f777a5ff6d, 85faa4767a01414fb8a8844e4855490b; no voters: 
I20260709 13:20:06.114387 17482 raft_consensus.cc:2804] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:06.114830 17482 raft_consensus.cc:697] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 3 LEADER]: Becoming Leader. State: Replica: 85faa4767a01414fb8a8844e4855490b, State: Running, Role: LEADER
I20260709 13:20:06.115128 17118 raft_consensus.cc:2468] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85faa4767a01414fb8a8844e4855490b in term 3.
I20260709 13:20:06.115757 17482 consensus_queue.cc:237] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } }
I20260709 13:20:06.125597 16940 catalog_manager.cc:5697] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b reported cstate change: term changed from 2 to 3, leader changed from 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2) to 85faa4767a01414fb8a8844e4855490b (127.6.233.3). New cstate: current_term: 3 leader_uuid: "85faa4767a01414fb8a8844e4855490b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85faa4767a01414fb8a8844e4855490b" member_type: VOTER last_known_addr { host: "127.6.233.3" port: 44509 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:06.289081 17118 raft_consensus.cc:1275] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Refusing update from remote peer 85faa4767a01414fb8a8844e4855490b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:06.290619 17482 consensus_queue.cc:1048] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:06.301276 17045 raft_consensus.cc:1275] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Refusing update from remote peer 85faa4767a01414fb8a8844e4855490b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:06.302824 17519 consensus_queue.cc:1048] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:06.600726 17045 raft_consensus.cc:1275] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 3 FOLLOWER]: Refusing update from remote peer 85faa4767a01414fb8a8844e4855490b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:06.601877 17335 consensus_queue.cc:1048] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f82dcb597824c149ec645f777a5ff6d" member_type: VOTER last_known_addr { host: "127.6.233.1" port: 43913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:06.610499 17118 raft_consensus.cc:1275] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 3 FOLLOWER]: Refusing update from remote peer 85faa4767a01414fb8a8844e4855490b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:06.612411 17335 consensus_queue.cc:1048] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f4d1a1667f049b09139e68d548a4b4d" member_type: VOTER last_known_addr { host: "127.6.233.2" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:06.864789  7076 tablet_server.cc:179] TabletServer@127.6.233.1:0 shutting down...
I20260709 13:20:06.889001  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:06.889863  7076 tablet_replica.cc:333] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.890599  7076 raft_consensus.cc:2243] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.891495  7076 raft_consensus.cc:2272] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.893536  7076 tablet_replica.cc:333] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.894201  7076 raft_consensus.cc:2243] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.895072  7076 raft_consensus.cc:2272] T d9cda90506714a9d8655e5443db45963 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.897089  7076 tablet_replica.cc:333] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.897717  7076 raft_consensus.cc:2243] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.898460  7076 raft_consensus.cc:2272] T 250e32bf965640efb0235518efa212b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.900993  7076 tablet_replica.cc:333] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.901543  7076 raft_consensus.cc:2243] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.901991  7076 raft_consensus.cc:2272] T 305dfc44e6ec46ed98df510d917e6250 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.903759  7076 tablet_replica.cc:333] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.904574  7076 raft_consensus.cc:2243] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.905051  7076 raft_consensus.cc:2272] T 3ba57d823da747d9acf8c7897a26c8b4 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.906883  7076 tablet_replica.cc:333] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.907505  7076 raft_consensus.cc:2243] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.908438  7076 raft_consensus.cc:2272] T b1acbced6dab4e7f813b3730aa63b641 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.910450  7076 tablet_replica.cc:333] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.911008  7076 raft_consensus.cc:2243] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.911434  7076 raft_consensus.cc:2272] T 034cfcd66ba440b889388cdbf7a863f2 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.913414  7076 tablet_replica.cc:333] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.913947  7076 raft_consensus.cc:2243] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.914364  7076 raft_consensus.cc:2272] T c65eb3ac940443fb9e3bd22a362ca078 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.917191  7076 tablet_replica.cc:333] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
W20260709 13:20:06.917273 17158 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:20:06.918093  7076 raft_consensus.cc:2243] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.918736  7076 raft_consensus.cc:2272] T beb60ee4583444808efb3a0a8e188db0 P 6f82dcb597824c149ec645f777a5ff6d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:06.921135 17158 consensus_peers.cc:597] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b -> Peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Couldn't send request to peer 6f82dcb597824c149ec645f777a5ff6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:06.923945  7076 tablet_replica.cc:333] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.924677  7076 raft_consensus.cc:2243] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.925348  7076 raft_consensus.cc:2272] T 56b6d36b98fc47afbda83f58ac7adf58 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.927403  7076 tablet_replica.cc:333] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.928073  7076 raft_consensus.cc:2243] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.928591  7076 raft_consensus.cc:2272] T cc33975be71a405f899d804b0d704b6d P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.930644  7076 tablet_replica.cc:333] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.931176  7076 raft_consensus.cc:2243] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.932072  7076 raft_consensus.cc:2272] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.934557  7076 tablet_replica.cc:333] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.935068  7076 raft_consensus.cc:2243] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.935475  7076 raft_consensus.cc:2272] T 78b497e987ff4bd9896969fb0582918d P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:06.936875 17084 consensus_peers.cc:597] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d -> Peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Couldn't send request to peer 6f82dcb597824c149ec645f777a5ff6d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:06.938732  7076 tablet_replica.cc:333] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.939319  7076 raft_consensus.cc:2243] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.940104  7076 raft_consensus.cc:2272] T 5f1c173fc822467fafaf752685f855ba P 6f82dcb597824c149ec645f777a5ff6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.942001  7076 tablet_replica.cc:333] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.942459  7076 raft_consensus.cc:2243] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.942822  7076 raft_consensus.cc:2272] T b92af6799d364350852d45a6ac8d3d91 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.944718  7076 tablet_replica.cc:333] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.945200  7076 raft_consensus.cc:2243] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.945554  7076 raft_consensus.cc:2272] T d5ebfeead72a40609742820ec626e3a0 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.947345  7076 tablet_replica.cc:333] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.947748  7076 raft_consensus.cc:2243] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.948173  7076 raft_consensus.cc:2272] T c28d0ef9c91f454aac86f19472e7daa1 P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.949895  7076 tablet_replica.cc:333] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d: stopping tablet replica
I20260709 13:20:06.950309  7076 raft_consensus.cc:2243] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.950665  7076 raft_consensus.cc:2272] T 639bd84656354802813590c28338f69b P 6f82dcb597824c149ec645f777a5ff6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.978749  7076 tablet_server.cc:196] TabletServer@127.6.233.1:0 shutdown complete.
W20260709 13:20:06.983148 17084 consensus_peers.cc:597] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d -> Peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Couldn't send request to peer 6f82dcb597824c149ec645f777a5ff6d. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:07.013236  7076 tablet_server.cc:179] TabletServer@127.6.233.2:0 shutting down...
W20260709 13:20:07.042073 17158 consensus_peers.cc:597] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b -> Peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Couldn't send request to peer 6f82dcb597824c149ec645f777a5ff6d. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:07.049523  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:07.050424  7076 tablet_replica.cc:333] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.051518  7076 raft_consensus.cc:2243] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.052199  7076 raft_consensus.cc:2272] T 56b6d36b98fc47afbda83f58ac7adf58 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.054311  7076 tablet_replica.cc:333] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.055001  7076 raft_consensus.cc:2243] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.055474  7076 raft_consensus.cc:2272] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.058380  7076 tablet_replica.cc:333] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.059310  7076 raft_consensus.cc:2243] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.060350  7076 raft_consensus.cc:2272] T 305dfc44e6ec46ed98df510d917e6250 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:07.061164 17084 consensus_peers.cc:597] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d -> Peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Couldn't send request to peer 6f82dcb597824c149ec645f777a5ff6d. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:07.062481 17159 consensus_peers.cc:597] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b -> Peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Couldn't send request to peer 0f4d1a1667f049b09139e68d548a4b4d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:07.063134  7076 tablet_replica.cc:333] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.064103  7076 raft_consensus.cc:2243] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.064795  7076 raft_consensus.cc:2272] T 3ba57d823da747d9acf8c7897a26c8b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.066710  7076 tablet_replica.cc:333] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.067183  7076 raft_consensus.cc:2243] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.067564  7076 raft_consensus.cc:2272] T 250e32bf965640efb0235518efa212b4 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.069548  7076 tablet_replica.cc:333] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.070063  7076 raft_consensus.cc:2243] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.070508  7076 raft_consensus.cc:2272] T c28d0ef9c91f454aac86f19472e7daa1 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.072414  7076 tablet_replica.cc:333] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.072978  7076 raft_consensus.cc:2243] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.073423  7076 raft_consensus.cc:2272] T 639bd84656354802813590c28338f69b P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.075457  7076 tablet_replica.cc:333] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.076027  7076 raft_consensus.cc:2243] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.076741  7076 raft_consensus.cc:2272] T cc33975be71a405f899d804b0d704b6d P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.079008  7076 tablet_replica.cc:333] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.079584  7076 raft_consensus.cc:2243] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.079991  7076 raft_consensus.cc:2272] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.082018  7076 tablet_replica.cc:333] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.082522  7076 raft_consensus.cc:2243] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.082924  7076 raft_consensus.cc:2272] T 78b497e987ff4bd9896969fb0582918d P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.086269  7076 tablet_replica.cc:333] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.087018  7076 raft_consensus.cc:2243] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.088080  7076 raft_consensus.cc:2272] T b92af6799d364350852d45a6ac8d3d91 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:07.088251 17084 consensus_peers.cc:597] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d -> Peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Couldn't send request to peer 6f82dcb597824c149ec645f777a5ff6d. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:07.090237  7076 tablet_replica.cc:333] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.090850  7076 raft_consensus.cc:2243] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.091295  7076 raft_consensus.cc:2272] T 5f1c173fc822467fafaf752685f855ba P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.093392  7076 tablet_replica.cc:333] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.093927  7076 raft_consensus.cc:2243] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.094712  7076 raft_consensus.cc:2272] T d5ebfeead72a40609742820ec626e3a0 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.096791  7076 tablet_replica.cc:333] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.097343  7076 raft_consensus.cc:2243] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.098096  7076 raft_consensus.cc:2272] T c65eb3ac940443fb9e3bd22a362ca078 P 0f4d1a1667f049b09139e68d548a4b4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.100400  7076 tablet_replica.cc:333] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.101099  7076 raft_consensus.cc:2243] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.101585  7076 raft_consensus.cc:2272] T beb60ee4583444808efb3a0a8e188db0 P 0f4d1a1667f049b09139e68d548a4b4d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:07.104351 17158 consensus_peers.cc:597] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b -> Peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Couldn't send request to peer 6f82dcb597824c149ec645f777a5ff6d. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:07.104465  7076 tablet_replica.cc:333] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.105185  7076 raft_consensus.cc:2243] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.105621  7076 raft_consensus.cc:2272] T b1acbced6dab4e7f813b3730aa63b641 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.107606  7076 tablet_replica.cc:333] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.108152  7076 raft_consensus.cc:2243] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.109066  7076 raft_consensus.cc:2272] T 034cfcd66ba440b889388cdbf7a863f2 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.111207  7076 tablet_replica.cc:333] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d: stopping tablet replica
I20260709 13:20:07.111680  7076 raft_consensus.cc:2243] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.112162  7076 raft_consensus.cc:2272] T d9cda90506714a9d8655e5443db45963 P 0f4d1a1667f049b09139e68d548a4b4d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.150743  7076 tablet_server.cc:196] TabletServer@127.6.233.2:0 shutdown complete.
W20260709 13:20:07.183079 17158 consensus_peers.cc:597] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b -> Peer 6f82dcb597824c149ec645f777a5ff6d (127.6.233.1:43913): Couldn't send request to peer 6f82dcb597824c149ec645f777a5ff6d. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.1:43913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:07.187392  7076 tablet_server.cc:179] TabletServer@127.6.233.3:0 shutting down...
I20260709 13:20:07.218488  7076 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:07.219415  7076 tablet_replica.cc:333] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.220306  7076 raft_consensus.cc:2243] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.221112  7076 raft_consensus.cc:2272] T 250e32bf965640efb0235518efa212b4 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.223392  7076 tablet_replica.cc:333] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.224017  7076 raft_consensus.cc:2243] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.224536  7076 raft_consensus.cc:2272] T d9cda90506714a9d8655e5443db45963 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.226424  7076 tablet_replica.cc:333] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.227151  7076 raft_consensus.cc:2243] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.227627  7076 raft_consensus.cc:2272] T 56b6d36b98fc47afbda83f58ac7adf58 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.230269  7076 tablet_replica.cc:333] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.230993  7076 raft_consensus.cc:2243] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.231454  7076 raft_consensus.cc:2272] T 305dfc44e6ec46ed98df510d917e6250 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:07.231696 17159 consensus_peers.cc:597] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b -> Peer 0f4d1a1667f049b09139e68d548a4b4d (127.6.233.2:37677): Couldn't send request to peer 0f4d1a1667f049b09139e68d548a4b4d. Status: Network error: Client connection negotiation failed: client connection to 127.6.233.2:37677: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:07.233650  7076 tablet_replica.cc:333] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.234382  7076 raft_consensus.cc:2243] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.234869  7076 raft_consensus.cc:2272] T 3ba57d823da747d9acf8c7897a26c8b4 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.236933  7076 tablet_replica.cc:333] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.237465  7076 raft_consensus.cc:2243] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.237907  7076 raft_consensus.cc:2272] T 034cfcd66ba440b889388cdbf7a863f2 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.240024  7076 tablet_replica.cc:333] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.240640  7076 raft_consensus.cc:2243] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.241098  7076 raft_consensus.cc:2272] T b1acbced6dab4e7f813b3730aa63b641 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.243041  7076 tablet_replica.cc:333] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.243599  7076 raft_consensus.cc:2243] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.244473  7076 raft_consensus.cc:2272] T 78b497e987ff4bd9896969fb0582918d P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.246862  7076 tablet_replica.cc:333] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.247457  7076 raft_consensus.cc:2243] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.247905  7076 raft_consensus.cc:2272] T cc33975be71a405f899d804b0d704b6d P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.249900  7076 tablet_replica.cc:333] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.250432  7076 raft_consensus.cc:2243] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.250855  7076 raft_consensus.cc:2272] T 9b5a9c19139b4c0dab6c6eaa17e61444 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.252961  7076 tablet_replica.cc:333] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.253515  7076 raft_consensus.cc:2243] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.253965  7076 raft_consensus.cc:2272] T 5f1c173fc822467fafaf752685f855ba P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.255996  7076 tablet_replica.cc:333] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.256633  7076 raft_consensus.cc:2243] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.257056  7076 raft_consensus.cc:2272] T d5ebfeead72a40609742820ec626e3a0 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.259002  7076 tablet_replica.cc:333] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.259518  7076 raft_consensus.cc:2243] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.259943  7076 raft_consensus.cc:2272] T b92af6799d364350852d45a6ac8d3d91 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.261843  7076 tablet_replica.cc:333] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.262359  7076 raft_consensus.cc:2243] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.262796  7076 raft_consensus.cc:2272] T d5ff0a0b20a143d0aaf15d6d82b08f45 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.264743  7076 tablet_replica.cc:333] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.265278  7076 raft_consensus.cc:2243] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:07.265707  7076 raft_consensus.cc:2272] T c65eb3ac940443fb9e3bd22a362ca078 P 85faa4767a01414fb8a8844e4855490b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.267422  7076 tablet_replica.cc:333] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.267903  7076 raft_consensus.cc:2243] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.268733  7076 raft_consensus.cc:2272] T beb60ee4583444808efb3a0a8e188db0 P 85faa4767a01414fb8a8844e4855490b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.271420  7076 tablet_replica.cc:333] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.271905  7076 raft_consensus.cc:2243] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.272735  7076 raft_consensus.cc:2272] T c28d0ef9c91f454aac86f19472e7daa1 P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.274610  7076 tablet_replica.cc:333] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b: stopping tablet replica
I20260709 13:20:07.275065  7076 raft_consensus.cc:2243] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.275892  7076 raft_consensus.cc:2272] T 639bd84656354802813590c28338f69b P 85faa4767a01414fb8a8844e4855490b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.305810  7076 tablet_server.cc:196] TabletServer@127.6.233.3:0 shutdown complete.
I20260709 13:20:07.338575  7076 master.cc:562] Master@127.6.233.62:33859 shutting down...
I20260709 13:20:07.367296  7076 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:07.367947  7076 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:07.368403  7076 tablet_replica.cc:333] T 00000000000000000000000000000000 P 404d64f8e3be442c848a69d690526274: stopping tablet replica
I20260709 13:20:07.390357  7076 master.cc:584] Master@127.6.233.62:33859 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12041 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25522 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (294924 ms total)
[  PASSED  ] 8 tests.
I20260709 13:20:07.448737  7076 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 395 messages since previous log ~14 seconds ago
I20260709 13:20:07.449016  7076 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 395 messages since previous log ~14 seconds ago
I20260709 13:20:07.449203  7076 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 392 messages since previous log ~15 seconds ago
I20260709 13:20:07.449419  7076 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:20:07.449620  7076 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:20:07.449823  7076 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~140 seconds ago
I20260709 13:20:07.450081  7076 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:20:07.450376  7076 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
